2024-04-17T05:12:59.858 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-17T05:12:59.859 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659843 --name rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi --description fs/permission/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_misc} -- /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659843/orig.config.yaml 2024-04-17T05:12:59.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T05:12:59.986 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659843 branch: wip-rishabh-testing-20240416.193735 description: fs/permission/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_misc} email: null first_in_suite: false job_id: '7659843' kernel: flavor: default kdb: true sha1: 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240416.193735 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client acl type: posix_acl client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: a8c84f5997950fd7d008204839253291d52e6eda ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a8c84f5997950fd7d008204839253291d52e6eda selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240416.193735 sha1: a8c84f5997950fd7d008204839253291d52e6eda owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 seed: 3521 sha1: a8c84f5997950fd7d008204839253291d52e6eda sleep_before_teardown: 0 subset: 410/512 suite: fs suite_branch: wip-rishabh-testing-20240416.193735 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a8c84f5997950fd7d008204839253291d52e6eda syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi123.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAdL68eAy9CzJlDJu+etqkdgVqxUyiv/bgcWuamJu5qIvE11quFoyFEKbOGMC7EK96u5Fv/O2JQGq16ZzGoswik= smithi164.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEOJMShfa2DFVnjO7ErSJ4KmA9IJsNhWcCGcgrOaRkhNNGBaeS7KXKuk01Ai9wz/XTU0l6wEmFd8jKWBUnf4j/Q= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - workunit: clients: all: - fs/misc/acl.sh - fs/misc/chmod.sh - fs/misc/dac_override.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 6c637841c215537a4502385240412f1966e0faab timestamp: 2024-04-17_04:58:44 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-17T05:12:59.987 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa; will attempt to use it 2024-04-17T05:12:59.988 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks 2024-04-17T05:12:59.988 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-17T05:12:59.989 INFO:teuthology.task.internal:Checking packages... 2024-04-17T05:13:00.016 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a8c84f5997950fd7d008204839253291d52e6eda' 2024-04-17T05:13:00.016 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-17T05:13:00.016 INFO:teuthology.packaging:ref: None 2024-04-17T05:13:00.016 INFO:teuthology.packaging:tag: None 2024-04-17T05:13:00.016 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240416.193735 2024-04-17T05:13:00.016 INFO:teuthology.packaging:sha1: a8c84f5997950fd7d008204839253291d52e6eda 2024-04-17T05:13:00.016 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240416.193735 2024-04-17T05:13:00.159 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3133.ga8c84f59 2024-04-17T05:13:00.161 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-17T05:13:00.171 INFO:teuthology.task.internal:no buildpackages task found 2024-04-17T05:13:00.171 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-17T05:13:00.183 INFO:teuthology.task.internal:Saving configuration 2024-04-17T05:13:00.200 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-17T05:13:00.210 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-17T05:13:00.234 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659843', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-17 05:07:42.921835', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAdL68eAy9CzJlDJu+etqkdgVqxUyiv/bgcWuamJu5qIvE11quFoyFEKbOGMC7EK96u5Fv/O2JQGq16ZzGoswik='} 2024-04-17T05:13:00.256 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659843', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-17 05:07:42.920495', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEOJMShfa2DFVnjO7ErSJ4KmA9IJsNhWcCGcgrOaRkhNNGBaeS7KXKuk01Ai9wz/XTU0l6wEmFd8jKWBUnf4j/Q='} 2024-04-17T05:13:00.256 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-17T05:13:00.265 INFO:teuthology.task.internal:roles: ubuntu@smithi123.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-17T05:13:00.266 INFO:teuthology.task.internal:roles: ubuntu@smithi164.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-17T05:13:00.266 INFO:teuthology.run_tasks:Running task console_log... 2024-04-17T05:13:00.345 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5c8b6d9160>, signals=[15]) 2024-04-17T05:13:00.345 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-17T05:13:00.355 INFO:teuthology.task.internal:Opening connections... 2024-04-17T05:13:00.355 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi123.front.sepia.ceph.com 2024-04-17T05:13:00.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:13:00.450 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi164.front.sepia.ceph.com 2024-04-17T05:13:00.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:13:00.536 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-17T05:13:00.545 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2024-04-17T05:13:00.563 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2024-04-17T05:13:00.564 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2024-04-17T05:13:00.621 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream" 2024-04-17T05:13:00.621 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="9" 2024-04-17T05:13:00.622 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos" 2024-04-17T05:13:00.622 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora" 2024-04-17T05:13:00.622 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="9" 2024-04-17T05:13:00.622 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el9" 2024-04-17T05:13:00.622 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T05:13:00.622 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2024-04-17T05:13:00.622 INFO:teuthology.orchestra.run.smithi123.stdout:LOGO="fedora-logo-icon" 2024-04-17T05:13:00.622 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T05:13:00.622 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/" 2024-04-17T05:13:00.622 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T05:13:00.622 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T05:13:00.622 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T05:13:00.623 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2024-04-17T05:13:00.650 DEBUG:teuthology.orchestra.run.smithi164:> uname -m 2024-04-17T05:13:00.668 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2024-04-17T05:13:00.668 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2024-04-17T05:13:00.724 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Stream" 2024-04-17T05:13:00.724 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="9" 2024-04-17T05:13:00.724 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos" 2024-04-17T05:13:00.724 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora" 2024-04-17T05:13:00.724 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="9" 2024-04-17T05:13:00.724 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el9" 2024-04-17T05:13:00.724 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T05:13:00.724 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2024-04-17T05:13:00.724 INFO:teuthology.orchestra.run.smithi164.stdout:LOGO="fedora-logo-icon" 2024-04-17T05:13:00.725 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T05:13:00.725 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/" 2024-04-17T05:13:00.725 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T05:13:00.725 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T05:13:00.725 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T05:13:00.725 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2024-04-17T05:13:00.750 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-17T05:13:00.760 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-17T05:13:00.772 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-17T05:13:00.772 DEBUG:teuthology.orchestra.run.smithi123:> test '!' -e /home/ubuntu/cephtest 2024-04-17T05:13:00.774 DEBUG:teuthology.orchestra.run.smithi164:> test '!' -e /home/ubuntu/cephtest 2024-04-17T05:13:00.790 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-17T05:13:00.800 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-17T05:13:00.800 DEBUG:teuthology.orchestra.run.smithi123:> test -z $(ls -A /var/lib/ceph) 2024-04-17T05:13:00.830 DEBUG:teuthology.orchestra.run.smithi164:> test -z $(ls -A /var/lib/ceph) 2024-04-17T05:13:00.930 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-17T05:13:00.984 INFO:teuthology.run_tasks:Running task kernel... 2024-04-17T05:13:01.001 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8'} 2024-04-17T05:13:01.001 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8'}}, timeout 300 2024-04-17T05:13:01.001 DEBUG:teuthology.orchestra.run.smithi123:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-17T05:13:01.002 DEBUG:teuthology.orchestra.run.smithi164:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-17T05:13:01.017 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T05:13:01.018 DEBUG:teuthology.task.kernel:sha1 for mon.a is 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-17T05:13:01.018 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8"... 2024-04-17T05:13:01.018 DEBUG:teuthology.orchestra.run.smithi123:> uname -r 2024-04-17T05:13:01.019 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T05:13:01.019 DEBUG:teuthology.task.kernel:sha1 for mon.b is 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-17T05:13:01.019 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8"... 2024-04-17T05:13:01.020 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2024-04-17T05:13:01.075 INFO:teuthology.orchestra.run.smithi164.stdout:5.14.0-361.el9.x86_64 2024-04-17T05:13:01.075 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-17T05:13:01.075 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-17T05:13:01.076 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-17T05:13:01.079 INFO:teuthology.orchestra.run.smithi123.stdout:5.14.0-361.el9.x86_64 2024-04-17T05:13:01.080 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-17T05:13:01.080 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-17T05:13:01.080 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-17T05:13:01.236 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum upgrade -y linux-firmware 2024-04-17T05:13:01.373 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum upgrade -y linux-firmware 2024-04-17T05:13:03.591 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS-9 - AppStream 9.0 MB/s | 6.7 MB 00:00 2024-04-17T05:13:03.851 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS-9 - AppStream 7.6 MB/s | 6.7 MB 00:00 2024-04-17T05:13:05.557 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS-9 - BaseOS 2.3 MB/s | 2.0 MB 00:00 2024-04-17T05:13:05.576 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS-9 - BaseOS 3.2 MB/s | 2.0 MB 00:00 2024-04-17T05:13:06.540 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.0 MB 00:00 2024-04-17T05:13:08.891 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - AppStream 16 MB/s | 19 MB 00:01 2024-04-17T05:13:14.033 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 6.2 MB 00:01 2024-04-17T05:13:15.357 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - BaseOS 873 kB/s | 8.0 MB 00:09 2024-04-17T05:13:15.475 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 16 kB 00:00 2024-04-17T05:13:17.751 INFO:teuthology.orchestra.run.smithi123.stdout:Extra Packages for Enterprise Linux 9.8 MB/s | 21 MB 00:02 2024-04-17T05:13:18.000 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - AppStream 12 MB/s | 19 MB 00:01 2024-04-17T05:13:22.542 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - CRB 6.2 MB/s | 6.2 MB 00:00 2024-04-17T05:13:22.692 INFO:teuthology.orchestra.run.smithi123.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2024-04-17T05:13:24.051 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 16 kB 00:00 2024-04-17T05:13:25.109 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-04-17T05:13:25.116 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-04-17T05:13:25.116 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2024-04-17T05:13:25.117 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-04-17T05:13:25.117 INFO:teuthology.orchestra.run.smithi123.stdout:Upgrading: 2024-04-17T05:13:25.117 INFO:teuthology.orchestra.run.smithi123.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-04-17T05:13:25.117 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:13:25.117 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-04-17T05:13:25.117 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-04-17T05:13:25.117 INFO:teuthology.orchestra.run.smithi123.stdout:Upgrade 1 Package 2024-04-17T05:13:25.117 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:13:25.118 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 375 M 2024-04-17T05:13:25.118 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-04-17T05:13:27.144 INFO:teuthology.orchestra.run.smithi164.stdout:Extra Packages for Enterprise Linux 7.1 MB/s | 21 MB 00:02 2024-04-17T05:13:32.244 INFO:teuthology.orchestra.run.smithi164.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-17T05:13:34.698 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-17T05:13:34.710 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-17T05:13:34.711 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-04-17T05:13:34.711 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-17T05:13:34.711 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrading: 2024-04-17T05:13:34.711 INFO:teuthology.orchestra.run.smithi164.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-04-17T05:13:34.711 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:13:34.711 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-17T05:13:34.711 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-04-17T05:13:34.711 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrade 1 Package 2024-04-17T05:13:34.711 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:13:34.711 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 375 M 2024-04-17T05:13:34.711 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-17T05:13:35.243 INFO:teuthology.orchestra.run.smithi123.stdout:linux-firmware-20240219-143.el9.noarch.rpm 37 MB/s | 375 MB 00:10 2024-04-17T05:13:35.244 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-04-17T05:13:35.244 INFO:teuthology.orchestra.run.smithi123.stdout:Total 37 MB/s | 375 MB 00:10 2024-04-17T05:13:35.245 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-04-17T05:13:35.329 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-04-17T05:13:35.329 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-04-17T05:13:37.746 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-04-17T05:13:37.746 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-04-17T05:13:42.319 INFO:teuthology.orchestra.run.smithi164.stdout:linux-firmware-20240219-143.el9.noarch.rpm 49 MB/s | 375 MB 00:07 2024-04-17T05:13:42.320 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-17T05:13:42.321 INFO:teuthology.orchestra.run.smithi164.stdout:Total 49 MB/s | 375 MB 00:07 2024-04-17T05:13:42.321 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-17T05:13:42.416 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-17T05:13:42.416 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-17T05:13:43.989 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-04-17T05:13:44.219 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-04-17T05:13:44.301 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-04-17T05:13:44.887 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-17T05:13:44.887 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-17T05:13:45.640 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-04-17T05:13:45.640 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-04-17T05:13:45.997 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-04-17T05:13:45.997 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:13:45.997 INFO:teuthology.orchestra.run.smithi123.stdout:Upgraded: 2024-04-17T05:13:45.997 INFO:teuthology.orchestra.run.smithi123.stdout: linux-firmware-20240219-143.el9.noarch 2024-04-17T05:13:45.997 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:13:45.997 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-04-17T05:13:46.291 INFO:teuthology.task.kernel:Downloading kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on mon.a... 2024-04-17T05:13:46.291 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-17T05:13:46.447 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/centos/9/flavors/default/x86_64/ 2024-04-17T05:13:46.447 DEBUG:teuthology.orchestra.run.smithi123:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g3f60ed14f7c1-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-17T05:13:46.449 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi123.front.sepia.ceph.com to complete... 2024-04-17T05:13:51.170 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-17T05:13:51.403 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-04-17T05:13:51.486 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-04-17T05:13:52.890 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-04-17T05:13:52.890 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-04-17T05:13:53.281 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-04-17T05:13:53.281 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:13:53.282 INFO:teuthology.orchestra.run.smithi164.stdout:Upgraded: 2024-04-17T05:13:53.282 INFO:teuthology.orchestra.run.smithi164.stdout: linux-firmware-20240219-143.el9.noarch 2024-04-17T05:13:53.282 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:13:53.282 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-17T05:13:53.597 INFO:teuthology.task.kernel:Downloading kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on mon.b... 2024-04-17T05:13:53.597 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-17T05:13:53.746 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/centos/9/flavors/default/x86_64/ 2024-04-17T05:13:53.746 DEBUG:teuthology.orchestra.run.smithi164:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g3f60ed14f7c1-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-17T05:13:53.748 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi164.front.sepia.ceph.com to complete... 2024-04-17T05:13:58.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17 05:13:58 URL:https://3.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g3f60ed14f7c1-1.x86_64.rpm [357344123/357344123] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-17T05:13:58.961 INFO:teuthology.orchestra.run.smithi123.stderr:FINISHED --2024-04-17 05:13:58-- 2024-04-17T05:13:58.961 INFO:teuthology.orchestra.run.smithi123.stderr:Total wall clock time: 12s 2024-04-17T05:13:58.961 INFO:teuthology.orchestra.run.smithi123.stderr:Downloaded: 1 files, 341M in 12s (27.9 MB/s) 2024-04-17T05:13:58.964 INFO:teuthology.task.kernel:Installing kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on mon.a... 2024-04-17T05:13:58.964 DEBUG:teuthology.orchestra.run.smithi123:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-17T05:14:01.008 INFO:teuthology.orchestra.run.smithi123.stdout:Verifying... ######################################## 2024-04-17T05:14:01.061 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing... ######################################## 2024-04-17T05:14:01.139 INFO:teuthology.orchestra.run.smithi123.stdout:Updating / installing... 2024-04-17T05:14:09.017 INFO:teuthology.orchestra.run.smithi123.stdout:kernel-6.9.0_rc3_g3f60ed14f7c1-1 ######################################## 2024-04-17T05:14:16.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17 05:14:16 URL:https://3.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g3f60ed14f7c1-1.x86_64.rpm [357344123/357344123] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-17T05:14:16.712 INFO:teuthology.orchestra.run.smithi164.stderr:FINISHED --2024-04-17 05:14:16-- 2024-04-17T05:14:16.712 INFO:teuthology.orchestra.run.smithi164.stderr:Total wall clock time: 23s 2024-04-17T05:14:16.712 INFO:teuthology.orchestra.run.smithi164.stderr:Downloaded: 1 files, 341M in 22s (15.2 MB/s) 2024-04-17T05:14:16.715 INFO:teuthology.task.kernel:Installing kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on mon.b... 2024-04-17T05:14:16.715 DEBUG:teuthology.orchestra.run.smithi164:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-17T05:14:18.770 INFO:teuthology.orchestra.run.smithi164.stdout:Verifying... ######################################## 2024-04-17T05:14:18.902 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing... ######################################## 2024-04-17T05:14:18.982 INFO:teuthology.orchestra.run.smithi164.stdout:Updating / installing... 2024-04-17T05:14:25.287 INFO:teuthology.orchestra.run.smithi123.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-17T05:14:26.999 INFO:teuthology.orchestra.run.smithi164.stdout:kernel-6.9.0_rc3_g3f60ed14f7c1-1 ######################################## 2024-04-17T05:14:43.604 INFO:teuthology.orchestra.run.smithi164.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-17T05:14:48.172 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi123.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-17T05:14:48.173 DEBUG:teuthology.orchestra.run.smithi123:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-17T05:14:48.243 INFO:teuthology.orchestra.run.smithi123.stdout:/boot/System.map-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T05:14:48.244 INFO:teuthology.orchestra.run.smithi123.stdout:/boot/config-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T05:14:48.244 INFO:teuthology.orchestra.run.smithi123.stdout:/boot/vmlinuz-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T05:14:48.244 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/System.map 2024-04-17T05:14:48.244 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/config 2024-04-17T05:14:48.244 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel 2024-04-17T05:14:48.244 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch 2024-04-17T05:14:48.244 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86 2024-04-17T05:14:48.244 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto 2024-04-17T05:14:48.244 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-17T05:14:48.244 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-17T05:14:48.244 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-17T05:14:48.244 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-17T05:14:48.245 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-17T05:14:48.245 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-17T05:14:48.245 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-17T05:14:48.245 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-17T05:14:48.245 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-17T05:14:48.245 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-17T05:14:48.245 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-17T05:14:48.245 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-17T05:14:48.245 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-17T05:14:48.245 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-17T05:14:48.245 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-17T05:14:48.245 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-17T05:14:48.245 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-17T05:14:48.246 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-17T05:14:48.246 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-17T05:14:48.246 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-17T05:14:48.246 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel 2024-04-17T05:14:48.246 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu 2024-04-17T05:14:48.246 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce 2024-04-17T05:14:48.246 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-17T05:14:48.246 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm 2024-04-17T05:14:48.246 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-17T05:14:48.246 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-17T05:14:48.246 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm.ko 2024-04-17T05:14:48.246 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto 2024-04-17T05:14:48.246 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ansi_cprng.ko 2024-04-17T05:14:48.246 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/anubis.ko 2024-04-17T05:14:48.247 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/arc4.ko 2024-04-17T05:14:48.247 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx 2024-04-17T05:14:48.247 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_memcpy.ko 2024-04-17T05:14:48.247 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_pq.ko 2024-04-17T05:14:48.247 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-17T05:14:48.247 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_tx.ko 2024-04-17T05:14:48.247 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_xor.ko 2024-04-17T05:14:48.247 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/raid6test.ko 2024-04-17T05:14:48.247 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authenc.ko 2024-04-17T05:14:48.247 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authencesn.ko 2024-04-17T05:14:48.247 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blake2b_generic.ko 2024-04-17T05:14:48.247 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_common.ko 2024-04-17T05:14:48.247 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_generic.ko 2024-04-17T05:14:48.247 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/camellia_generic.ko 2024-04-17T05:14:48.248 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast5_generic.ko 2024-04-17T05:14:48.248 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast6_generic.ko 2024-04-17T05:14:48.248 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast_common.ko 2024-04-17T05:14:48.248 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ccm.ko 2024-04-17T05:14:48.248 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cmac.ko 2024-04-17T05:14:48.248 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crc32_generic.ko 2024-04-17T05:14:48.248 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_engine.ko 2024-04-17T05:14:48.248 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_user.ko 2024-04-17T05:14:48.248 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cts.ko 2024-04-17T05:14:48.248 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/des_generic.ko 2024-04-17T05:14:48.248 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/dh_generic.ko 2024-04-17T05:14:48.248 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/echainiv.ko 2024-04-17T05:14:48.248 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/essiv.ko 2024-04-17T05:14:48.249 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/fcrypt.ko 2024-04-17T05:14:48.249 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/khazad.ko 2024-04-17T05:14:48.249 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4.ko 2024-04-17T05:14:48.249 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4hc.ko 2024-04-17T05:14:48.249 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/md4.ko 2024-04-17T05:14:48.249 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/michael_mic.ko 2024-04-17T05:14:48.249 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcbc.ko 2024-04-17T05:14:48.249 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcrypt.ko 2024-04-17T05:14:48.249 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/rmd160.ko 2024-04-17T05:14:48.249 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/seed.ko 2024-04-17T05:14:48.249 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/serpent_generic.ko 2024-04-17T05:14:48.249 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tcrypt.ko 2024-04-17T05:14:48.249 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tea.ko 2024-04-17T05:14:48.249 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_common.ko 2024-04-17T05:14:48.249 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_generic.ko 2024-04-17T05:14:48.250 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/vmac.ko 2024-04-17T05:14:48.250 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/wp512.ko 2024-04-17T05:14:48.250 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xcbc.ko 2024-04-17T05:14:48.250 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xor.ko 2024-04-17T05:14:48.250 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xxhash_generic.ko 2024-04-17T05:14:48.250 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers 2024-04-17T05:14:48.250 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi 2024-04-17T05:14:48.250 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-17T05:14:48.250 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_pad.ko 2024-04-17T05:14:48.250 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/ec_sys.ko 2024-04-17T05:14:48.250 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/platform_profile.ko 2024-04-17T05:14:48.250 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbs.ko 2024-04-17T05:14:48.250 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbshc.ko 2024-04-17T05:14:48.250 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/video.ko 2024-04-17T05:14:48.250 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata 2024-04-17T05:14:48.251 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/acard-ahci.ko 2024-04-17T05:14:48.251 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ahci_platform.ko 2024-04-17T05:14:48.251 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ata_generic.ko 2024-04-17T05:14:48.251 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/libahci_platform.ko 2024-04-17T05:14:48.251 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_acpi.ko 2024-04-17T05:14:48.251 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ali.ko 2024-04-17T05:14:48.251 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_amd.ko 2024-04-17T05:14:48.251 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_artop.ko 2024-04-17T05:14:48.251 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atiixp.ko 2024-04-17T05:14:48.251 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atp867x.ko 2024-04-17T05:14:48.251 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd640.ko 2024-04-17T05:14:48.251 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd64x.ko 2024-04-17T05:14:48.251 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cypress.ko 2024-04-17T05:14:48.251 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_efar.ko 2024-04-17T05:14:48.251 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt366.ko 2024-04-17T05:14:48.251 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt37x.ko 2024-04-17T05:14:48.252 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-17T05:14:48.252 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-17T05:14:48.252 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it8213.ko 2024-04-17T05:14:48.252 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it821x.ko 2024-04-17T05:14:48.252 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_jmicron.ko 2024-04-17T05:14:48.252 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_marvell.ko 2024-04-17T05:14:48.252 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_mpiix.ko 2024-04-17T05:14:48.252 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_netcell.ko 2024-04-17T05:14:48.252 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ninja32.ko 2024-04-17T05:14:48.252 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87410.ko 2024-04-17T05:14:48.252 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87415.ko 2024-04-17T05:14:48.252 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_oldpiix.ko 2024-04-17T05:14:48.252 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_opti.ko 2024-04-17T05:14:48.252 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_optidma.ko 2024-04-17T05:14:48.253 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pcmcia.ko 2024-04-17T05:14:48.253 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-17T05:14:48.253 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-17T05:14:48.253 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_piccolo.ko 2024-04-17T05:14:48.253 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_rdc.ko 2024-04-17T05:14:48.253 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sch.ko 2024-04-17T05:14:48.253 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_serverworks.ko 2024-04-17T05:14:48.253 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sil680.ko 2024-04-17T05:14:48.253 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sis.ko 2024-04-17T05:14:48.253 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sl82c105.ko 2024-04-17T05:14:48.253 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_triflex.ko 2024-04-17T05:14:48.253 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_via.ko 2024-04-17T05:14:48.253 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pdc_adma.ko 2024-04-17T05:14:48.253 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_inic162x.ko 2024-04-17T05:14:48.253 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_mv.ko 2024-04-17T05:14:48.253 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_nv.ko 2024-04-17T05:14:48.254 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_promise.ko 2024-04-17T05:14:48.254 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_qstor.ko 2024-04-17T05:14:48.254 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil.ko 2024-04-17T05:14:48.254 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil24.ko 2024-04-17T05:14:48.254 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sis.ko 2024-04-17T05:14:48.254 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_svw.ko 2024-04-17T05:14:48.254 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sx4.ko 2024-04-17T05:14:48.254 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_uli.ko 2024-04-17T05:14:48.254 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_via.ko 2024-04-17T05:14:48.254 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_vsc.ko 2024-04-17T05:14:48.254 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay 2024-04-17T05:14:48.254 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay/ks0108.ko 2024-04-17T05:14:48.254 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base 2024-04-17T05:14:48.254 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base/regmap 2024-04-17T05:14:48.255 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-17T05:14:48.255 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-17T05:14:48.255 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma 2024-04-17T05:14:48.255 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma/bcma.ko 2024-04-17T05:14:48.255 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block 2024-04-17T05:14:48.255 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe 2024-04-17T05:14:48.255 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe/aoe.ko 2024-04-17T05:14:48.255 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/brd.ko 2024-04-17T05:14:48.255 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd 2024-04-17T05:14:48.255 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd/drbd.ko 2024-04-17T05:14:48.255 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/floppy.ko 2024-04-17T05:14:48.255 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/loop.ko 2024-04-17T05:14:48.255 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx 2024-04-17T05:14:48.255 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-17T05:14:48.255 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/nbd.ko 2024-04-17T05:14:48.256 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk 2024-04-17T05:14:48.256 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk/null_blk.ko 2024-04-17T05:14:48.256 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/pktcdvd.ko 2024-04-17T05:14:48.256 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/rbd.ko 2024-04-17T05:14:48.256 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/virtio_blk.ko 2024-04-17T05:14:48.256 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback 2024-04-17T05:14:48.256 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-17T05:14:48.256 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkfront.ko 2024-04-17T05:14:48.256 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram 2024-04-17T05:14:48.256 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram/zram.ko 2024-04-17T05:14:48.256 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char 2024-04-17T05:14:48.256 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hangcheck-timer.ko 2024-04-17T05:14:48.256 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random 2024-04-17T05:14:48.256 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-17T05:14:48.256 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-17T05:14:48.257 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-17T05:14:48.257 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/via-rng.ko 2024-04-17T05:14:48.257 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-17T05:14:48.257 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi 2024-04-17T05:14:48.257 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-17T05:14:48.257 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-17T05:14:48.257 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-17T05:14:48.257 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-17T05:14:48.257 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-17T05:14:48.257 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-17T05:14:48.257 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/lp.ko 2024-04-17T05:14:48.257 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave 2024-04-17T05:14:48.257 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave/mwave.ko 2024-04-17T05:14:48.257 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ppdev.ko 2024-04-17T05:14:48.257 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tlclk.ko 2024-04-17T05:14:48.258 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm 2024-04-17T05:14:48.258 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm.ko 2024-04-17T05:14:48.258 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-17T05:14:48.258 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-17T05:14:48.258 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-17T05:14:48.258 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-17T05:14:48.258 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-17T05:14:48.258 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/uv_mmtimer.ko 2024-04-17T05:14:48.258 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/virtio_console.ko 2024-04-17T05:14:48.258 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq 2024-04-17T05:14:48.258 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-17T05:14:48.258 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-17T05:14:48.258 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-17T05:14:48.258 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-17T05:14:48.258 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-17T05:14:48.259 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-17T05:14:48.259 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto 2024-04-17T05:14:48.259 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp 2024-04-17T05:14:48.259 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-17T05:14:48.259 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp.ko 2024-04-17T05:14:48.259 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel 2024-04-17T05:14:48.259 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat 2024-04-17T05:14:48.259 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common 2024-04-17T05:14:48.259 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-17T05:14:48.259 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-17T05:14:48.259 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-17T05:14:48.259 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-aes.ko 2024-04-17T05:14:48.259 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-sha.ko 2024-04-17T05:14:48.259 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio 2024-04-17T05:14:48.260 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-17T05:14:48.260 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca 2024-04-17T05:14:48.260 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca/dca.ko 2024-04-17T05:14:48.260 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/devfreq 2024-04-17T05:14:48.260 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-17T05:14:48.260 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma 2024-04-17T05:14:48.260 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw 2024-04-17T05:14:48.260 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-17T05:14:48.260 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat 2024-04-17T05:14:48.260 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-17T05:14:48.260 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac 2024-04-17T05:14:48.260 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/amd64_edac.ko 2024-04-17T05:14:48.260 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/e752x_edac.ko 2024-04-17T05:14:48.260 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/edac_mce_amd.ko 2024-04-17T05:14:48.261 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3000_edac.ko 2024-04-17T05:14:48.261 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3200_edac.ko 2024-04-17T05:14:48.261 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5100_edac.ko 2024-04-17T05:14:48.261 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5400_edac.ko 2024-04-17T05:14:48.261 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7300_edac.ko 2024-04-17T05:14:48.261 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7core_edac.ko 2024-04-17T05:14:48.261 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i82975x_edac.ko 2024-04-17T05:14:48.261 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/ie31200_edac.ko 2024-04-17T05:14:48.261 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/sb_edac.ko 2024-04-17T05:14:48.261 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/x38_edac.ko 2024-04-17T05:14:48.261 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware 2024-04-17T05:14:48.261 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/edd.ko 2024-04-17T05:14:48.261 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-17T05:14:48.261 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio 2024-04-17T05:14:48.261 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-ich.ko 2024-04-17T05:14:48.262 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-17T05:14:48.262 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid 2024-04-17T05:14:48.262 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-appleir.ko 2024-04-17T05:14:48.262 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-aureal.ko 2024-04-17T05:14:48.262 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-axff.ko 2024-04-17T05:14:48.262 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-dr.ko 2024-04-17T05:14:48.262 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elecom.ko 2024-04-17T05:14:48.262 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elo.ko 2024-04-17T05:14:48.262 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-emsff.ko 2024-04-17T05:14:48.262 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gaff.ko 2024-04-17T05:14:48.262 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gt683r.ko 2024-04-17T05:14:48.262 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gyration.ko 2024-04-17T05:14:48.262 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-17T05:14:48.262 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-17T05:14:48.263 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtekff.ko 2024-04-17T05:14:48.263 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-hyperv.ko 2024-04-17T05:14:48.263 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-icade.ko 2024-04-17T05:14:48.263 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-keytouch.ko 2024-04-17T05:14:48.263 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-kye.ko 2024-04-17T05:14:48.263 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lcpower.ko 2024-04-17T05:14:48.263 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-led.ko 2024-04-17T05:14:48.263 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lenovo.ko 2024-04-17T05:14:48.263 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-17T05:14:48.263 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-17T05:14:48.263 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-multitouch.ko 2024-04-17T05:14:48.263 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-ortek.ko 2024-04-17T05:14:48.263 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-penmount.ko 2024-04-17T05:14:48.263 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-petalynx.ko 2024-04-17T05:14:48.263 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-picolcd.ko 2024-04-17T05:14:48.264 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-pl.ko 2024-04-17T05:14:48.264 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-plantronics.ko 2024-04-17T05:14:48.264 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-primax.ko 2024-04-17T05:14:48.264 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-rmi.ko 2024-04-17T05:14:48.264 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-17T05:14:48.264 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-common.ko 2024-04-17T05:14:48.264 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-17T05:14:48.264 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-17T05:14:48.264 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-17T05:14:48.264 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-17T05:14:48.264 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-17T05:14:48.264 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-17T05:14:48.264 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-17T05:14:48.264 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-17T05:14:48.265 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-17T05:14:48.265 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat.ko 2024-04-17T05:14:48.265 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-saitek.ko 2024-04-17T05:14:48.265 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-samsung.ko 2024-04-17T05:14:48.265 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-17T05:14:48.265 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sjoy.ko 2024-04-17T05:14:48.265 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sony.ko 2024-04-17T05:14:48.265 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-speedlink.ko 2024-04-17T05:14:48.265 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-steelseries.ko 2024-04-17T05:14:48.265 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sunplus.ko 2024-04-17T05:14:48.265 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-17T05:14:48.265 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tivo.ko 2024-04-17T05:14:48.265 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tmff.ko 2024-04-17T05:14:48.265 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-topseed.ko 2024-04-17T05:14:48.265 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-twinhan.ko 2024-04-17T05:14:48.266 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-uclogic.ko 2024-04-17T05:14:48.266 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-waltop.ko 2024-04-17T05:14:48.266 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-wiimote.ko 2024-04-17T05:14:48.266 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-xinmo.ko 2024-04-17T05:14:48.266 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zpff.ko 2024-04-17T05:14:48.266 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zydacron.ko 2024-04-17T05:14:48.266 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/uhid.ko 2024-04-17T05:14:48.266 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/wacom.ko 2024-04-17T05:14:48.266 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv 2024-04-17T05:14:48.266 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_balloon.ko 2024-04-17T05:14:48.266 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_utils.ko 2024-04-17T05:14:48.266 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_vmbus.ko 2024-04-17T05:14:48.266 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon 2024-04-17T05:14:48.266 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru.ko 2024-04-17T05:14:48.267 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru3.ko 2024-04-17T05:14:48.267 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-17T05:14:48.267 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7414.ko 2024-04-17T05:14:48.267 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7418.ko 2024-04-17T05:14:48.267 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adc128d818.ko 2024-04-17T05:14:48.267 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1025.ko 2024-04-17T05:14:48.267 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1026.ko 2024-04-17T05:14:48.267 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1029.ko 2024-04-17T05:14:48.267 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1031.ko 2024-04-17T05:14:48.267 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm9240.ko 2024-04-17T05:14:48.267 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ads7828.ko 2024-04-17T05:14:48.267 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7410.ko 2024-04-17T05:14:48.267 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7411.ko 2024-04-17T05:14:48.267 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7462.ko 2024-04-17T05:14:48.267 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7470.ko 2024-04-17T05:14:48.268 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7475.ko 2024-04-17T05:14:48.268 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7x10.ko 2024-04-17T05:14:48.268 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/amc6821.ko 2024-04-17T05:14:48.268 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/applesmc.ko 2024-04-17T05:14:48.268 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asb100.ko 2024-04-17T05:14:48.268 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asc7621.ko 2024-04-17T05:14:48.268 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-17T05:14:48.268 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/atxp1.ko 2024-04-17T05:14:48.268 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/coretemp.ko 2024-04-17T05:14:48.268 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-17T05:14:48.268 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dme1737.ko 2024-04-17T05:14:48.268 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds1621.ko 2024-04-17T05:14:48.268 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds620.ko 2024-04-17T05:14:48.268 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc1403.ko 2024-04-17T05:14:48.268 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc6w201.ko 2024-04-17T05:14:48.269 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71805f.ko 2024-04-17T05:14:48.269 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71882fg.ko 2024-04-17T05:14:48.269 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f75375s.ko 2024-04-17T05:14:48.269 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fam15h_power.ko 2024-04-17T05:14:48.269 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fschmd.ko 2024-04-17T05:14:48.269 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g760a.ko 2024-04-17T05:14:48.269 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g762.ko 2024-04-17T05:14:48.269 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl518sm.ko 2024-04-17T05:14:48.269 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl520sm.ko 2024-04-17T05:14:48.269 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-17T05:14:48.269 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5500_temp.ko 2024-04-17T05:14:48.269 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5k_amb.ko 2024-04-17T05:14:48.269 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmaem.ko 2024-04-17T05:14:48.269 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmpex.ko 2024-04-17T05:14:48.269 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina209.ko 2024-04-17T05:14:48.269 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina2xx.ko 2024-04-17T05:14:48.270 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/it87.ko 2024-04-17T05:14:48.270 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k10temp.ko 2024-04-17T05:14:48.270 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k8temp.ko 2024-04-17T05:14:48.270 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lineage-pem.ko 2024-04-17T05:14:48.270 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm63.ko 2024-04-17T05:14:48.270 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm73.ko 2024-04-17T05:14:48.270 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm75.ko 2024-04-17T05:14:48.270 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm77.ko 2024-04-17T05:14:48.270 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm78.ko 2024-04-17T05:14:48.270 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm80.ko 2024-04-17T05:14:48.270 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm83.ko 2024-04-17T05:14:48.270 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm85.ko 2024-04-17T05:14:48.270 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm87.ko 2024-04-17T05:14:48.270 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm90.ko 2024-04-17T05:14:48.271 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm92.ko 2024-04-17T05:14:48.271 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm93.ko 2024-04-17T05:14:48.271 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95234.ko 2024-04-17T05:14:48.271 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95241.ko 2024-04-17T05:14:48.271 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95245.ko 2024-04-17T05:14:48.271 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc2945.ko 2024-04-17T05:14:48.271 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4151.ko 2024-04-17T05:14:48.271 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4215.ko 2024-04-17T05:14:48.271 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4222.ko 2024-04-17T05:14:48.271 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4245.ko 2024-04-17T05:14:48.271 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4260.ko 2024-04-17T05:14:48.271 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4261.ko 2024-04-17T05:14:48.271 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max16065.ko 2024-04-17T05:14:48.271 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1619.ko 2024-04-17T05:14:48.272 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1668.ko 2024-04-17T05:14:48.272 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max197.ko 2024-04-17T05:14:48.272 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6639.ko 2024-04-17T05:14:48.272 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6650.ko 2024-04-17T05:14:48.272 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6697.ko 2024-04-17T05:14:48.272 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/mcp3021.ko 2024-04-17T05:14:48.272 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6683.ko 2024-04-17T05:14:48.272 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775-core.ko 2024-04-17T05:14:48.272 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775.ko 2024-04-17T05:14:48.272 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct7802.ko 2024-04-17T05:14:48.272 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87360.ko 2024-04-17T05:14:48.272 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87427.ko 2024-04-17T05:14:48.272 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pcf8591.ko 2024-04-17T05:14:48.272 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus 2024-04-17T05:14:48.272 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-17T05:14:48.273 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-17T05:14:48.273 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-17T05:14:48.273 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-17T05:14:48.273 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-17T05:14:48.273 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-17T05:14:48.273 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-17T05:14:48.273 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-17T05:14:48.273 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-17T05:14:48.273 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-17T05:14:48.273 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-17T05:14:48.273 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-17T05:14:48.273 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/powr1220.ko 2024-04-17T05:14:48.273 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5627.ko 2024-04-17T05:14:48.273 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5636.ko 2024-04-17T05:14:48.273 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-17T05:14:48.273 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht15.ko 2024-04-17T05:14:48.273 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht21.ko 2024-04-17T05:14:48.273 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/shtc1.ko 2024-04-17T05:14:48.274 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sis5595.ko 2024-04-17T05:14:48.274 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47b397.ko 2024-04-17T05:14:48.274 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m1.ko 2024-04-17T05:14:48.274 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m192.ko 2024-04-17T05:14:48.274 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/thmc50.ko 2024-04-17T05:14:48.274 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp102.ko 2024-04-17T05:14:48.274 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp103.ko 2024-04-17T05:14:48.274 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp401.ko 2024-04-17T05:14:48.274 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp421.ko 2024-04-17T05:14:48.274 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via-cputemp.ko 2024-04-17T05:14:48.274 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via686a.ko 2024-04-17T05:14:48.274 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt1211.ko 2024-04-17T05:14:48.274 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt8231.ko 2024-04-17T05:14:48.274 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627ehf.ko 2024-04-17T05:14:48.274 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627hf.ko 2024-04-17T05:14:48.275 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83781d.ko 2024-04-17T05:14:48.275 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83791d.ko 2024-04-17T05:14:48.275 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83792d.ko 2024-04-17T05:14:48.275 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83793.ko 2024-04-17T05:14:48.275 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83795.ko 2024-04-17T05:14:48.275 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l785ts.ko 2024-04-17T05:14:48.275 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l786ng.ko 2024-04-17T05:14:48.275 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c 2024-04-17T05:14:48.275 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos 2024-04-17T05:14:48.275 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-17T05:14:48.275 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-17T05:14:48.275 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses 2024-04-17T05:14:48.275 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-17T05:14:48.275 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-17T05:14:48.275 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-17T05:14:48.276 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-17T05:14:48.276 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-17T05:14:48.276 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-17T05:14:48.276 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-17T05:14:48.276 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-17T05:14:48.276 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-17T05:14:48.276 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-17T05:14:48.276 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-17T05:14:48.276 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-17T05:14:48.276 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-17T05:14:48.276 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-17T05:14:48.276 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-17T05:14:48.276 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-17T05:14:48.276 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-17T05:14:48.276 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-17T05:14:48.277 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-17T05:14:48.277 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-17T05:14:48.277 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-17T05:14:48.277 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-17T05:14:48.277 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-17T05:14:48.277 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-dev.ko 2024-04-17T05:14:48.277 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-mux.ko 2024-04-17T05:14:48.277 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-17T05:14:48.277 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-smbus.ko 2024-04-17T05:14:48.277 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-stub.ko 2024-04-17T05:14:48.277 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband 2024-04-17T05:14:48.277 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core 2024-04-17T05:14:48.277 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-17T05:14:48.277 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_core.ko 2024-04-17T05:14:48.277 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-17T05:14:48.278 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-17T05:14:48.278 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-17T05:14:48.278 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-17T05:14:48.278 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-17T05:14:48.278 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw 2024-04-17T05:14:48.278 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4 2024-04-17T05:14:48.278 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-17T05:14:48.278 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4 2024-04-17T05:14:48.278 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-17T05:14:48.278 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5 2024-04-17T05:14:48.278 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-17T05:14:48.278 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca 2024-04-17T05:14:48.278 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-17T05:14:48.278 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp 2024-04-17T05:14:48.278 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib 2024-04-17T05:14:48.279 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-17T05:14:48.279 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser 2024-04-17T05:14:48.279 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-17T05:14:48.279 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert 2024-04-17T05:14:48.279 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-17T05:14:48.279 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp 2024-04-17T05:14:48.279 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-17T05:14:48.279 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt 2024-04-17T05:14:48.279 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-17T05:14:48.279 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input 2024-04-17T05:14:48.279 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport 2024-04-17T05:14:48.279 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-17T05:14:48.279 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-17T05:14:48.279 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/gameport.ko 2024-04-17T05:14:48.280 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/joydev.ko 2024-04-17T05:14:48.280 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard 2024-04-17T05:14:48.280 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-17T05:14:48.280 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse 2024-04-17T05:14:48.280 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/appletouch.ko 2024-04-17T05:14:48.280 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/bcm5974.ko 2024-04-17T05:14:48.280 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/cyapatp.ko 2024-04-17T05:14:48.280 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-17T05:14:48.280 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/sermouse.ko 2024-04-17T05:14:48.280 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-17T05:14:48.280 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-17T05:14:48.280 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-17T05:14:48.280 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4 2024-04-17T05:14:48.280 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-17T05:14:48.280 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio 2024-04-17T05:14:48.281 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/altera_ps2.ko 2024-04-17T05:14:48.281 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/arc_ps2.ko 2024-04-17T05:14:48.281 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-17T05:14:48.281 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/serio_raw.ko 2024-04-17T05:14:48.281 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/sparse-keymap.ko 2024-04-17T05:14:48.281 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds 2024-04-17T05:14:48.281 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-blinkm.ko 2024-04-17T05:14:48.281 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm3530.ko 2024-04-17T05:14:48.281 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lp3944.ko 2024-04-17T05:14:48.281 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-ss4200.ko 2024-04-17T05:14:48.281 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger 2024-04-17T05:14:48.281 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-17T05:14:48.281 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-17T05:14:48.281 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-17T05:14:48.281 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-17T05:14:48.281 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-17T05:14:48.282 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-17T05:14:48.282 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-17T05:14:48.282 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-17T05:14:48.282 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-17T05:14:48.282 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md 2024-04-17T05:14:48.282 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache 2024-04-17T05:14:48.282 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache/bcache.ko 2024-04-17T05:14:48.282 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-bio-prison.ko 2024-04-17T05:14:48.282 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache-smq.ko 2024-04-17T05:14:48.282 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache.ko 2024-04-17T05:14:48.282 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-crypt.ko 2024-04-17T05:14:48.282 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-delay.ko 2024-04-17T05:14:48.282 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-flakey.ko 2024-04-17T05:14:48.282 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-log-userspace.ko 2024-04-17T05:14:48.283 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-multipath.ko 2024-04-17T05:14:48.283 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-queue-length.ko 2024-04-17T05:14:48.283 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-raid.ko 2024-04-17T05:14:48.283 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-round-robin.ko 2024-04-17T05:14:48.283 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-service-time.ko 2024-04-17T05:14:48.283 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-switch.ko 2024-04-17T05:14:48.283 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-thin-pool.ko 2024-04-17T05:14:48.283 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-verity.ko 2024-04-17T05:14:48.283 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data 2024-04-17T05:14:48.283 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-17T05:14:48.283 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid0.ko 2024-04-17T05:14:48.283 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid1.ko 2024-04-17T05:14:48.283 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid10.ko 2024-04-17T05:14:48.283 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid456.ko 2024-04-17T05:14:48.283 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message 2024-04-17T05:14:48.284 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion 2024-04-17T05:14:48.284 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptbase.ko 2024-04-17T05:14:48.284 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptctl.ko 2024-04-17T05:14:48.284 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptfc.ko 2024-04-17T05:14:48.284 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptlan.ko 2024-04-17T05:14:48.284 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptsas.ko 2024-04-17T05:14:48.284 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptscsih.ko 2024-04-17T05:14:48.284 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptspi.ko 2024-04-17T05:14:48.284 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd 2024-04-17T05:14:48.284 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_ich.ko 2024-04-17T05:14:48.284 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_sch.ko 2024-04-17T05:14:48.284 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/mfd-core.ko 2024-04-17T05:14:48.284 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/sm501.ko 2024-04-17T05:14:48.284 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/viperboard.ko 2024-04-17T05:14:48.284 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/vx855.ko 2024-04-17T05:14:48.284 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/wl1273-core.ko 2024-04-17T05:14:48.285 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc 2024-04-17T05:14:48.285 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl 2024-04-17T05:14:48.285 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-17T05:14:48.285 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds9802als.ko 2024-04-17T05:14:48.285 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds990x.ko 2024-04-17T05:14:48.285 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/bh1770glc.ko 2024-04-17T05:14:48.285 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710 2024-04-17T05:14:48.285 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710/cb710.ko 2024-04-17T05:14:48.285 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom 2024-04-17T05:14:48.285 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/at24.ko 2024-04-17T05:14:48.285 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-17T05:14:48.285 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/max6875.ko 2024-04-17T05:14:48.285 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/enclosure.ko 2024-04-17T05:14:48.285 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/hpilo.ko 2024-04-17T05:14:48.285 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29003.ko 2024-04-17T05:14:48.286 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29020.ko 2024-04-17T05:14:48.286 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d 2024-04-17T05:14:48.286 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-17T05:14:48.286 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-17T05:14:48.286 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei 2024-04-17T05:14:48.286 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-me.ko 2024-04-17T05:14:48.286 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-txe.ko 2024-04-17T05:14:48.286 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei.ko 2024-04-17T05:14:48.286 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-gru 2024-04-17T05:14:48.286 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-17T05:14:48.286 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp 2024-04-17T05:14:48.286 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-17T05:14:48.286 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-17T05:14:48.286 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-17T05:14:48.287 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_7xx1.ko 2024-04-17T05:14:48.287 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_core.ko 2024-04-17T05:14:48.287 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tsl2550.ko 2024-04-17T05:14:48.287 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_balloon.ko 2024-04-17T05:14:48.287 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci 2024-04-17T05:14:48.287 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-17T05:14:48.287 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net 2024-04-17T05:14:48.287 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding 2024-04-17T05:14:48.287 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding/bonding.ko 2024-04-17T05:14:48.287 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa 2024-04-17T05:14:48.287 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53 2024-04-17T05:14:48.287 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-17T05:14:48.287 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-17T05:14:48.287 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-17T05:14:48.288 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx 2024-04-17T05:14:48.288 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-17T05:14:48.288 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dummy.ko 2024-04-17T05:14:48.288 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/eql.ko 2024-04-17T05:14:48.288 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet 2024-04-17T05:14:48.288 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com 2024-04-17T05:14:48.288 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-17T05:14:48.288 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-17T05:14:48.288 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-17T05:14:48.288 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-17T05:14:48.288 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390 2024-04-17T05:14:48.288 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-17T05:14:48.288 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-17T05:14:48.288 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-17T05:14:48.288 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-17T05:14:48.289 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec 2024-04-17T05:14:48.289 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-17T05:14:48.289 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere 2024-04-17T05:14:48.289 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-17T05:14:48.289 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon 2024-04-17T05:14:48.289 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-17T05:14:48.289 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera 2024-04-17T05:14:48.289 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-17T05:14:48.289 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd 2024-04-17T05:14:48.289 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-17T05:14:48.289 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-17T05:14:48.289 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-17T05:14:48.289 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros 2024-04-17T05:14:48.289 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx 2024-04-17T05:14:48.290 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-17T05:14:48.290 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-17T05:14:48.290 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-17T05:14:48.290 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-17T05:14:48.290 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-17T05:14:48.290 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx 2024-04-17T05:14:48.290 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-17T05:14:48.290 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-17T05:14:48.290 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom 2024-04-17T05:14:48.290 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-17T05:14:48.290 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-17T05:14:48.290 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-17T05:14:48.290 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-17T05:14:48.290 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-17T05:14:48.290 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet 2024-04-17T05:14:48.291 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-17T05:14:48.291 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-17T05:14:48.291 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade 2024-04-17T05:14:48.291 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna 2024-04-17T05:14:48.291 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-17T05:14:48.291 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio 2024-04-17T05:14:48.291 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-17T05:14:48.291 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-17T05:14:48.291 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-17T05:14:48.291 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-17T05:14:48.291 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-17T05:14:48.291 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-17T05:14:48.291 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-17T05:14:48.291 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-17T05:14:48.292 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-17T05:14:48.292 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-17T05:14:48.292 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco 2024-04-17T05:14:48.292 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic 2024-04-17T05:14:48.292 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-17T05:14:48.292 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec 2024-04-17T05:14:48.292 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip 2024-04-17T05:14:48.292 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-17T05:14:48.292 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-17T05:14:48.292 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-17T05:14:48.292 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-17T05:14:48.292 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-17T05:14:48.292 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-17T05:14:48.292 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink 2024-04-17T05:14:48.292 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-17T05:14:48.293 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-17T05:14:48.293 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dnet.ko 2024-04-17T05:14:48.293 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex 2024-04-17T05:14:48.293 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet 2024-04-17T05:14:48.293 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-17T05:14:48.293 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ethoc.ko 2024-04-17T05:14:48.293 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/fealnx.ko 2024-04-17T05:14:48.293 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel 2024-04-17T05:14:48.293 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-17T05:14:48.293 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000 2024-04-17T05:14:48.293 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-17T05:14:48.293 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e 2024-04-17T05:14:48.293 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-17T05:14:48.293 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k 2024-04-17T05:14:48.293 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-17T05:14:48.293 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e 2024-04-17T05:14:48.294 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-17T05:14:48.294 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf 2024-04-17T05:14:48.294 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-17T05:14:48.294 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb 2024-04-17T05:14:48.294 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-17T05:14:48.294 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf 2024-04-17T05:14:48.294 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-17T05:14:48.294 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-17T05:14:48.294 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-17T05:14:48.294 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-17T05:14:48.294 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-17T05:14:48.294 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/jme.ko 2024-04-17T05:14:48.294 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell 2024-04-17T05:14:48.294 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-17T05:14:48.294 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-17T05:14:48.295 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-17T05:14:48.295 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox 2024-04-17T05:14:48.295 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-17T05:14:48.295 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-17T05:14:48.295 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-17T05:14:48.295 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-17T05:14:48.295 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-17T05:14:48.295 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-17T05:14:48.295 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel 2024-04-17T05:14:48.295 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-17T05:14:48.295 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom 2024-04-17T05:14:48.295 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-17T05:14:48.295 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-17T05:14:48.295 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi 2024-04-17T05:14:48.296 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-17T05:14:48.296 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-17T05:14:48.296 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion 2024-04-17T05:14:48.296 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-17T05:14:48.296 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia 2024-04-17T05:14:48.296 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-17T05:14:48.296 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines 2024-04-17T05:14:48.296 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-17T05:14:48.296 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-17T05:14:48.296 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic 2024-04-17T05:14:48.296 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-17T05:14:48.296 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-17T05:14:48.296 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-17T05:14:48.296 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-17T05:14:48.296 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-17T05:14:48.296 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc 2024-04-17T05:14:48.297 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-17T05:14:48.297 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek 2024-04-17T05:14:48.297 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-17T05:14:48.297 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-17T05:14:48.297 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-17T05:14:48.297 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-17T05:14:48.297 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rocker 2024-04-17T05:14:48.297 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-17T05:14:48.297 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc 2024-04-17T05:14:48.297 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-17T05:14:48.297 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan 2024-04-17T05:14:48.297 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-17T05:14:48.297 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis 2024-04-17T05:14:48.297 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-17T05:14:48.297 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-17T05:14:48.298 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc 2024-04-17T05:14:48.298 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-17T05:14:48.298 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-17T05:14:48.298 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-17T05:14:48.298 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-17T05:14:48.298 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro 2024-04-17T05:14:48.298 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-17T05:14:48.298 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-17T05:14:48.298 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-17T05:14:48.298 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun 2024-04-17T05:14:48.298 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-17T05:14:48.298 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-17T05:14:48.298 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-17T05:14:48.298 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-17T05:14:48.298 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti 2024-04-17T05:14:48.299 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-17T05:14:48.299 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti 2024-04-17T05:14:48.299 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-17T05:14:48.299 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via 2024-04-17T05:14:48.299 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-17T05:14:48.299 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-17T05:14:48.299 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet 2024-04-17T05:14:48.299 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-17T05:14:48.299 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-17T05:14:48.299 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom 2024-04-17T05:14:48.299 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-17T05:14:48.299 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/geneve.ko 2024-04-17T05:14:48.299 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv 2024-04-17T05:14:48.299 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-17T05:14:48.299 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154 2024-04-17T05:14:48.299 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-17T05:14:48.299 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ifb.ko 2024-04-17T05:14:48.300 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan 2024-04-17T05:14:48.300 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-17T05:14:48.300 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvlan.ko 2024-04-17T05:14:48.300 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvtap.ko 2024-04-17T05:14:48.300 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio 2024-04-17T05:14:48.300 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio.ko 2024-04-17T05:14:48.300 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-17T05:14:48.300 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-17T05:14:48.300 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-17T05:14:48.300 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mii.ko 2024-04-17T05:14:48.300 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/net_failover.ko 2024-04-17T05:14:48.300 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/netconsole.ko 2024-04-17T05:14:48.300 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/nlmon.ko 2024-04-17T05:14:48.300 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs 2024-04-17T05:14:48.300 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-17T05:14:48.300 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-17T05:14:48.301 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy 2024-04-17T05:14:48.301 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/amd.ko 2024-04-17T05:14:48.301 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-17T05:14:48.301 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-17T05:14:48.301 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-17T05:14:48.301 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm87xx.ko 2024-04-17T05:14:48.301 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/broadcom.ko 2024-04-17T05:14:48.301 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/cicada.ko 2024-04-17T05:14:48.301 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/davicom.ko 2024-04-17T05:14:48.301 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/dp83640.ko 2024-04-17T05:14:48.301 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/et1011c.ko 2024-04-17T05:14:48.301 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/icplus.ko 2024-04-17T05:14:48.301 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/lxt.ko 2024-04-17T05:14:48.301 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/marvell.ko 2024-04-17T05:14:48.301 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/micrel.ko 2024-04-17T05:14:48.302 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/national.ko 2024-04-17T05:14:48.302 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/phylink.ko 2024-04-17T05:14:48.302 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/qsemi.ko 2024-04-17T05:14:48.302 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/realtek.ko 2024-04-17T05:14:48.302 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/smsc.ko 2024-04-17T05:14:48.302 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/ste10Xp.ko 2024-04-17T05:14:48.302 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/vitesse.ko 2024-04-17T05:14:48.302 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp 2024-04-17T05:14:48.302 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-17T05:14:48.302 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_async.ko 2024-04-17T05:14:48.302 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-17T05:14:48.302 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-17T05:14:48.302 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-17T05:14:48.302 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-17T05:14:48.302 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppoe.ko 2024-04-17T05:14:48.303 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppox.ko 2024-04-17T05:14:48.303 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pptp.ko 2024-04-17T05:14:48.303 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip 2024-04-17T05:14:48.303 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/slhc.ko 2024-04-17T05:14:48.303 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/slip.ko 2024-04-17T05:14:48.303 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/sungem_phy.ko 2024-04-17T05:14:48.303 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/tap.ko 2024-04-17T05:14:48.303 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team 2024-04-17T05:14:48.303 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team.ko 2024-04-17T05:14:48.303 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-17T05:14:48.303 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-17T05:14:48.303 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-17T05:14:48.303 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_random.ko 2024-04-17T05:14:48.303 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-17T05:14:48.303 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/tun.ko 2024-04-17T05:14:48.304 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/veth.ko 2024-04-17T05:14:48.304 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/virtio_net.ko 2024-04-17T05:14:48.304 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3 2024-04-17T05:14:48.304 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-17T05:14:48.304 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan 2024-04-17T05:14:48.304 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan/vxlan.ko 2024-04-17T05:14:48.304 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback 2024-04-17T05:14:48.304 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-17T05:14:48.304 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netfront.ko 2024-04-17T05:14:48.304 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb 2024-04-17T05:14:48.304 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb/ntb.ko 2024-04-17T05:14:48.304 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme 2024-04-17T05:14:48.304 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host 2024-04-17T05:14:48.304 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme-core.ko 2024-04-17T05:14:48.304 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme.ko 2024-04-17T05:14:48.304 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport 2024-04-17T05:14:48.305 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport.ko 2024-04-17T05:14:48.305 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_cs.ko 2024-04-17T05:14:48.305 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_pc.ko 2024-04-17T05:14:48.305 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_serial.ko 2024-04-17T05:14:48.305 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci 2024-04-17T05:14:48.305 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug 2024-04-17T05:14:48.305 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-17T05:14:48.305 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/pcie 2024-04-17T05:14:48.305 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-17T05:14:48.305 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/xen-pcifront.ko 2024-04-17T05:14:48.305 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia 2024-04-17T05:14:48.305 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/i82092.ko 2024-04-17T05:14:48.305 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pd6729.ko 2024-04-17T05:14:48.305 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-17T05:14:48.305 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl 2024-04-17T05:14:48.306 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel 2024-04-17T05:14:48.306 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-17T05:14:48.306 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform 2024-04-17T05:14:48.306 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86 2024-04-17T05:14:48.306 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-17T05:14:48.306 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acerhdf.ko 2024-04-17T05:14:48.306 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-17T05:14:48.306 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-17T05:14:48.306 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-17T05:14:48.306 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-17T05:14:48.306 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-17T05:14:48.306 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-17T05:14:48.306 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-17T05:14:48.306 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-17T05:14:48.307 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-17T05:14:48.307 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/hdaps.ko 2024-04-17T05:14:48.307 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel 2024-04-17T05:14:48.307 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-17T05:14:48.307 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel_ips.ko 2024-04-17T05:14:48.307 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-17T05:14:48.307 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-17T05:14:48.307 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-17T05:14:48.307 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-17T05:14:48.307 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-17T05:14:48.307 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-17T05:14:48.307 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-17T05:14:48.307 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-17T05:14:48.307 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-17T05:14:48.307 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi.ko 2024-04-17T05:14:48.308 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap 2024-04-17T05:14:48.308 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-17T05:14:48.308 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-17T05:14:48.308 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps 2024-04-17T05:14:48.308 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients 2024-04-17T05:14:48.308 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-17T05:14:48.308 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-17T05:14:48.308 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps_parport.ko 2024-04-17T05:14:48.308 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/pps_core.ko 2024-04-17T05:14:48.308 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp 2024-04-17T05:14:48.308 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp.ko 2024-04-17T05:14:48.308 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp_kvm.ko 2024-04-17T05:14:48.308 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras 2024-04-17T05:14:48.308 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd 2024-04-17T05:14:48.308 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl 2024-04-17T05:14:48.309 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-17T05:14:48.309 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/fmpm.ko 2024-04-17T05:14:48.309 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc 2024-04-17T05:14:48.309 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-17T05:14:48.309 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-17T05:14:48.309 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-17T05:14:48.309 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-17T05:14:48.309 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-17T05:14:48.309 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-17T05:14:48.309 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-17T05:14:48.309 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-17T05:14:48.309 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-17T05:14:48.309 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-17T05:14:48.309 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-em3027.ko 2024-04-17T05:14:48.309 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-17T05:14:48.309 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-17T05:14:48.309 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-17T05:14:48.310 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-17T05:14:48.310 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-17T05:14:48.310 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-17T05:14:48.310 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max6900.ko 2024-04-17T05:14:48.310 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-17T05:14:48.310 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-17T05:14:48.310 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-17T05:14:48.310 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-17T05:14:48.310 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-17T05:14:48.310 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-17T05:14:48.310 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-17T05:14:48.310 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-17T05:14:48.310 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-17T05:14:48.311 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-17T05:14:48.311 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-17T05:14:48.311 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-17T05:14:48.311 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-x1205.ko 2024-04-17T05:14:48.311 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi 2024-04-17T05:14:48.311 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-9xxx.ko 2024-04-17T05:14:48.311 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-sas.ko 2024-04-17T05:14:48.311 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-xxxx.ko 2024-04-17T05:14:48.311 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/BusLogic.ko 2024-04-17T05:14:48.311 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/a100u2w.ko 2024-04-17T05:14:48.311 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid 2024-04-17T05:14:48.311 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-17T05:14:48.311 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/advansys.ko 2024-04-17T05:14:48.311 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx 2024-04-17T05:14:48.311 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-17T05:14:48.312 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-17T05:14:48.312 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/am53c974.ko 2024-04-17T05:14:48.312 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr 2024-04-17T05:14:48.312 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-17T05:14:48.312 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/atp870u.ko 2024-04-17T05:14:48.312 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi 2024-04-17T05:14:48.312 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-17T05:14:48.312 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa 2024-04-17T05:14:48.312 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa/bfa.ko 2024-04-17T05:14:48.312 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc 2024-04-17T05:14:48.312 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-17T05:14:48.312 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i 2024-04-17T05:14:48.312 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-17T05:14:48.312 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ch.ko 2024-04-17T05:14:48.312 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor 2024-04-17T05:14:48.313 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-17T05:14:48.313 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi 2024-04-17T05:14:48.313 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-17T05:14:48.313 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-17T05:14:48.313 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-17T05:14:48.313 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-17T05:14:48.313 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-17T05:14:48.313 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dc395x.ko 2024-04-17T05:14:48.313 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler 2024-04-17T05:14:48.313 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-17T05:14:48.313 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-17T05:14:48.313 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-17T05:14:48.313 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-17T05:14:48.313 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dmx3191d.ko 2024-04-17T05:14:48.314 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r 2024-04-17T05:14:48.314 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-17T05:14:48.314 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esp_scsi.ko 2024-04-17T05:14:48.314 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe 2024-04-17T05:14:48.314 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-17T05:14:48.314 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-17T05:14:48.314 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic 2024-04-17T05:14:48.314 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic/fnic.ko 2024-04-17T05:14:48.314 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hpsa.ko 2024-04-17T05:14:48.314 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hptiop.ko 2024-04-17T05:14:48.314 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hv_storvsc.ko 2024-04-17T05:14:48.314 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/initio.ko 2024-04-17T05:14:48.314 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ipr.ko 2024-04-17T05:14:48.314 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ips.ko 2024-04-17T05:14:48.315 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci 2024-04-17T05:14:48.315 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci/isci.ko 2024-04-17T05:14:48.315 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-17T05:14:48.315 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-17T05:14:48.315 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc 2024-04-17T05:14:48.315 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc/libfc.ko 2024-04-17T05:14:48.315 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi.ko 2024-04-17T05:14:48.315 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-17T05:14:48.315 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas 2024-04-17T05:14:48.315 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas/libsas.ko 2024-04-17T05:14:48.315 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc 2024-04-17T05:14:48.315 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-17T05:14:48.315 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid 2024-04-17T05:14:48.315 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid.ko 2024-04-17T05:14:48.315 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-17T05:14:48.315 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-17T05:14:48.316 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-17T05:14:48.316 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas 2024-04-17T05:14:48.316 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-17T05:14:48.316 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas 2024-04-17T05:14:48.316 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-17T05:14:48.316 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvumi.ko 2024-04-17T05:14:48.316 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001 2024-04-17T05:14:48.316 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-17T05:14:48.316 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pmcraid.ko 2024-04-17T05:14:48.316 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla1280.ko 2024-04-17T05:14:48.316 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx 2024-04-17T05:14:48.316 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-17T05:14:48.316 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-17T05:14:48.316 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx 2024-04-17T05:14:48.316 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-17T05:14:48.317 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/raid_class.ko 2024-04-17T05:14:48.317 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_debug.ko 2024-04-17T05:14:48.317 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-17T05:14:48.317 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-17T05:14:48.317 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-17T05:14:48.317 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-17T05:14:48.317 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-17T05:14:48.317 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ses.ko 2024-04-17T05:14:48.317 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/st.ko 2024-04-17T05:14:48.317 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/stex.ko 2024-04-17T05:14:48.317 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2 2024-04-17T05:14:48.317 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-17T05:14:48.317 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/virtio_scsi.ko 2024-04-17T05:14:48.317 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-17T05:14:48.318 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/wd719x.ko 2024-04-17T05:14:48.318 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb 2024-04-17T05:14:48.318 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb/ssb.ko 2024-04-17T05:14:48.318 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target 2024-04-17T05:14:48.318 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi 2024-04-17T05:14:48.318 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-17T05:14:48.318 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback 2024-04-17T05:14:48.318 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-17T05:14:48.318 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_file.ko 2024-04-17T05:14:48.318 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_iblock.ko 2024-04-17T05:14:48.318 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_mod.ko 2024-04-17T05:14:48.318 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_pscsi.ko 2024-04-17T05:14:48.318 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_user.ko 2024-04-17T05:14:48.318 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc 2024-04-17T05:14:48.318 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-17T05:14:48.319 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal 2024-04-17T05:14:48.319 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel 2024-04-17T05:14:48.319 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal 2024-04-17T05:14:48.319 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-17T05:14:48.319 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-17T05:14:48.319 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-17T05:14:48.319 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-17T05:14:48.319 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-17T05:14:48.319 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-17T05:14:48.319 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-17T05:14:48.319 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-17T05:14:48.319 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-17T05:14:48.319 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-17T05:14:48.319 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-17T05:14:48.320 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-17T05:14:48.321 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-17T05:14:48.321 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-17T05:14:48.321 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-17T05:14:48.321 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-17T05:14:48.322 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-17T05:14:48.322 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-17T05:14:48.322 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty 2024-04-17T05:14:48.322 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless 2024-04-17T05:14:48.322 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-17T05:14:48.322 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_gsm.ko 2024-04-17T05:14:48.322 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_hdlc.ko 2024-04-17T05:14:48.322 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/nozomi.ko 2024-04-17T05:14:48.322 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial 2024-04-17T05:14:48.322 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250 2024-04-17T05:14:48.322 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-17T05:14:48.322 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/arc_uart.ko 2024-04-17T05:14:48.322 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm 2024-04-17T05:14:48.322 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-17T05:14:48.322 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs 2024-04-17T05:14:48.323 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core 2024-04-17T05:14:48.323 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-17T05:14:48.323 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host 2024-04-17T05:14:48.323 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-17T05:14:48.323 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio 2024-04-17T05:14:48.323 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio.ko 2024-04-17T05:14:48.323 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_aec.ko 2024-04-17T05:14:48.323 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_cif.ko 2024-04-17T05:14:48.323 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_pci_generic.ko 2024-04-17T05:14:48.323 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_sercos3.ko 2024-04-17T05:14:48.323 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb 2024-04-17T05:14:48.323 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class 2024-04-17T05:14:48.323 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-acm.ko 2024-04-17T05:14:48.323 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-17T05:14:48.323 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usblp.ko 2024-04-17T05:14:48.324 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usbtmc.ko 2024-04-17T05:14:48.324 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host 2024-04-17T05:14:48.324 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-17T05:14:48.324 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image 2024-04-17T05:14:48.324 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/mdc800.ko 2024-04-17T05:14:48.324 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/microtek.ko 2024-04-17T05:14:48.324 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc 2024-04-17T05:14:48.324 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/adutux.ko 2024-04-17T05:14:48.324 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/appledisplay.ko 2024-04-17T05:14:48.324 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi26.ko 2024-04-17T05:14:48.324 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi62.ko 2024-04-17T05:14:48.324 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ezusb.ko 2024-04-17T05:14:48.324 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/idmouse.ko 2024-04-17T05:14:48.324 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/iowarrior.ko 2024-04-17T05:14:48.324 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-17T05:14:48.325 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ldusb.ko 2024-04-17T05:14:48.325 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/legousbtower.ko 2024-04-17T05:14:48.325 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga 2024-04-17T05:14:48.325 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-17T05:14:48.325 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-17T05:14:48.325 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usb3503.ko 2024-04-17T05:14:48.325 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usblcd.ko 2024-04-17T05:14:48.325 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-17T05:14:48.325 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/uss720.ko 2024-04-17T05:14:48.325 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/yurex.ko 2024-04-17T05:14:48.325 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy 2024-04-17T05:14:48.325 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-generic.ko 2024-04-17T05:14:48.325 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial 2024-04-17T05:14:48.325 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/aircable.ko 2024-04-17T05:14:48.325 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ark3116.ko 2024-04-17T05:14:48.326 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-17T05:14:48.326 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ch341.ko 2024-04-17T05:14:48.326 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cp210x.ko 2024-04-17T05:14:48.326 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cyberjack.ko 2024-04-17T05:14:48.326 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-17T05:14:48.326 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-17T05:14:48.326 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/empeg.ko 2024-04-17T05:14:48.326 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-17T05:14:48.326 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-17T05:14:48.326 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-17T05:14:48.326 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_ti.ko 2024-04-17T05:14:48.326 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipaq.ko 2024-04-17T05:14:48.326 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipw.ko 2024-04-17T05:14:48.326 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ir-usb.ko 2024-04-17T05:14:48.326 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-17T05:14:48.327 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan.ko 2024-04-17T05:14:48.327 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-17T05:14:48.327 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-17T05:14:48.327 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-17T05:14:48.327 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mct_u232.ko 2024-04-17T05:14:48.327 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7720.ko 2024-04-17T05:14:48.327 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7840.ko 2024-04-17T05:14:48.327 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/navman.ko 2024-04-17T05:14:48.327 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/omninet.ko 2024-04-17T05:14:48.327 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/opticon.ko 2024-04-17T05:14:48.327 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/option.ko 2024-04-17T05:14:48.327 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/oti6858.ko 2024-04-17T05:14:48.327 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/pl2303.ko 2024-04-17T05:14:48.327 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcaux.ko 2024-04-17T05:14:48.327 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcserial.ko 2024-04-17T05:14:48.328 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/quatech2.ko 2024-04-17T05:14:48.328 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/safe_serial.ko 2024-04-17T05:14:48.328 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/sierra.ko 2024-04-17T05:14:48.328 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-17T05:14:48.328 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ssu100.ko 2024-04-17T05:14:48.328 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/symbolserial.ko 2024-04-17T05:14:48.328 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-17T05:14:48.328 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-17T05:14:48.328 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_debug.ko 2024-04-17T05:14:48.328 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-17T05:14:48.328 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/visor.ko 2024-04-17T05:14:48.328 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/whiteheat.ko 2024-04-17T05:14:48.328 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-17T05:14:48.328 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage 2024-04-17T05:14:48.328 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/uas.ko 2024-04-17T05:14:48.328 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-17T05:14:48.328 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-17T05:14:48.329 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-17T05:14:48.329 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-17T05:14:48.329 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-17T05:14:48.329 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-17T05:14:48.329 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-17T05:14:48.329 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-karma.ko 2024-04-17T05:14:48.329 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-17T05:14:48.329 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-17T05:14:48.329 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-17T05:14:48.329 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-17T05:14:48.329 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-17T05:14:48.329 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/usb-storage.ko 2024-04-17T05:14:48.329 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip 2024-04-17T05:14:48.329 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-17T05:14:48.329 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-17T05:14:48.329 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-17T05:14:48.330 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio 2024-04-17T05:14:48.330 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci 2024-04-17T05:14:48.330 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-17T05:14:48.330 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-17T05:14:48.330 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio.ko 2024-04-17T05:14:48.330 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-17T05:14:48.330 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost 2024-04-17T05:14:48.330 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost.ko 2024-04-17T05:14:48.330 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-17T05:14:48.330 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_net.ko 2024-04-17T05:14:48.330 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_scsi.ko 2024-04-17T05:14:48.330 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video 2024-04-17T05:14:48.330 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight 2024-04-17T05:14:48.330 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/apple_bl.ko 2024-04-17T05:14:48.330 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lcd.ko 2024-04-17T05:14:48.331 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-17T05:14:48.331 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio 2024-04-17T05:14:48.331 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio.ko 2024-04-17T05:14:48.331 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_balloon.ko 2024-04-17T05:14:48.331 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_mmio.ko 2024-04-17T05:14:48.331 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_pci.ko 2024-04-17T05:14:48.331 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-17T05:14:48.331 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-17T05:14:48.331 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_ring.ko 2024-04-17T05:14:48.331 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1 2024-04-17T05:14:48.331 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters 2024-04-17T05:14:48.331 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2482.ko 2024-04-17T05:14:48.331 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2490.ko 2024-04-17T05:14:48.331 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves 2024-04-17T05:14:48.331 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-17T05:14:48.332 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-17T05:14:48.332 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-17T05:14:48.332 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-17T05:14:48.332 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-17T05:14:48.332 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-17T05:14:48.332 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-17T05:14:48.332 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-17T05:14:48.332 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-17T05:14:48.332 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-17T05:14:48.332 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-17T05:14:48.332 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/wire.ko 2024-04-17T05:14:48.332 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog 2024-04-17T05:14:48.332 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-17T05:14:48.332 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-17T05:14:48.332 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-17T05:14:48.332 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/hpwdt.ko 2024-04-17T05:14:48.332 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/i6300esb.ko 2024-04-17T05:14:48.333 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-17T05:14:48.333 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-17T05:14:48.333 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ib700wdt.ko 2024-04-17T05:14:48.333 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ibmasr.ko 2024-04-17T05:14:48.333 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-17T05:14:48.333 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-17T05:14:48.333 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it87_wdt.ko 2024-04-17T05:14:48.333 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/machzwd.ko 2024-04-17T05:14:48.333 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/nv_tco.ko 2024-04-17T05:14:48.333 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-17T05:14:48.333 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-17T05:14:48.333 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-17T05:14:48.333 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-17T05:14:48.333 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/softdog.ko 2024-04-17T05:14:48.333 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-17T05:14:48.333 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/via_wdt.ko 2024-04-17T05:14:48.334 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-17T05:14:48.334 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-17T05:14:48.334 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-17T05:14:48.334 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wdt_pci.ko 2024-04-17T05:14:48.334 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/xen_wdt.ko 2024-04-17T05:14:48.334 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen 2024-04-17T05:14:48.334 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-17T05:14:48.334 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-evtchn.ko 2024-04-17T05:14:48.334 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntalloc.ko 2024-04-17T05:14:48.334 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntdev.ko 2024-04-17T05:14:48.334 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback 2024-04-17T05:14:48.334 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-17T05:14:48.334 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-privcmd.ko 2024-04-17T05:14:48.334 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs 2024-04-17T05:14:48.335 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-17T05:14:48.335 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs 2024-04-17T05:14:48.335 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p 2024-04-17T05:14:48.335 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p/9p.ko 2024-04-17T05:14:48.335 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs 2024-04-17T05:14:48.335 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs/affs.ko 2024-04-17T05:14:48.335 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs 2024-04-17T05:14:48.335 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs/befs.ko 2024-04-17T05:14:48.335 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/binfmt_misc.ko 2024-04-17T05:14:48.335 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs 2024-04-17T05:14:48.335 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs/btrfs.ko 2024-04-17T05:14:48.335 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles 2024-04-17T05:14:48.335 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles/cachefiles.ko 2024-04-17T05:14:48.335 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph 2024-04-17T05:14:48.336 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph/ceph.ko 2024-04-17T05:14:48.336 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda 2024-04-17T05:14:48.336 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda/coda.ko 2024-04-17T05:14:48.336 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs 2024-04-17T05:14:48.336 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs/cramfs.ko 2024-04-17T05:14:48.336 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm 2024-04-17T05:14:48.336 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm/dlm.ko 2024-04-17T05:14:48.336 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ecryptfs 2024-04-17T05:14:48.336 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-17T05:14:48.336 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs 2024-04-17T05:14:48.336 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs/f2fs.ko 2024-04-17T05:14:48.336 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat 2024-04-17T05:14:48.336 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/fat.ko 2024-04-17T05:14:48.336 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/msdos.ko 2024-04-17T05:14:48.336 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/vfat.ko 2024-04-17T05:14:48.336 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse 2024-04-17T05:14:48.337 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/cuse.ko 2024-04-17T05:14:48.337 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/fuse.ko 2024-04-17T05:14:48.337 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2 2024-04-17T05:14:48.337 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2/gfs2.ko 2024-04-17T05:14:48.337 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs 2024-04-17T05:14:48.337 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs/hfs.ko 2024-04-17T05:14:48.337 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus 2024-04-17T05:14:48.337 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus/hfsplus.ko 2024-04-17T05:14:48.337 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs 2024-04-17T05:14:48.337 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs/isofs.ko 2024-04-17T05:14:48.337 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs 2024-04-17T05:14:48.337 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs/jfs.ko 2024-04-17T05:14:48.337 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd 2024-04-17T05:14:48.337 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd/lockd.ko 2024-04-17T05:14:48.338 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix 2024-04-17T05:14:48.338 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix/minix.ko 2024-04-17T05:14:48.338 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs 2024-04-17T05:14:48.338 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs/netfs.ko 2024-04-17T05:14:48.338 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs 2024-04-17T05:14:48.338 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout 2024-04-17T05:14:48.338 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-17T05:14:48.338 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout 2024-04-17T05:14:48.338 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-17T05:14:48.338 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout 2024-04-17T05:14:48.338 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-17T05:14:48.338 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfs.ko 2024-04-17T05:14:48.338 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv3.ko 2024-04-17T05:14:48.338 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv4.ko 2024-04-17T05:14:48.339 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common 2024-04-17T05:14:48.339 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/grace.ko 2024-04-17T05:14:48.339 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/nfs_acl.ko 2024-04-17T05:14:48.339 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd 2024-04-17T05:14:48.339 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd/nfsd.ko 2024-04-17T05:14:48.339 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2 2024-04-17T05:14:48.339 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2/nilfs2.ko 2024-04-17T05:14:48.339 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls 2024-04-17T05:14:48.339 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-celtic.ko 2024-04-17T05:14:48.339 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-centeuro.ko 2024-04-17T05:14:48.339 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-croatian.ko 2024-04-17T05:14:48.339 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-cyrillic.ko 2024-04-17T05:14:48.339 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-gaelic.ko 2024-04-17T05:14:48.339 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-greek.ko 2024-04-17T05:14:48.339 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-iceland.ko 2024-04-17T05:14:48.340 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-inuit.ko 2024-04-17T05:14:48.340 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-roman.ko 2024-04-17T05:14:48.340 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-romanian.ko 2024-04-17T05:14:48.340 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-turkish.ko 2024-04-17T05:14:48.340 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1250.ko 2024-04-17T05:14:48.340 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1251.ko 2024-04-17T05:14:48.340 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1255.ko 2024-04-17T05:14:48.340 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp737.ko 2024-04-17T05:14:48.340 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp775.ko 2024-04-17T05:14:48.340 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp850.ko 2024-04-17T05:14:48.340 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp852.ko 2024-04-17T05:14:48.340 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp855.ko 2024-04-17T05:14:48.340 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp857.ko 2024-04-17T05:14:48.340 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp860.ko 2024-04-17T05:14:48.341 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp861.ko 2024-04-17T05:14:48.341 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp862.ko 2024-04-17T05:14:48.341 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp863.ko 2024-04-17T05:14:48.341 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp864.ko 2024-04-17T05:14:48.341 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp865.ko 2024-04-17T05:14:48.341 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp866.ko 2024-04-17T05:14:48.341 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp869.ko 2024-04-17T05:14:48.341 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp874.ko 2024-04-17T05:14:48.341 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp932.ko 2024-04-17T05:14:48.341 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp936.ko 2024-04-17T05:14:48.341 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp949.ko 2024-04-17T05:14:48.341 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp950.ko 2024-04-17T05:14:48.341 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_euc-jp.ko 2024-04-17T05:14:48.341 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-1.ko 2024-04-17T05:14:48.341 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-13.ko 2024-04-17T05:14:48.341 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-14.ko 2024-04-17T05:14:48.342 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-15.ko 2024-04-17T05:14:48.342 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-2.ko 2024-04-17T05:14:48.342 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-3.ko 2024-04-17T05:14:48.342 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-4.ko 2024-04-17T05:14:48.342 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-5.ko 2024-04-17T05:14:48.342 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-6.ko 2024-04-17T05:14:48.342 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-7.ko 2024-04-17T05:14:48.342 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-9.ko 2024-04-17T05:14:48.342 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-r.ko 2024-04-17T05:14:48.342 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-ru.ko 2024-04-17T05:14:48.342 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-u.ko 2024-04-17T05:14:48.342 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-17T05:14:48.342 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_utf8.ko 2024-04-17T05:14:48.342 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2 2024-04-17T05:14:48.342 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster 2024-04-17T05:14:48.343 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-17T05:14:48.343 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm 2024-04-17T05:14:48.343 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-17T05:14:48.343 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs 2024-04-17T05:14:48.343 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-17T05:14:48.343 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2.ko 2024-04-17T05:14:48.343 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-17T05:14:48.343 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-17T05:14:48.343 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-17T05:14:48.343 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs 2024-04-17T05:14:48.343 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs/overlay.ko 2024-04-17T05:14:48.343 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore 2024-04-17T05:14:48.343 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore/ramoops.ko 2024-04-17T05:14:48.343 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs 2024-04-17T05:14:48.344 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs/reiserfs.ko 2024-04-17T05:14:48.344 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs 2024-04-17T05:14:48.344 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs/romfs.ko 2024-04-17T05:14:48.344 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb 2024-04-17T05:14:48.344 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client 2024-04-17T05:14:48.344 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client/cifs.ko 2024-04-17T05:14:48.344 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common 2024-04-17T05:14:48.344 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_arc4.ko 2024-04-17T05:14:48.344 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_md4.ko 2024-04-17T05:14:48.344 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs 2024-04-17T05:14:48.344 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs/squashfs.ko 2024-04-17T05:14:48.344 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv 2024-04-17T05:14:48.344 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv/sysv.ko 2024-04-17T05:14:48.344 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf 2024-04-17T05:14:48.344 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf/udf.ko 2024-04-17T05:14:48.344 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs 2024-04-17T05:14:48.345 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs/ufs.ko 2024-04-17T05:14:48.345 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs 2024-04-17T05:14:48.345 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs/xfs.ko 2024-04-17T05:14:48.345 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel 2024-04-17T05:14:48.345 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/rcu 2024-04-17T05:14:48.345 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/rcu/rcutorture.ko 2024-04-17T05:14:48.345 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/torture.ko 2024-04-17T05:14:48.345 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/trace 2024-04-17T05:14:48.345 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-17T05:14:48.345 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib 2024-04-17T05:14:48.345 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/asn1_encoder.ko 2024-04-17T05:14:48.345 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc-itu-t.ko 2024-04-17T05:14:48.345 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc8.ko 2024-04-17T05:14:48.345 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto 2024-04-17T05:14:48.345 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libarc4.ko 2024-04-17T05:14:48.346 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libdes.ko 2024-04-17T05:14:48.346 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/libcrc32c.ko 2024-04-17T05:14:48.346 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lru_cache.ko 2024-04-17T05:14:48.346 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4 2024-04-17T05:14:48.346 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4_compress.ko 2024-04-17T05:14:48.346 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4hc_compress.ko 2024-04-17T05:14:48.346 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math 2024-04-17T05:14:48.346 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math/cordic.ko 2024-04-17T05:14:48.346 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6 2024-04-17T05:14:48.346 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6/raid6_pq.ko 2024-04-17T05:14:48.346 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon 2024-04-17T05:14:48.346 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-17T05:14:48.346 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_bm.ko 2024-04-17T05:14:48.346 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_fsm.ko 2024-04-17T05:14:48.347 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_kmp.ko 2024-04-17T05:14:48.347 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/zstd 2024-04-17T05:14:48.347 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/zstd/zstd_compress.ko 2024-04-17T05:14:48.347 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm 2024-04-17T05:14:48.347 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm/hwpoison-inject.ko 2024-04-17T05:14:48.347 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net 2024-04-17T05:14:48.347 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan 2024-04-17T05:14:48.347 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/6lowpan.ko 2024-04-17T05:14:48.347 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_dest.ko 2024-04-17T05:14:48.347 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_fragment.ko 2024-04-17T05:14:48.347 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_hop.ko 2024-04-17T05:14:48.347 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-17T05:14:48.347 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_mobility.ko 2024-04-17T05:14:48.347 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_routing.ko 2024-04-17T05:14:48.347 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_udp.ko 2024-04-17T05:14:48.348 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802 2024-04-17T05:14:48.348 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/garp.ko 2024-04-17T05:14:48.348 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/mrp.ko 2024-04-17T05:14:48.348 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/p8022.ko 2024-04-17T05:14:48.348 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/psnap.ko 2024-04-17T05:14:48.348 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/stp.ko 2024-04-17T05:14:48.348 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q 2024-04-17T05:14:48.348 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q/8021q.ko 2024-04-17T05:14:48.348 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p 2024-04-17T05:14:48.348 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet.ko 2024-04-17T05:14:48.348 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_fd.ko 2024-04-17T05:14:48.348 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_rdma.ko 2024-04-17T05:14:48.348 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_virtio.ko 2024-04-17T05:14:48.348 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv 2024-04-17T05:14:48.349 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv/batman-adv.ko 2024-04-17T05:14:48.349 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge 2024-04-17T05:14:48.349 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/br_netfilter.ko 2024-04-17T05:14:48.349 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/bridge.ko 2024-04-17T05:14:48.349 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter 2024-04-17T05:14:48.349 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-17T05:14:48.349 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-17T05:14:48.349 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-17T05:14:48.349 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-17T05:14:48.349 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-17T05:14:48.349 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-17T05:14:48.349 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-17T05:14:48.349 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-17T05:14:48.349 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-17T05:14:48.350 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-17T05:14:48.350 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-17T05:14:48.350 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-17T05:14:48.350 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-17T05:14:48.350 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-17T05:14:48.350 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-17T05:14:48.350 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-17T05:14:48.350 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-17T05:14:48.350 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-17T05:14:48.350 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-17T05:14:48.350 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-17T05:14:48.350 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtables.ko 2024-04-17T05:14:48.350 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-17T05:14:48.350 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-17T05:14:48.350 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-17T05:14:48.351 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph 2024-04-17T05:14:48.351 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph/libceph.ko 2024-04-17T05:14:48.351 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core 2024-04-17T05:14:48.351 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/failover.ko 2024-04-17T05:14:48.351 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/pktgen.ko 2024-04-17T05:14:48.351 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp 2024-04-17T05:14:48.351 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp.ko 2024-04-17T05:14:48.351 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_diag.ko 2024-04-17T05:14:48.351 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv4.ko 2024-04-17T05:14:48.351 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv6.ko 2024-04-17T05:14:48.351 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dns_resolver 2024-04-17T05:14:48.351 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dns_resolver/dns_resolver.ko 2024-04-17T05:14:48.351 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa 2024-04-17T05:14:48.351 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/dsa_core.ko 2024-04-17T05:14:48.351 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_brcm.ko 2024-04-17T05:14:48.352 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_dsa.ko 2024-04-17T05:14:48.352 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_none.ko 2024-04-17T05:14:48.352 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_trailer.ko 2024-04-17T05:14:48.352 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154 2024-04-17T05:14:48.352 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan 2024-04-17T05:14:48.352 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-17T05:14:48.352 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154.ko 2024-04-17T05:14:48.352 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-17T05:14:48.352 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4 2024-04-17T05:14:48.352 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ah4.ko 2024-04-17T05:14:48.352 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/esp4.ko 2024-04-17T05:14:48.352 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/fou.ko 2024-04-17T05:14:48.352 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/gre.ko 2024-04-17T05:14:48.352 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/inet_diag.ko 2024-04-17T05:14:48.352 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_gre.ko 2024-04-17T05:14:48.353 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_tunnel.ko 2024-04-17T05:14:48.353 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_vti.ko 2024-04-17T05:14:48.353 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipcomp.ko 2024-04-17T05:14:48.353 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipip.ko 2024-04-17T05:14:48.353 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter 2024-04-17T05:14:48.353 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-17T05:14:48.353 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-17T05:14:48.353 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-17T05:14:48.353 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-17T05:14:48.353 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-17T05:14:48.353 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-17T05:14:48.353 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-17T05:14:48.353 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-17T05:14:48.353 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-17T05:14:48.353 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-17T05:14:48.354 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-17T05:14:48.354 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-17T05:14:48.354 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-17T05:14:48.354 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-17T05:14:48.354 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-17T05:14:48.354 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-17T05:14:48.354 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-17T05:14:48.354 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-17T05:14:48.354 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-17T05:14:48.354 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-17T05:14:48.354 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-17T05:14:48.354 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_bic.ko 2024-04-17T05:14:48.354 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_dctcp.ko 2024-04-17T05:14:48.354 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_diag.ko 2024-04-17T05:14:48.355 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_highspeed.ko 2024-04-17T05:14:48.355 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_htcp.ko 2024-04-17T05:14:48.355 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_hybla.ko 2024-04-17T05:14:48.355 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_illinois.ko 2024-04-17T05:14:48.355 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_lp.ko 2024-04-17T05:14:48.355 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_scalable.ko 2024-04-17T05:14:48.355 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_vegas.ko 2024-04-17T05:14:48.355 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_veno.ko 2024-04-17T05:14:48.355 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_westwood.ko 2024-04-17T05:14:48.355 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_yeah.ko 2024-04-17T05:14:48.355 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tunnel4.ko 2024-04-17T05:14:48.355 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_diag.ko 2024-04-17T05:14:48.355 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_tunnel.ko 2024-04-17T05:14:48.355 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-17T05:14:48.355 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6 2024-04-17T05:14:48.356 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ah6.ko 2024-04-17T05:14:48.356 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/esp6.ko 2024-04-17T05:14:48.356 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/fou6.ko 2024-04-17T05:14:48.356 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_tunnel.ko 2024-04-17T05:14:48.356 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-17T05:14:48.356 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_vti.ko 2024-04-17T05:14:48.356 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ipcomp6.ko 2024-04-17T05:14:48.356 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter 2024-04-17T05:14:48.356 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-17T05:14:48.356 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-17T05:14:48.356 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-17T05:14:48.356 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-17T05:14:48.356 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-17T05:14:48.356 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-17T05:14:48.356 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-17T05:14:48.357 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-17T05:14:48.357 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-17T05:14:48.357 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-17T05:14:48.357 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-17T05:14:48.357 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-17T05:14:48.357 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-17T05:14:48.357 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-17T05:14:48.357 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-17T05:14:48.357 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-17T05:14:48.357 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-17T05:14:48.357 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-17T05:14:48.357 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-17T05:14:48.357 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-17T05:14:48.357 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-17T05:14:48.357 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-17T05:14:48.358 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-17T05:14:48.358 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-17T05:14:48.358 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/sit.ko 2024-04-17T05:14:48.358 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/tunnel6.ko 2024-04-17T05:14:48.358 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-17T05:14:48.358 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key 2024-04-17T05:14:48.358 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key/af_key.ko 2024-04-17T05:14:48.358 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp 2024-04-17T05:14:48.358 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_core.ko 2024-04-17T05:14:48.358 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-17T05:14:48.358 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_eth.ko 2024-04-17T05:14:48.358 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip.ko 2024-04-17T05:14:48.358 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip6.ko 2024-04-17T05:14:48.358 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_netlink.ko 2024-04-17T05:14:48.358 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ppp.ko 2024-04-17T05:14:48.359 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc 2024-04-17T05:14:48.359 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc/llc.ko 2024-04-17T05:14:48.359 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154 2024-04-17T05:14:48.359 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154/mac802154.ko 2024-04-17T05:14:48.359 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls 2024-04-17T05:14:48.359 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls/mpls_gso.ko 2024-04-17T05:14:48.359 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter 2024-04-17T05:14:48.359 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset 2024-04-17T05:14:48.359 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set.ko 2024-04-17T05:14:48.359 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-17T05:14:48.359 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-17T05:14:48.359 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-17T05:14:48.359 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-17T05:14:48.359 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-17T05:14:48.359 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-17T05:14:48.359 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-17T05:14:48.360 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-17T05:14:48.360 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-17T05:14:48.360 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-17T05:14:48.360 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-17T05:14:48.360 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-17T05:14:48.360 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-17T05:14:48.360 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-17T05:14:48.360 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-17T05:14:48.360 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs 2024-04-17T05:14:48.360 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-17T05:14:48.360 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-17T05:14:48.360 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-17T05:14:48.360 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-17T05:14:48.360 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-17T05:14:48.360 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-17T05:14:48.360 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-17T05:14:48.361 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-17T05:14:48.361 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-17T05:14:48.361 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-17T05:14:48.361 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-17T05:14:48.361 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-17T05:14:48.361 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-17T05:14:48.361 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-17T05:14:48.361 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conncount.ko 2024-04-17T05:14:48.361 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack.ko 2024-04-17T05:14:48.361 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-17T05:14:48.361 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-17T05:14:48.361 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-17T05:14:48.361 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-17T05:14:48.361 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-17T05:14:48.361 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-17T05:14:48.362 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-17T05:14:48.362 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-17T05:14:48.362 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-17T05:14:48.362 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-17T05:14:48.362 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-17T05:14:48.362 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-17T05:14:48.362 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-17T05:14:48.362 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table.ko 2024-04-17T05:14:48.362 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-17T05:14:48.362 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_log_syslog.ko 2024-04-17T05:14:48.362 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat.ko 2024-04-17T05:14:48.362 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-17T05:14:48.362 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-17T05:14:48.362 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_irc.ko 2024-04-17T05:14:48.363 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_sip.ko 2024-04-17T05:14:48.363 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-17T05:14:48.363 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-17T05:14:48.363 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_tables.ko 2024-04-17T05:14:48.363 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink.ko 2024-04-17T05:14:48.363 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-17T05:14:48.363 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_log.ko 2024-04-17T05:14:48.363 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-17T05:14:48.363 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-17T05:14:48.363 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_chain_nat.ko 2024-04-17T05:14:48.363 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_compat.ko 2024-04-17T05:14:48.363 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_ct.ko 2024-04-17T05:14:48.363 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-17T05:14:48.363 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fib.ko 2024-04-17T05:14:48.363 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-17T05:14:48.363 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_hash.ko 2024-04-17T05:14:48.364 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_limit.ko 2024-04-17T05:14:48.364 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_log.ko 2024-04-17T05:14:48.364 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_masq.ko 2024-04-17T05:14:48.364 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_nat.ko 2024-04-17T05:14:48.364 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_numgen.ko 2024-04-17T05:14:48.364 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_queue.ko 2024-04-17T05:14:48.364 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_quota.ko 2024-04-17T05:14:48.364 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_redir.ko 2024-04-17T05:14:48.364 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject.ko 2024-04-17T05:14:48.364 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject_inet.ko 2024-04-17T05:14:48.364 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_socket.ko 2024-04-17T05:14:48.364 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_tunnel.ko 2024-04-17T05:14:48.364 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_AUDIT.ko 2024-04-17T05:14:48.364 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-17T05:14:48.364 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-17T05:14:48.365 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-17T05:14:48.365 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CT.ko 2024-04-17T05:14:48.365 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_DSCP.ko 2024-04-17T05:14:48.365 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HL.ko 2024-04-17T05:14:48.365 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HMARK.ko 2024-04-17T05:14:48.365 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-17T05:14:48.365 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LED.ko 2024-04-17T05:14:48.365 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LOG.ko 2024-04-17T05:14:48.365 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-17T05:14:48.365 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NETMAP.ko 2024-04-17T05:14:48.365 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFLOG.ko 2024-04-17T05:14:48.365 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-17T05:14:48.365 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_RATEEST.ko 2024-04-17T05:14:48.365 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-17T05:14:48.366 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_SECMARK.ko 2024-04-17T05:14:48.366 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-17T05:14:48.366 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-17T05:14:48.366 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TEE.ko 2024-04-17T05:14:48.366 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TPROXY.ko 2024-04-17T05:14:48.366 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TRACE.ko 2024-04-17T05:14:48.366 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_addrtype.ko 2024-04-17T05:14:48.366 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_bpf.ko 2024-04-17T05:14:48.366 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cgroup.ko 2024-04-17T05:14:48.366 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cluster.ko 2024-04-17T05:14:48.366 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_comment.ko 2024-04-17T05:14:48.366 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connbytes.ko 2024-04-17T05:14:48.366 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlabel.ko 2024-04-17T05:14:48.366 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlimit.ko 2024-04-17T05:14:48.366 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connmark.ko 2024-04-17T05:14:48.367 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_conntrack.ko 2024-04-17T05:14:48.367 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cpu.ko 2024-04-17T05:14:48.367 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dccp.ko 2024-04-17T05:14:48.367 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_devgroup.ko 2024-04-17T05:14:48.367 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dscp.ko 2024-04-17T05:14:48.367 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ecn.ko 2024-04-17T05:14:48.367 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_esp.ko 2024-04-17T05:14:48.367 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hashlimit.ko 2024-04-17T05:14:48.367 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_helper.ko 2024-04-17T05:14:48.367 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hl.ko 2024-04-17T05:14:48.367 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipcomp.ko 2024-04-17T05:14:48.367 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_iprange.ko 2024-04-17T05:14:48.367 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipvs.ko 2024-04-17T05:14:48.367 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_l2tp.ko 2024-04-17T05:14:48.367 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_length.ko 2024-04-17T05:14:48.368 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_limit.ko 2024-04-17T05:14:48.368 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mac.ko 2024-04-17T05:14:48.368 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mark.ko 2024-04-17T05:14:48.368 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_multiport.ko 2024-04-17T05:14:48.368 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nat.ko 2024-04-17T05:14:48.368 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nfacct.ko 2024-04-17T05:14:48.368 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_osf.ko 2024-04-17T05:14:48.368 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_owner.ko 2024-04-17T05:14:48.368 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_physdev.ko 2024-04-17T05:14:48.368 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_pkttype.ko 2024-04-17T05:14:48.369 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_policy.ko 2024-04-17T05:14:48.369 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_quota.ko 2024-04-17T05:14:48.369 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_rateest.ko 2024-04-17T05:14:48.369 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_realm.ko 2024-04-17T05:14:48.369 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_recent.ko 2024-04-17T05:14:48.369 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_sctp.ko 2024-04-17T05:14:48.369 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_set.ko 2024-04-17T05:14:48.369 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_socket.ko 2024-04-17T05:14:48.369 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_state.ko 2024-04-17T05:14:48.369 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_statistic.ko 2024-04-17T05:14:48.369 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_string.ko 2024-04-17T05:14:48.369 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_tcpmss.ko 2024-04-17T05:14:48.369 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_time.ko 2024-04-17T05:14:48.369 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_u32.ko 2024-04-17T05:14:48.369 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink 2024-04-17T05:14:48.370 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink/netlink_diag.ko 2024-04-17T05:14:48.370 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh 2024-04-17T05:14:48.370 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh/nsh.ko 2024-04-17T05:14:48.370 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch 2024-04-17T05:14:48.370 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/openvswitch.ko 2024-04-17T05:14:48.370 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-geneve.ko 2024-04-17T05:14:48.370 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-gre.ko 2024-04-17T05:14:48.370 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-vxlan.ko 2024-04-17T05:14:48.370 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet 2024-04-17T05:14:48.370 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet/af_packet_diag.ko 2024-04-17T05:14:48.370 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds 2024-04-17T05:14:48.370 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds.ko 2024-04-17T05:14:48.370 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_rdma.ko 2024-04-17T05:14:48.371 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_tcp.ko 2024-04-17T05:14:48.371 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched 2024-04-17T05:14:48.371 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_csum.ko 2024-04-17T05:14:48.371 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_gact.ko 2024-04-17T05:14:48.371 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_mirred.ko 2024-04-17T05:14:48.371 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_nat.ko 2024-04-17T05:14:48.371 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_pedit.ko 2024-04-17T05:14:48.371 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_police.ko 2024-04-17T05:14:48.371 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_simple.ko 2024-04-17T05:14:48.371 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_skbedit.ko 2024-04-17T05:14:48.371 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_vlan.ko 2024-04-17T05:14:48.371 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_basic.ko 2024-04-17T05:14:48.371 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_bpf.ko 2024-04-17T05:14:48.371 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_flow.ko 2024-04-17T05:14:48.371 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_fw.ko 2024-04-17T05:14:48.372 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_route.ko 2024-04-17T05:14:48.372 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_u32.ko 2024-04-17T05:14:48.372 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_cmp.ko 2024-04-17T05:14:48.372 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_ipset.ko 2024-04-17T05:14:48.372 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_meta.ko 2024-04-17T05:14:48.372 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_nbyte.ko 2024-04-17T05:14:48.372 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_text.ko 2024-04-17T05:14:48.372 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_u32.ko 2024-04-17T05:14:48.372 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_choke.ko 2024-04-17T05:14:48.372 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_codel.ko 2024-04-17T05:14:48.372 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_drr.ko 2024-04-17T05:14:48.372 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_fq.ko 2024-04-17T05:14:48.372 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_gred.ko 2024-04-17T05:14:48.372 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hfsc.ko 2024-04-17T05:14:48.373 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hhf.ko 2024-04-17T05:14:48.373 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_htb.ko 2024-04-17T05:14:48.373 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_ingress.ko 2024-04-17T05:14:48.373 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio.ko 2024-04-17T05:14:48.373 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio_lib.ko 2024-04-17T05:14:48.373 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_multiq.ko 2024-04-17T05:14:48.373 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_netem.ko 2024-04-17T05:14:48.373 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_pie.ko 2024-04-17T05:14:48.373 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_plug.ko 2024-04-17T05:14:48.373 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_prio.ko 2024-04-17T05:14:48.373 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_qfq.ko 2024-04-17T05:14:48.373 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_red.ko 2024-04-17T05:14:48.373 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfb.ko 2024-04-17T05:14:48.373 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfq.ko 2024-04-17T05:14:48.374 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_tbf.ko 2024-04-17T05:14:48.374 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_teql.ko 2024-04-17T05:14:48.374 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp 2024-04-17T05:14:48.374 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp.ko 2024-04-17T05:14:48.374 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp_diag.ko 2024-04-17T05:14:48.374 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc 2024-04-17T05:14:48.374 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss 2024-04-17T05:14:48.374 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-17T05:14:48.374 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-17T05:14:48.374 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/sunrpc.ko 2024-04-17T05:14:48.374 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma 2024-04-17T05:14:48.374 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-17T05:14:48.374 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc 2024-04-17T05:14:48.375 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc.ko 2024-04-17T05:14:48.375 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc_diag.ko 2024-04-17T05:14:48.375 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix 2024-04-17T05:14:48.375 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix/unix_diag.ko 2024-04-17T05:14:48.375 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock 2024-04-17T05:14:48.375 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-17T05:14:48.375 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-17T05:14:48.375 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock.ko 2024-04-17T05:14:48.375 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-17T05:14:48.375 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-17T05:14:48.375 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm 2024-04-17T05:14:48.375 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-17T05:14:48.375 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security 2024-04-17T05:14:48.375 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys 2024-04-17T05:14:48.375 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/encrypted-keys 2024-04-17T05:14:48.375 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-17T05:14:48.376 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/trusted-keys 2024-04-17T05:14:48.376 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/trusted-keys/trusted.ko 2024-04-17T05:14:48.376 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias 2024-04-17T05:14:48.376 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias.bin 2024-04-17T05:14:48.376 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin 2024-04-17T05:14:48.376 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.alias.bin 2024-04-17T05:14:48.376 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.bin 2024-04-17T05:14:48.376 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.modinfo 2024-04-17T05:14:48.376 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep 2024-04-17T05:14:48.376 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep.bin 2024-04-17T05:14:48.376 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.devname 2024-04-17T05:14:48.376 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.order 2024-04-17T05:14:48.376 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.softdep 2024-04-17T05:14:48.377 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols 2024-04-17T05:14:48.377 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols.bin 2024-04-17T05:14:48.377 INFO:teuthology.orchestra.run.smithi123.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/vmlinuz 2024-04-17T05:14:48.381 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g3f60ed14f7c1 2024-04-17T05:14:48.381 DEBUG:teuthology.orchestra.run.smithi123:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-17T05:14:48.403 INFO:teuthology.orchestra.run.smithi123.stdout:postinstall scriptlet (using /bin/sh): 2024-04-17T05:14:48.403 INFO:teuthology.orchestra.run.smithi123.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-17T05:14:48.403 INFO:teuthology.orchestra.run.smithi123.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g3f60ed14f7c1 /lib/modules/6.9.0-rc3-g3f60ed14f7c1/vmlinuz 2024-04-17T05:14:48.403 INFO:teuthology.orchestra.run.smithi123.stdout:fi 2024-04-17T05:14:48.403 INFO:teuthology.orchestra.run.smithi123.stdout:for file in vmlinuz System.map config; do 2024-04-17T05:14:48.403 INFO:teuthology.orchestra.run.smithi123.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/${file}" "/boot/${file}-6.9.0-rc3-g3f60ed14f7c1"; then 2024-04-17T05:14:48.403 INFO:teuthology.orchestra.run.smithi123.stdout: cp "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/${file}" "/boot/${file}-6.9.0-rc3-g3f60ed14f7c1" 2024-04-17T05:14:48.403 INFO:teuthology.orchestra.run.smithi123.stdout: fi 2024-04-17T05:14:48.403 INFO:teuthology.orchestra.run.smithi123.stdout:done 2024-04-17T05:14:48.403 INFO:teuthology.orchestra.run.smithi123.stdout:if [ -d "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/dtb" ] && \ 2024-04-17T05:14:48.404 INFO:teuthology.orchestra.run.smithi123.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/dtb" "/boot/dtb-6.9.0-rc3-g3f60ed14f7c1" >/dev/null 2>&1; then 2024-04-17T05:14:48.404 INFO:teuthology.orchestra.run.smithi123.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g3f60ed14f7c1" 2024-04-17T05:14:48.404 INFO:teuthology.orchestra.run.smithi123.stdout: cp -r "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/dtb" "/boot/dtb-6.9.0-rc3-g3f60ed14f7c1" 2024-04-17T05:14:48.404 INFO:teuthology.orchestra.run.smithi123.stdout:fi 2024-04-17T05:14:48.404 INFO:teuthology.orchestra.run.smithi123.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep" ]; then 2024-04-17T05:14:48.404 INFO:teuthology.orchestra.run.smithi123.stdout: /usr/sbin/depmod 6.9.0-rc3-g3f60ed14f7c1 2024-04-17T05:14:48.404 INFO:teuthology.orchestra.run.smithi123.stdout:fi 2024-04-17T05:14:48.404 INFO:teuthology.orchestra.run.smithi123.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-17T05:14:48.404 INFO:teuthology.orchestra.run.smithi123.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-17T05:14:48.404 INFO:teuthology.orchestra.run.smithi123.stdout:kernel-install remove 6.9.0-rc3-g3f60ed14f7c1 2024-04-17T05:14:48.404 INFO:teuthology.orchestra.run.smithi123.stdout:fi 2024-04-17T05:14:48.405 DEBUG:teuthology.orchestra.run.smithi123:> sudo rpm -qi grub2-tools 2024-04-17T05:14:48.479 INFO:teuthology.orchestra.run.smithi123.stdout:Name : grub2-tools 2024-04-17T05:14:48.479 INFO:teuthology.orchestra.run.smithi123.stdout:Epoch : 1 2024-04-17T05:14:48.480 INFO:teuthology.orchestra.run.smithi123.stdout:Version : 2.06 2024-04-17T05:14:48.480 INFO:teuthology.orchestra.run.smithi123.stdout:Release : 68.el9 2024-04-17T05:14:48.480 INFO:teuthology.orchestra.run.smithi123.stdout:Architecture: x86_64 2024-04-17T05:14:48.480 INFO:teuthology.orchestra.run.smithi123.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-17T05:14:48.480 INFO:teuthology.orchestra.run.smithi123.stdout:Group : Unspecified 2024-04-17T05:14:48.480 INFO:teuthology.orchestra.run.smithi123.stdout:Size : 8264254 2024-04-17T05:14:48.480 INFO:teuthology.orchestra.run.smithi123.stdout:License : GPLv3+ 2024-04-17T05:14:48.480 INFO:teuthology.orchestra.run.smithi123.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-17T05:14:48.480 INFO:teuthology.orchestra.run.smithi123.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-17T05:14:48.480 INFO:teuthology.orchestra.run.smithi123.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-17T05:14:48.480 INFO:teuthology.orchestra.run.smithi123.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-17T05:14:48.480 INFO:teuthology.orchestra.run.smithi123.stdout:Packager : builder@centos.org 2024-04-17T05:14:48.480 INFO:teuthology.orchestra.run.smithi123.stdout:Vendor : CentOS 2024-04-17T05:14:48.480 INFO:teuthology.orchestra.run.smithi123.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-17T05:14:48.480 INFO:teuthology.orchestra.run.smithi123.stdout:Summary : Support tools for GRUB. 2024-04-17T05:14:48.481 INFO:teuthology.orchestra.run.smithi123.stdout:Description : 2024-04-17T05:14:48.481 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:14:48.481 INFO:teuthology.orchestra.run.smithi123.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-17T05:14:48.481 INFO:teuthology.orchestra.run.smithi123.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-17T05:14:48.481 INFO:teuthology.orchestra.run.smithi123.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-17T05:14:48.481 INFO:teuthology.orchestra.run.smithi123.stdout:hardware devices. 2024-04-17T05:14:48.481 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:14:48.481 INFO:teuthology.orchestra.run.smithi123.stdout:This subpackage provides tools for support of all platforms. 2024-04-17T05:14:48.482 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-17T05:14:48.482 INFO:teuthology.task.kernel:Updating grub on smithi123 to boot 6.9.0-rc3-g3f60ed14f7c1 2024-04-17T05:14:48.482 DEBUG:teuthology.orchestra.run.smithi123:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-17T05:14:49.063 INFO:teuthology.orchestra.run.smithi123.stderr:Generating grub configuration file ... 2024-04-17T05:14:50.540 INFO:teuthology.orchestra.run.smithi123.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-17T05:14:50.561 INFO:teuthology.orchestra.run.smithi123.stderr:done 2024-04-17T05:14:50.564 DEBUG:teuthology.orchestra.run.smithi123:> mktemp 2024-04-17T05:14:50.579 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/tmp.Fjh2PZMge7 2024-04-17T05:14:50.579 DEBUG:teuthology.orchestra.run.smithi123:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Fjh2PZMge7 2024-04-17T05:14:50.648 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0666 /tmp/tmp.Fjh2PZMge7 2024-04-17T05:14:50.785 DEBUG:teuthology.orchestra.remote:smithi123:/tmp/tmp.Fjh2PZMge7 is 6KB 2024-04-17T05:14:50.832 DEBUG:teuthology.orchestra.run.smithi123:> rm -fr /tmp/tmp.Fjh2PZMge7 2024-04-17T05:14:50.846 DEBUG:teuthology.orchestra.run.smithi123:> sudo /bin/ls /boot/loader/entries || true 2024-04-17T05:14:50.911 INFO:teuthology.orchestra.run.smithi123.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-17T05:14:50.911 INFO:teuthology.orchestra.run.smithi123.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-17T05:14:50.911 INFO:teuthology.orchestra.run.smithi123.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-17T05:14:50.911 INFO:teuthology.orchestra.run.smithi123.stdout:15949e3c88704300882482eddfd7baae-6.9.0-rc3-g3f60ed14f7c1.conf 2024-04-17T05:14:50.912 DEBUG:teuthology.orchestra.run.smithi123:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T05:14:51.091 DEBUG:teuthology.orchestra.run.smithi123:> sudo shutdown -r now 2024-04-17T05:15:06.611 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi164.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-17T05:15:06.612 DEBUG:teuthology.orchestra.run.smithi164:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-17T05:15:06.691 INFO:teuthology.orchestra.run.smithi164.stdout:/boot/System.map-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T05:15:06.691 INFO:teuthology.orchestra.run.smithi164.stdout:/boot/config-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T05:15:06.691 INFO:teuthology.orchestra.run.smithi164.stdout:/boot/vmlinuz-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T05:15:06.691 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/System.map 2024-04-17T05:15:06.692 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/config 2024-04-17T05:15:06.692 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel 2024-04-17T05:15:06.692 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch 2024-04-17T05:15:06.692 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86 2024-04-17T05:15:06.692 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto 2024-04-17T05:15:06.692 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-17T05:15:06.692 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-17T05:15:06.692 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-17T05:15:06.692 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-17T05:15:06.692 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-17T05:15:06.692 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-17T05:15:06.692 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-17T05:15:06.692 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-17T05:15:06.692 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-17T05:15:06.693 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-17T05:15:06.693 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-17T05:15:06.693 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-17T05:15:06.693 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-17T05:15:06.693 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-17T05:15:06.693 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-17T05:15:06.693 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-17T05:15:06.693 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-17T05:15:06.693 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-17T05:15:06.693 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-17T05:15:06.693 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-17T05:15:06.693 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel 2024-04-17T05:15:06.693 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu 2024-04-17T05:15:06.693 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce 2024-04-17T05:15:06.694 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-17T05:15:06.694 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm 2024-04-17T05:15:06.694 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-17T05:15:06.694 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-17T05:15:06.694 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm.ko 2024-04-17T05:15:06.694 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto 2024-04-17T05:15:06.694 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ansi_cprng.ko 2024-04-17T05:15:06.694 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/anubis.ko 2024-04-17T05:15:06.694 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/arc4.ko 2024-04-17T05:15:06.694 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx 2024-04-17T05:15:06.694 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_memcpy.ko 2024-04-17T05:15:06.694 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_pq.ko 2024-04-17T05:15:06.694 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-17T05:15:06.694 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_tx.ko 2024-04-17T05:15:06.695 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_xor.ko 2024-04-17T05:15:06.695 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/raid6test.ko 2024-04-17T05:15:06.695 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authenc.ko 2024-04-17T05:15:06.695 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authencesn.ko 2024-04-17T05:15:06.695 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blake2b_generic.ko 2024-04-17T05:15:06.695 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_common.ko 2024-04-17T05:15:06.695 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_generic.ko 2024-04-17T05:15:06.695 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/camellia_generic.ko 2024-04-17T05:15:06.695 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast5_generic.ko 2024-04-17T05:15:06.695 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast6_generic.ko 2024-04-17T05:15:06.695 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast_common.ko 2024-04-17T05:15:06.695 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ccm.ko 2024-04-17T05:15:06.695 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cmac.ko 2024-04-17T05:15:06.696 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crc32_generic.ko 2024-04-17T05:15:06.696 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_engine.ko 2024-04-17T05:15:06.696 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_user.ko 2024-04-17T05:15:06.696 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cts.ko 2024-04-17T05:15:06.696 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/des_generic.ko 2024-04-17T05:15:06.696 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/dh_generic.ko 2024-04-17T05:15:06.696 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/echainiv.ko 2024-04-17T05:15:06.696 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/essiv.ko 2024-04-17T05:15:06.696 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/fcrypt.ko 2024-04-17T05:15:06.696 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/khazad.ko 2024-04-17T05:15:06.696 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4.ko 2024-04-17T05:15:06.696 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4hc.ko 2024-04-17T05:15:06.696 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/md4.ko 2024-04-17T05:15:06.696 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/michael_mic.ko 2024-04-17T05:15:06.696 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcbc.ko 2024-04-17T05:15:06.697 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcrypt.ko 2024-04-17T05:15:06.697 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/rmd160.ko 2024-04-17T05:15:06.697 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/seed.ko 2024-04-17T05:15:06.697 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/serpent_generic.ko 2024-04-17T05:15:06.697 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tcrypt.ko 2024-04-17T05:15:06.697 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tea.ko 2024-04-17T05:15:06.697 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_common.ko 2024-04-17T05:15:06.697 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_generic.ko 2024-04-17T05:15:06.697 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/vmac.ko 2024-04-17T05:15:06.697 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/wp512.ko 2024-04-17T05:15:06.697 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xcbc.ko 2024-04-17T05:15:06.697 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xor.ko 2024-04-17T05:15:06.697 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xxhash_generic.ko 2024-04-17T05:15:06.697 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers 2024-04-17T05:15:06.697 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi 2024-04-17T05:15:06.698 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-17T05:15:06.698 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_pad.ko 2024-04-17T05:15:06.698 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/ec_sys.ko 2024-04-17T05:15:06.698 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/platform_profile.ko 2024-04-17T05:15:06.698 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbs.ko 2024-04-17T05:15:06.698 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbshc.ko 2024-04-17T05:15:06.698 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/video.ko 2024-04-17T05:15:06.698 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata 2024-04-17T05:15:06.698 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/acard-ahci.ko 2024-04-17T05:15:06.698 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ahci_platform.ko 2024-04-17T05:15:06.698 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ata_generic.ko 2024-04-17T05:15:06.698 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/libahci_platform.ko 2024-04-17T05:15:06.698 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_acpi.ko 2024-04-17T05:15:06.698 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ali.ko 2024-04-17T05:15:06.699 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_amd.ko 2024-04-17T05:15:06.699 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_artop.ko 2024-04-17T05:15:06.699 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atiixp.ko 2024-04-17T05:15:06.699 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atp867x.ko 2024-04-17T05:15:06.699 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd640.ko 2024-04-17T05:15:06.699 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd64x.ko 2024-04-17T05:15:06.699 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cypress.ko 2024-04-17T05:15:06.699 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_efar.ko 2024-04-17T05:15:06.699 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt366.ko 2024-04-17T05:15:06.699 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt37x.ko 2024-04-17T05:15:06.699 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-17T05:15:06.699 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-17T05:15:06.699 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it8213.ko 2024-04-17T05:15:06.699 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it821x.ko 2024-04-17T05:15:06.699 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_jmicron.ko 2024-04-17T05:15:06.699 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_marvell.ko 2024-04-17T05:15:06.700 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_mpiix.ko 2024-04-17T05:15:06.700 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_netcell.ko 2024-04-17T05:15:06.700 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ninja32.ko 2024-04-17T05:15:06.700 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87410.ko 2024-04-17T05:15:06.700 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87415.ko 2024-04-17T05:15:06.700 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_oldpiix.ko 2024-04-17T05:15:06.700 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_opti.ko 2024-04-17T05:15:06.700 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_optidma.ko 2024-04-17T05:15:06.700 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pcmcia.ko 2024-04-17T05:15:06.700 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-17T05:15:06.700 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-17T05:15:06.700 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_piccolo.ko 2024-04-17T05:15:06.700 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_rdc.ko 2024-04-17T05:15:06.700 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sch.ko 2024-04-17T05:15:06.701 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_serverworks.ko 2024-04-17T05:15:06.701 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sil680.ko 2024-04-17T05:15:06.701 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sis.ko 2024-04-17T05:15:06.701 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sl82c105.ko 2024-04-17T05:15:06.701 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_triflex.ko 2024-04-17T05:15:06.701 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_via.ko 2024-04-17T05:15:06.701 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pdc_adma.ko 2024-04-17T05:15:06.701 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_inic162x.ko 2024-04-17T05:15:06.701 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_mv.ko 2024-04-17T05:15:06.701 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_nv.ko 2024-04-17T05:15:06.701 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_promise.ko 2024-04-17T05:15:06.701 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_qstor.ko 2024-04-17T05:15:06.701 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil.ko 2024-04-17T05:15:06.701 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil24.ko 2024-04-17T05:15:06.702 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sis.ko 2024-04-17T05:15:06.702 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_svw.ko 2024-04-17T05:15:06.702 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sx4.ko 2024-04-17T05:15:06.702 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_uli.ko 2024-04-17T05:15:06.702 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_via.ko 2024-04-17T05:15:06.702 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_vsc.ko 2024-04-17T05:15:06.702 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay 2024-04-17T05:15:06.702 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay/ks0108.ko 2024-04-17T05:15:06.702 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base 2024-04-17T05:15:06.702 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base/regmap 2024-04-17T05:15:06.702 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-17T05:15:06.702 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-17T05:15:06.702 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma 2024-04-17T05:15:06.702 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma/bcma.ko 2024-04-17T05:15:06.703 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block 2024-04-17T05:15:06.703 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe 2024-04-17T05:15:06.703 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe/aoe.ko 2024-04-17T05:15:06.703 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/brd.ko 2024-04-17T05:15:06.703 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd 2024-04-17T05:15:06.703 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd/drbd.ko 2024-04-17T05:15:06.703 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/floppy.ko 2024-04-17T05:15:06.703 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/loop.ko 2024-04-17T05:15:06.703 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx 2024-04-17T05:15:06.703 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-17T05:15:06.703 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/nbd.ko 2024-04-17T05:15:06.703 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk 2024-04-17T05:15:06.703 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk/null_blk.ko 2024-04-17T05:15:06.703 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/pktcdvd.ko 2024-04-17T05:15:06.704 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/rbd.ko 2024-04-17T05:15:06.704 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/virtio_blk.ko 2024-04-17T05:15:06.704 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback 2024-04-17T05:15:06.704 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-17T05:15:06.704 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkfront.ko 2024-04-17T05:15:06.704 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram 2024-04-17T05:15:06.704 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram/zram.ko 2024-04-17T05:15:06.704 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char 2024-04-17T05:15:06.704 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hangcheck-timer.ko 2024-04-17T05:15:06.704 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random 2024-04-17T05:15:06.704 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-17T05:15:06.704 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-17T05:15:06.704 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-17T05:15:06.704 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/via-rng.ko 2024-04-17T05:15:06.704 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-17T05:15:06.705 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi 2024-04-17T05:15:06.705 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-17T05:15:06.705 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-17T05:15:06.705 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-17T05:15:06.705 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-17T05:15:06.705 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-17T05:15:06.705 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-17T05:15:06.705 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/lp.ko 2024-04-17T05:15:06.705 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave 2024-04-17T05:15:06.705 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave/mwave.ko 2024-04-17T05:15:06.705 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ppdev.ko 2024-04-17T05:15:06.705 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tlclk.ko 2024-04-17T05:15:06.705 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm 2024-04-17T05:15:06.705 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm.ko 2024-04-17T05:15:06.705 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-17T05:15:06.706 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-17T05:15:06.706 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-17T05:15:06.706 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-17T05:15:06.706 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-17T05:15:06.706 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/uv_mmtimer.ko 2024-04-17T05:15:06.706 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/virtio_console.ko 2024-04-17T05:15:06.706 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq 2024-04-17T05:15:06.706 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-17T05:15:06.706 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-17T05:15:06.706 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-17T05:15:06.706 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-17T05:15:06.706 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-17T05:15:06.706 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-17T05:15:06.706 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto 2024-04-17T05:15:06.707 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp 2024-04-17T05:15:06.707 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-17T05:15:06.707 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp.ko 2024-04-17T05:15:06.707 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel 2024-04-17T05:15:06.707 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat 2024-04-17T05:15:06.707 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common 2024-04-17T05:15:06.707 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-17T05:15:06.707 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-17T05:15:06.707 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-17T05:15:06.707 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-aes.ko 2024-04-17T05:15:06.707 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-sha.ko 2024-04-17T05:15:06.707 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio 2024-04-17T05:15:06.707 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-17T05:15:06.707 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca 2024-04-17T05:15:06.707 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca/dca.ko 2024-04-17T05:15:06.708 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/devfreq 2024-04-17T05:15:06.708 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-17T05:15:06.708 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma 2024-04-17T05:15:06.708 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw 2024-04-17T05:15:06.708 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-17T05:15:06.708 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat 2024-04-17T05:15:06.708 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-17T05:15:06.708 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac 2024-04-17T05:15:06.708 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/amd64_edac.ko 2024-04-17T05:15:06.708 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/e752x_edac.ko 2024-04-17T05:15:06.708 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/edac_mce_amd.ko 2024-04-17T05:15:06.708 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3000_edac.ko 2024-04-17T05:15:06.708 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3200_edac.ko 2024-04-17T05:15:06.708 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5100_edac.ko 2024-04-17T05:15:06.709 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5400_edac.ko 2024-04-17T05:15:06.709 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7300_edac.ko 2024-04-17T05:15:06.709 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7core_edac.ko 2024-04-17T05:15:06.709 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i82975x_edac.ko 2024-04-17T05:15:06.709 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/ie31200_edac.ko 2024-04-17T05:15:06.709 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/sb_edac.ko 2024-04-17T05:15:06.709 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/x38_edac.ko 2024-04-17T05:15:06.709 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware 2024-04-17T05:15:06.709 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/edd.ko 2024-04-17T05:15:06.709 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-17T05:15:06.709 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio 2024-04-17T05:15:06.709 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-ich.ko 2024-04-17T05:15:06.709 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-17T05:15:06.709 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid 2024-04-17T05:15:06.709 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-appleir.ko 2024-04-17T05:15:06.710 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-aureal.ko 2024-04-17T05:15:06.710 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-axff.ko 2024-04-17T05:15:06.710 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-dr.ko 2024-04-17T05:15:06.710 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elecom.ko 2024-04-17T05:15:06.710 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elo.ko 2024-04-17T05:15:06.710 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-emsff.ko 2024-04-17T05:15:06.710 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gaff.ko 2024-04-17T05:15:06.710 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gt683r.ko 2024-04-17T05:15:06.710 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gyration.ko 2024-04-17T05:15:06.710 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-17T05:15:06.710 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-17T05:15:06.710 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtekff.ko 2024-04-17T05:15:06.710 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-hyperv.ko 2024-04-17T05:15:06.710 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-icade.ko 2024-04-17T05:15:06.710 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-keytouch.ko 2024-04-17T05:15:06.711 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-kye.ko 2024-04-17T05:15:06.711 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lcpower.ko 2024-04-17T05:15:06.711 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-led.ko 2024-04-17T05:15:06.711 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lenovo.ko 2024-04-17T05:15:06.711 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-17T05:15:06.711 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-17T05:15:06.711 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-multitouch.ko 2024-04-17T05:15:06.711 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-ortek.ko 2024-04-17T05:15:06.711 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-penmount.ko 2024-04-17T05:15:06.711 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-petalynx.ko 2024-04-17T05:15:06.711 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-picolcd.ko 2024-04-17T05:15:06.711 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-pl.ko 2024-04-17T05:15:06.711 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-plantronics.ko 2024-04-17T05:15:06.711 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-primax.ko 2024-04-17T05:15:06.711 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-rmi.ko 2024-04-17T05:15:06.712 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-17T05:15:06.712 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-common.ko 2024-04-17T05:15:06.712 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-17T05:15:06.712 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-17T05:15:06.712 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-17T05:15:06.712 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-17T05:15:06.712 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-17T05:15:06.712 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-17T05:15:06.712 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-17T05:15:06.712 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-17T05:15:06.712 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-17T05:15:06.712 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat.ko 2024-04-17T05:15:06.712 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-saitek.ko 2024-04-17T05:15:06.712 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-samsung.ko 2024-04-17T05:15:06.712 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-17T05:15:06.712 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sjoy.ko 2024-04-17T05:15:06.713 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sony.ko 2024-04-17T05:15:06.713 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-speedlink.ko 2024-04-17T05:15:06.713 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-steelseries.ko 2024-04-17T05:15:06.713 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sunplus.ko 2024-04-17T05:15:06.713 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-17T05:15:06.713 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tivo.ko 2024-04-17T05:15:06.713 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tmff.ko 2024-04-17T05:15:06.713 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-topseed.ko 2024-04-17T05:15:06.713 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-twinhan.ko 2024-04-17T05:15:06.713 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-uclogic.ko 2024-04-17T05:15:06.713 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-waltop.ko 2024-04-17T05:15:06.713 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-wiimote.ko 2024-04-17T05:15:06.713 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-xinmo.ko 2024-04-17T05:15:06.714 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zpff.ko 2024-04-17T05:15:06.714 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zydacron.ko 2024-04-17T05:15:06.714 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/uhid.ko 2024-04-17T05:15:06.714 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/wacom.ko 2024-04-17T05:15:06.714 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv 2024-04-17T05:15:06.714 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_balloon.ko 2024-04-17T05:15:06.714 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_utils.ko 2024-04-17T05:15:06.714 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_vmbus.ko 2024-04-17T05:15:06.714 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon 2024-04-17T05:15:06.714 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru.ko 2024-04-17T05:15:06.714 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru3.ko 2024-04-17T05:15:06.714 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-17T05:15:06.714 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7414.ko 2024-04-17T05:15:06.714 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7418.ko 2024-04-17T05:15:06.714 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adc128d818.ko 2024-04-17T05:15:06.714 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1025.ko 2024-04-17T05:15:06.715 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1026.ko 2024-04-17T05:15:06.715 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1029.ko 2024-04-17T05:15:06.715 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1031.ko 2024-04-17T05:15:06.715 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm9240.ko 2024-04-17T05:15:06.715 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ads7828.ko 2024-04-17T05:15:06.715 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7410.ko 2024-04-17T05:15:06.715 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7411.ko 2024-04-17T05:15:06.715 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7462.ko 2024-04-17T05:15:06.715 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7470.ko 2024-04-17T05:15:06.715 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7475.ko 2024-04-17T05:15:06.715 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7x10.ko 2024-04-17T05:15:06.715 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/amc6821.ko 2024-04-17T05:15:06.715 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/applesmc.ko 2024-04-17T05:15:06.715 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asb100.ko 2024-04-17T05:15:06.715 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asc7621.ko 2024-04-17T05:15:06.716 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-17T05:15:06.716 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/atxp1.ko 2024-04-17T05:15:06.716 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/coretemp.ko 2024-04-17T05:15:06.716 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-17T05:15:06.716 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dme1737.ko 2024-04-17T05:15:06.716 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds1621.ko 2024-04-17T05:15:06.716 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds620.ko 2024-04-17T05:15:06.716 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc1403.ko 2024-04-17T05:15:06.716 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc6w201.ko 2024-04-17T05:15:06.716 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71805f.ko 2024-04-17T05:15:06.716 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71882fg.ko 2024-04-17T05:15:06.716 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f75375s.ko 2024-04-17T05:15:06.716 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fam15h_power.ko 2024-04-17T05:15:06.716 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fschmd.ko 2024-04-17T05:15:06.716 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g760a.ko 2024-04-17T05:15:06.717 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g762.ko 2024-04-17T05:15:06.717 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl518sm.ko 2024-04-17T05:15:06.717 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl520sm.ko 2024-04-17T05:15:06.717 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-17T05:15:06.717 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5500_temp.ko 2024-04-17T05:15:06.717 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5k_amb.ko 2024-04-17T05:15:06.717 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmaem.ko 2024-04-17T05:15:06.717 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmpex.ko 2024-04-17T05:15:06.717 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina209.ko 2024-04-17T05:15:06.717 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina2xx.ko 2024-04-17T05:15:06.717 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/it87.ko 2024-04-17T05:15:06.717 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k10temp.ko 2024-04-17T05:15:06.717 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k8temp.ko 2024-04-17T05:15:06.717 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lineage-pem.ko 2024-04-17T05:15:06.718 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm63.ko 2024-04-17T05:15:06.718 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm73.ko 2024-04-17T05:15:06.718 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm75.ko 2024-04-17T05:15:06.718 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm77.ko 2024-04-17T05:15:06.718 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm78.ko 2024-04-17T05:15:06.718 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm80.ko 2024-04-17T05:15:06.718 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm83.ko 2024-04-17T05:15:06.718 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm85.ko 2024-04-17T05:15:06.718 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm87.ko 2024-04-17T05:15:06.718 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm90.ko 2024-04-17T05:15:06.718 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm92.ko 2024-04-17T05:15:06.718 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm93.ko 2024-04-17T05:15:06.718 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95234.ko 2024-04-17T05:15:06.718 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95241.ko 2024-04-17T05:15:06.718 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95245.ko 2024-04-17T05:15:06.719 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc2945.ko 2024-04-17T05:15:06.719 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4151.ko 2024-04-17T05:15:06.719 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4215.ko 2024-04-17T05:15:06.719 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4222.ko 2024-04-17T05:15:06.719 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4245.ko 2024-04-17T05:15:06.719 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4260.ko 2024-04-17T05:15:06.719 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4261.ko 2024-04-17T05:15:06.719 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max16065.ko 2024-04-17T05:15:06.719 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1619.ko 2024-04-17T05:15:06.719 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1668.ko 2024-04-17T05:15:06.719 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max197.ko 2024-04-17T05:15:06.719 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6639.ko 2024-04-17T05:15:06.719 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6650.ko 2024-04-17T05:15:06.719 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6697.ko 2024-04-17T05:15:06.720 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/mcp3021.ko 2024-04-17T05:15:06.720 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6683.ko 2024-04-17T05:15:06.720 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775-core.ko 2024-04-17T05:15:06.720 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775.ko 2024-04-17T05:15:06.720 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct7802.ko 2024-04-17T05:15:06.720 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87360.ko 2024-04-17T05:15:06.720 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87427.ko 2024-04-17T05:15:06.720 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pcf8591.ko 2024-04-17T05:15:06.720 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus 2024-04-17T05:15:06.720 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-17T05:15:06.720 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-17T05:15:06.720 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-17T05:15:06.720 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-17T05:15:06.720 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-17T05:15:06.720 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-17T05:15:06.721 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-17T05:15:06.721 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-17T05:15:06.721 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-17T05:15:06.721 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-17T05:15:06.721 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-17T05:15:06.721 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-17T05:15:06.721 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/powr1220.ko 2024-04-17T05:15:06.721 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5627.ko 2024-04-17T05:15:06.721 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5636.ko 2024-04-17T05:15:06.721 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-17T05:15:06.721 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht15.ko 2024-04-17T05:15:06.721 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht21.ko 2024-04-17T05:15:06.721 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/shtc1.ko 2024-04-17T05:15:06.721 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sis5595.ko 2024-04-17T05:15:06.721 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47b397.ko 2024-04-17T05:15:06.722 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m1.ko 2024-04-17T05:15:06.722 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m192.ko 2024-04-17T05:15:06.722 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/thmc50.ko 2024-04-17T05:15:06.722 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp102.ko 2024-04-17T05:15:06.722 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp103.ko 2024-04-17T05:15:06.722 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp401.ko 2024-04-17T05:15:06.722 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp421.ko 2024-04-17T05:15:06.722 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via-cputemp.ko 2024-04-17T05:15:06.722 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via686a.ko 2024-04-17T05:15:06.722 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt1211.ko 2024-04-17T05:15:06.722 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt8231.ko 2024-04-17T05:15:06.722 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627ehf.ko 2024-04-17T05:15:06.722 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627hf.ko 2024-04-17T05:15:06.722 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83781d.ko 2024-04-17T05:15:06.723 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83791d.ko 2024-04-17T05:15:06.723 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83792d.ko 2024-04-17T05:15:06.723 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83793.ko 2024-04-17T05:15:06.723 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83795.ko 2024-04-17T05:15:06.723 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l785ts.ko 2024-04-17T05:15:06.723 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l786ng.ko 2024-04-17T05:15:06.723 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c 2024-04-17T05:15:06.723 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos 2024-04-17T05:15:06.723 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-17T05:15:06.723 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-17T05:15:06.723 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses 2024-04-17T05:15:06.723 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-17T05:15:06.723 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-17T05:15:06.723 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-17T05:15:06.723 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-17T05:15:06.723 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-17T05:15:06.724 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-17T05:15:06.724 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-17T05:15:06.724 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-17T05:15:06.724 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-17T05:15:06.724 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-17T05:15:06.724 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-17T05:15:06.724 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-17T05:15:06.724 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-17T05:15:06.724 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-17T05:15:06.724 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-17T05:15:06.724 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-17T05:15:06.724 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-17T05:15:06.724 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-17T05:15:06.724 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-17T05:15:06.725 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-17T05:15:06.725 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-17T05:15:06.725 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-17T05:15:06.725 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-17T05:15:06.725 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-dev.ko 2024-04-17T05:15:06.725 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-mux.ko 2024-04-17T05:15:06.725 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-17T05:15:06.725 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-smbus.ko 2024-04-17T05:15:06.725 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-stub.ko 2024-04-17T05:15:06.725 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband 2024-04-17T05:15:06.725 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core 2024-04-17T05:15:06.725 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-17T05:15:06.725 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_core.ko 2024-04-17T05:15:06.725 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-17T05:15:06.726 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-17T05:15:06.726 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-17T05:15:06.726 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-17T05:15:06.726 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-17T05:15:06.726 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw 2024-04-17T05:15:06.726 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4 2024-04-17T05:15:06.726 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-17T05:15:06.726 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4 2024-04-17T05:15:06.726 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-17T05:15:06.726 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5 2024-04-17T05:15:06.726 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-17T05:15:06.726 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca 2024-04-17T05:15:06.726 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-17T05:15:06.726 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp 2024-04-17T05:15:06.726 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib 2024-04-17T05:15:06.727 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-17T05:15:06.727 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser 2024-04-17T05:15:06.727 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-17T05:15:06.727 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert 2024-04-17T05:15:06.727 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-17T05:15:06.727 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp 2024-04-17T05:15:06.727 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-17T05:15:06.727 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt 2024-04-17T05:15:06.727 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-17T05:15:06.727 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input 2024-04-17T05:15:06.727 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport 2024-04-17T05:15:06.727 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-17T05:15:06.727 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-17T05:15:06.727 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/gameport.ko 2024-04-17T05:15:06.728 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/joydev.ko 2024-04-17T05:15:06.728 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard 2024-04-17T05:15:06.728 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-17T05:15:06.728 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse 2024-04-17T05:15:06.728 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/appletouch.ko 2024-04-17T05:15:06.728 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/bcm5974.ko 2024-04-17T05:15:06.728 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/cyapatp.ko 2024-04-17T05:15:06.728 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-17T05:15:06.728 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/sermouse.ko 2024-04-17T05:15:06.728 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-17T05:15:06.728 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-17T05:15:06.728 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-17T05:15:06.728 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4 2024-04-17T05:15:06.728 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-17T05:15:06.728 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio 2024-04-17T05:15:06.728 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/altera_ps2.ko 2024-04-17T05:15:06.729 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/arc_ps2.ko 2024-04-17T05:15:06.729 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-17T05:15:06.729 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/serio_raw.ko 2024-04-17T05:15:06.729 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/sparse-keymap.ko 2024-04-17T05:15:06.729 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds 2024-04-17T05:15:06.729 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-blinkm.ko 2024-04-17T05:15:06.729 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm3530.ko 2024-04-17T05:15:06.729 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lp3944.ko 2024-04-17T05:15:06.729 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-ss4200.ko 2024-04-17T05:15:06.729 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger 2024-04-17T05:15:06.729 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-17T05:15:06.729 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-17T05:15:06.729 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-17T05:15:06.729 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-17T05:15:06.729 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-17T05:15:06.730 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-17T05:15:06.730 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-17T05:15:06.730 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-17T05:15:06.730 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-17T05:15:06.730 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md 2024-04-17T05:15:06.730 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache 2024-04-17T05:15:06.730 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache/bcache.ko 2024-04-17T05:15:06.730 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-bio-prison.ko 2024-04-17T05:15:06.730 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache-smq.ko 2024-04-17T05:15:06.730 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache.ko 2024-04-17T05:15:06.730 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-crypt.ko 2024-04-17T05:15:06.730 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-delay.ko 2024-04-17T05:15:06.730 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-flakey.ko 2024-04-17T05:15:06.730 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-log-userspace.ko 2024-04-17T05:15:06.731 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-multipath.ko 2024-04-17T05:15:06.731 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-queue-length.ko 2024-04-17T05:15:06.731 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-raid.ko 2024-04-17T05:15:06.731 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-round-robin.ko 2024-04-17T05:15:06.731 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-service-time.ko 2024-04-17T05:15:06.731 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-switch.ko 2024-04-17T05:15:06.731 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-thin-pool.ko 2024-04-17T05:15:06.731 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-verity.ko 2024-04-17T05:15:06.731 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data 2024-04-17T05:15:06.731 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-17T05:15:06.731 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid0.ko 2024-04-17T05:15:06.731 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid1.ko 2024-04-17T05:15:06.731 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid10.ko 2024-04-17T05:15:06.732 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid456.ko 2024-04-17T05:15:06.732 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message 2024-04-17T05:15:06.732 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion 2024-04-17T05:15:06.732 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptbase.ko 2024-04-17T05:15:06.732 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptctl.ko 2024-04-17T05:15:06.732 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptfc.ko 2024-04-17T05:15:06.732 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptlan.ko 2024-04-17T05:15:06.732 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptsas.ko 2024-04-17T05:15:06.732 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptscsih.ko 2024-04-17T05:15:06.732 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptspi.ko 2024-04-17T05:15:06.732 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd 2024-04-17T05:15:06.732 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_ich.ko 2024-04-17T05:15:06.732 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_sch.ko 2024-04-17T05:15:06.732 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/mfd-core.ko 2024-04-17T05:15:06.732 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/sm501.ko 2024-04-17T05:15:06.733 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/viperboard.ko 2024-04-17T05:15:06.733 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/vx855.ko 2024-04-17T05:15:06.733 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/wl1273-core.ko 2024-04-17T05:15:06.733 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc 2024-04-17T05:15:06.733 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl 2024-04-17T05:15:06.733 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-17T05:15:06.733 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds9802als.ko 2024-04-17T05:15:06.733 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds990x.ko 2024-04-17T05:15:06.733 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/bh1770glc.ko 2024-04-17T05:15:06.733 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710 2024-04-17T05:15:06.733 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710/cb710.ko 2024-04-17T05:15:06.733 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom 2024-04-17T05:15:06.733 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/at24.ko 2024-04-17T05:15:06.733 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-17T05:15:06.734 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/max6875.ko 2024-04-17T05:15:06.734 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/enclosure.ko 2024-04-17T05:15:06.734 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/hpilo.ko 2024-04-17T05:15:06.734 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29003.ko 2024-04-17T05:15:06.734 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29020.ko 2024-04-17T05:15:06.734 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d 2024-04-17T05:15:06.734 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-17T05:15:06.734 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-17T05:15:06.734 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei 2024-04-17T05:15:06.734 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-me.ko 2024-04-17T05:15:06.734 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-txe.ko 2024-04-17T05:15:06.734 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei.ko 2024-04-17T05:15:06.734 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-gru 2024-04-17T05:15:06.734 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-17T05:15:06.735 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp 2024-04-17T05:15:06.735 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-17T05:15:06.735 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-17T05:15:06.735 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-17T05:15:06.735 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_7xx1.ko 2024-04-17T05:15:06.735 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_core.ko 2024-04-17T05:15:06.735 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tsl2550.ko 2024-04-17T05:15:06.735 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_balloon.ko 2024-04-17T05:15:06.735 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci 2024-04-17T05:15:06.735 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-17T05:15:06.735 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net 2024-04-17T05:15:06.735 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding 2024-04-17T05:15:06.735 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding/bonding.ko 2024-04-17T05:15:06.735 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa 2024-04-17T05:15:06.735 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53 2024-04-17T05:15:06.735 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-17T05:15:06.736 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-17T05:15:06.736 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-17T05:15:06.736 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx 2024-04-17T05:15:06.736 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-17T05:15:06.736 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dummy.ko 2024-04-17T05:15:06.736 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/eql.ko 2024-04-17T05:15:06.736 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet 2024-04-17T05:15:06.736 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com 2024-04-17T05:15:06.736 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-17T05:15:06.736 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-17T05:15:06.736 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-17T05:15:06.736 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-17T05:15:06.736 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390 2024-04-17T05:15:06.736 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-17T05:15:06.736 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-17T05:15:06.737 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-17T05:15:06.737 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-17T05:15:06.737 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec 2024-04-17T05:15:06.737 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-17T05:15:06.737 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere 2024-04-17T05:15:06.737 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-17T05:15:06.737 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon 2024-04-17T05:15:06.737 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-17T05:15:06.737 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera 2024-04-17T05:15:06.737 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-17T05:15:06.737 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd 2024-04-17T05:15:06.737 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-17T05:15:06.737 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-17T05:15:06.738 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-17T05:15:06.738 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros 2024-04-17T05:15:06.738 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx 2024-04-17T05:15:06.738 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-17T05:15:06.738 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-17T05:15:06.738 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-17T05:15:06.738 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-17T05:15:06.738 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-17T05:15:06.738 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx 2024-04-17T05:15:06.738 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-17T05:15:06.738 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-17T05:15:06.738 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom 2024-04-17T05:15:06.738 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-17T05:15:06.739 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-17T05:15:06.739 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-17T05:15:06.739 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-17T05:15:06.739 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-17T05:15:06.739 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet 2024-04-17T05:15:06.739 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-17T05:15:06.739 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-17T05:15:06.739 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade 2024-04-17T05:15:06.739 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna 2024-04-17T05:15:06.739 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-17T05:15:06.739 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio 2024-04-17T05:15:06.739 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-17T05:15:06.739 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-17T05:15:06.739 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-17T05:15:06.740 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-17T05:15:06.740 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-17T05:15:06.740 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-17T05:15:06.740 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-17T05:15:06.740 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-17T05:15:06.740 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-17T05:15:06.740 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-17T05:15:06.740 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco 2024-04-17T05:15:06.740 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic 2024-04-17T05:15:06.740 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-17T05:15:06.740 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec 2024-04-17T05:15:06.740 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip 2024-04-17T05:15:06.740 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-17T05:15:06.740 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-17T05:15:06.740 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-17T05:15:06.741 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-17T05:15:06.741 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-17T05:15:06.741 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-17T05:15:06.741 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink 2024-04-17T05:15:06.741 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-17T05:15:06.741 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-17T05:15:06.741 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dnet.ko 2024-04-17T05:15:06.741 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex 2024-04-17T05:15:06.741 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet 2024-04-17T05:15:06.741 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-17T05:15:06.741 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ethoc.ko 2024-04-17T05:15:06.741 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/fealnx.ko 2024-04-17T05:15:06.741 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel 2024-04-17T05:15:06.741 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-17T05:15:06.742 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000 2024-04-17T05:15:06.742 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-17T05:15:06.742 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e 2024-04-17T05:15:06.742 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-17T05:15:06.742 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k 2024-04-17T05:15:06.742 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-17T05:15:06.742 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e 2024-04-17T05:15:06.742 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-17T05:15:06.742 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf 2024-04-17T05:15:06.742 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-17T05:15:06.742 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb 2024-04-17T05:15:06.742 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-17T05:15:06.742 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf 2024-04-17T05:15:06.743 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-17T05:15:06.743 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-17T05:15:06.743 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-17T05:15:06.743 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-17T05:15:06.743 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-17T05:15:06.743 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/jme.ko 2024-04-17T05:15:06.743 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell 2024-04-17T05:15:06.743 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-17T05:15:06.743 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-17T05:15:06.743 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-17T05:15:06.743 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox 2024-04-17T05:15:06.743 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-17T05:15:06.743 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-17T05:15:06.744 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-17T05:15:06.744 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-17T05:15:06.744 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-17T05:15:06.744 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-17T05:15:06.744 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel 2024-04-17T05:15:06.744 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-17T05:15:06.744 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom 2024-04-17T05:15:06.744 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-17T05:15:06.744 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-17T05:15:06.744 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi 2024-04-17T05:15:06.744 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-17T05:15:06.744 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-17T05:15:06.744 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion 2024-04-17T05:15:06.744 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-17T05:15:06.744 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia 2024-04-17T05:15:06.744 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-17T05:15:06.745 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines 2024-04-17T05:15:06.745 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-17T05:15:06.745 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-17T05:15:06.745 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic 2024-04-17T05:15:06.745 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-17T05:15:06.745 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-17T05:15:06.745 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-17T05:15:06.745 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-17T05:15:06.745 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-17T05:15:06.745 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc 2024-04-17T05:15:06.745 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-17T05:15:06.745 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek 2024-04-17T05:15:06.745 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-17T05:15:06.745 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-17T05:15:06.746 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-17T05:15:06.746 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-17T05:15:06.746 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rocker 2024-04-17T05:15:06.746 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-17T05:15:06.746 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc 2024-04-17T05:15:06.746 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-17T05:15:06.746 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan 2024-04-17T05:15:06.746 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-17T05:15:06.746 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis 2024-04-17T05:15:06.746 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-17T05:15:06.746 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-17T05:15:06.746 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc 2024-04-17T05:15:06.746 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-17T05:15:06.747 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-17T05:15:06.747 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-17T05:15:06.747 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-17T05:15:06.747 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro 2024-04-17T05:15:06.747 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-17T05:15:06.747 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-17T05:15:06.747 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-17T05:15:06.747 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun 2024-04-17T05:15:06.747 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-17T05:15:06.747 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-17T05:15:06.747 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-17T05:15:06.747 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-17T05:15:06.747 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti 2024-04-17T05:15:06.747 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-17T05:15:06.747 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti 2024-04-17T05:15:06.748 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-17T05:15:06.748 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via 2024-04-17T05:15:06.748 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-17T05:15:06.748 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-17T05:15:06.748 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet 2024-04-17T05:15:06.748 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-17T05:15:06.748 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-17T05:15:06.748 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom 2024-04-17T05:15:06.748 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-17T05:15:06.748 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/geneve.ko 2024-04-17T05:15:06.748 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv 2024-04-17T05:15:06.748 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-17T05:15:06.748 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154 2024-04-17T05:15:06.748 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-17T05:15:06.748 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ifb.ko 2024-04-17T05:15:06.749 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan 2024-04-17T05:15:06.749 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-17T05:15:06.749 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvlan.ko 2024-04-17T05:15:06.749 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvtap.ko 2024-04-17T05:15:06.749 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio 2024-04-17T05:15:06.749 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio.ko 2024-04-17T05:15:06.749 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-17T05:15:06.749 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-17T05:15:06.749 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-17T05:15:06.749 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mii.ko 2024-04-17T05:15:06.749 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/net_failover.ko 2024-04-17T05:15:06.749 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/netconsole.ko 2024-04-17T05:15:06.749 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/nlmon.ko 2024-04-17T05:15:06.749 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs 2024-04-17T05:15:06.750 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-17T05:15:06.750 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-17T05:15:06.750 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy 2024-04-17T05:15:06.750 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/amd.ko 2024-04-17T05:15:06.750 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-17T05:15:06.750 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-17T05:15:06.750 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-17T05:15:06.750 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm87xx.ko 2024-04-17T05:15:06.750 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/broadcom.ko 2024-04-17T05:15:06.750 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/cicada.ko 2024-04-17T05:15:06.750 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/davicom.ko 2024-04-17T05:15:06.750 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/dp83640.ko 2024-04-17T05:15:06.750 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/et1011c.ko 2024-04-17T05:15:06.750 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/icplus.ko 2024-04-17T05:15:06.750 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/lxt.ko 2024-04-17T05:15:06.751 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/marvell.ko 2024-04-17T05:15:06.751 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/micrel.ko 2024-04-17T05:15:06.751 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/national.ko 2024-04-17T05:15:06.751 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/phylink.ko 2024-04-17T05:15:06.751 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/qsemi.ko 2024-04-17T05:15:06.751 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/realtek.ko 2024-04-17T05:15:06.751 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/smsc.ko 2024-04-17T05:15:06.751 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/ste10Xp.ko 2024-04-17T05:15:06.751 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/vitesse.ko 2024-04-17T05:15:06.751 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp 2024-04-17T05:15:06.751 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-17T05:15:06.751 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_async.ko 2024-04-17T05:15:06.751 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-17T05:15:06.751 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-17T05:15:06.752 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-17T05:15:06.752 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-17T05:15:06.752 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppoe.ko 2024-04-17T05:15:06.752 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppox.ko 2024-04-17T05:15:06.752 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pptp.ko 2024-04-17T05:15:06.752 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip 2024-04-17T05:15:06.752 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/slhc.ko 2024-04-17T05:15:06.752 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/slip.ko 2024-04-17T05:15:06.752 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/sungem_phy.ko 2024-04-17T05:15:06.752 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/tap.ko 2024-04-17T05:15:06.752 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team 2024-04-17T05:15:06.752 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team.ko 2024-04-17T05:15:06.752 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-17T05:15:06.752 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-17T05:15:06.752 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-17T05:15:06.753 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_random.ko 2024-04-17T05:15:06.753 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-17T05:15:06.753 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/tun.ko 2024-04-17T05:15:06.753 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/veth.ko 2024-04-17T05:15:06.753 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/virtio_net.ko 2024-04-17T05:15:06.753 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3 2024-04-17T05:15:06.753 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-17T05:15:06.753 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan 2024-04-17T05:15:06.753 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan/vxlan.ko 2024-04-17T05:15:06.753 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback 2024-04-17T05:15:06.753 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-17T05:15:06.753 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netfront.ko 2024-04-17T05:15:06.753 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb 2024-04-17T05:15:06.753 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb/ntb.ko 2024-04-17T05:15:06.754 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme 2024-04-17T05:15:06.754 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host 2024-04-17T05:15:06.754 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme-core.ko 2024-04-17T05:15:06.754 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme.ko 2024-04-17T05:15:06.754 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport 2024-04-17T05:15:06.754 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport.ko 2024-04-17T05:15:06.754 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_cs.ko 2024-04-17T05:15:06.754 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_pc.ko 2024-04-17T05:15:06.754 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_serial.ko 2024-04-17T05:15:06.754 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci 2024-04-17T05:15:06.754 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug 2024-04-17T05:15:06.754 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-17T05:15:06.754 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/pcie 2024-04-17T05:15:06.755 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-17T05:15:06.755 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/xen-pcifront.ko 2024-04-17T05:15:06.755 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia 2024-04-17T05:15:06.755 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/i82092.ko 2024-04-17T05:15:06.755 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pd6729.ko 2024-04-17T05:15:06.755 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-17T05:15:06.755 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl 2024-04-17T05:15:06.755 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel 2024-04-17T05:15:06.755 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-17T05:15:06.755 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform 2024-04-17T05:15:06.755 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86 2024-04-17T05:15:06.755 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-17T05:15:06.755 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acerhdf.ko 2024-04-17T05:15:06.755 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-17T05:15:06.755 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-17T05:15:06.756 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-17T05:15:06.756 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-17T05:15:06.756 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-17T05:15:06.756 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-17T05:15:06.756 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-17T05:15:06.756 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-17T05:15:06.756 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-17T05:15:06.756 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/hdaps.ko 2024-04-17T05:15:06.756 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel 2024-04-17T05:15:06.756 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-17T05:15:06.756 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel_ips.ko 2024-04-17T05:15:06.756 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-17T05:15:06.756 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-17T05:15:06.756 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-17T05:15:06.756 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-17T05:15:06.757 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-17T05:15:06.757 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-17T05:15:06.757 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-17T05:15:06.757 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-17T05:15:06.757 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-17T05:15:06.757 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi.ko 2024-04-17T05:15:06.757 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap 2024-04-17T05:15:06.757 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-17T05:15:06.757 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-17T05:15:06.757 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps 2024-04-17T05:15:06.757 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients 2024-04-17T05:15:06.757 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-17T05:15:06.757 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-17T05:15:06.757 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps_parport.ko 2024-04-17T05:15:06.758 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/pps_core.ko 2024-04-17T05:15:06.758 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp 2024-04-17T05:15:06.758 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp.ko 2024-04-17T05:15:06.758 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp_kvm.ko 2024-04-17T05:15:06.758 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras 2024-04-17T05:15:06.758 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd 2024-04-17T05:15:06.758 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl 2024-04-17T05:15:06.758 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-17T05:15:06.758 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/fmpm.ko 2024-04-17T05:15:06.758 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc 2024-04-17T05:15:06.758 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-17T05:15:06.758 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-17T05:15:06.758 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-17T05:15:06.758 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-17T05:15:06.759 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-17T05:15:06.759 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-17T05:15:06.759 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-17T05:15:06.759 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-17T05:15:06.759 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-17T05:15:06.759 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-17T05:15:06.759 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-em3027.ko 2024-04-17T05:15:06.759 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-17T05:15:06.759 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-17T05:15:06.759 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-17T05:15:06.759 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-17T05:15:06.759 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-17T05:15:06.759 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-17T05:15:06.759 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max6900.ko 2024-04-17T05:15:06.759 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-17T05:15:06.760 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-17T05:15:06.760 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-17T05:15:06.760 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-17T05:15:06.760 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-17T05:15:06.760 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-17T05:15:06.760 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-17T05:15:06.760 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-17T05:15:06.760 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-17T05:15:06.760 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-17T05:15:06.760 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-17T05:15:06.760 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-17T05:15:06.760 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-x1205.ko 2024-04-17T05:15:06.760 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi 2024-04-17T05:15:06.760 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-9xxx.ko 2024-04-17T05:15:06.760 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-sas.ko 2024-04-17T05:15:06.761 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-xxxx.ko 2024-04-17T05:15:06.761 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/BusLogic.ko 2024-04-17T05:15:06.761 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/a100u2w.ko 2024-04-17T05:15:06.761 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid 2024-04-17T05:15:06.761 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-17T05:15:06.761 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/advansys.ko 2024-04-17T05:15:06.761 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx 2024-04-17T05:15:06.761 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-17T05:15:06.761 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-17T05:15:06.761 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/am53c974.ko 2024-04-17T05:15:06.761 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr 2024-04-17T05:15:06.761 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-17T05:15:06.761 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/atp870u.ko 2024-04-17T05:15:06.761 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi 2024-04-17T05:15:06.761 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-17T05:15:06.762 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa 2024-04-17T05:15:06.762 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa/bfa.ko 2024-04-17T05:15:06.762 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc 2024-04-17T05:15:06.762 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-17T05:15:06.762 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i 2024-04-17T05:15:06.762 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-17T05:15:06.762 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ch.ko 2024-04-17T05:15:06.762 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor 2024-04-17T05:15:06.762 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-17T05:15:06.762 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi 2024-04-17T05:15:06.762 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-17T05:15:06.762 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-17T05:15:06.762 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-17T05:15:06.762 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-17T05:15:06.763 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-17T05:15:06.763 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dc395x.ko 2024-04-17T05:15:06.763 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler 2024-04-17T05:15:06.763 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-17T05:15:06.763 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-17T05:15:06.763 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-17T05:15:06.763 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-17T05:15:06.763 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dmx3191d.ko 2024-04-17T05:15:06.763 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r 2024-04-17T05:15:06.763 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-17T05:15:06.763 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esp_scsi.ko 2024-04-17T05:15:06.763 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe 2024-04-17T05:15:06.763 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-17T05:15:06.763 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-17T05:15:06.764 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic 2024-04-17T05:15:06.764 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic/fnic.ko 2024-04-17T05:15:06.764 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hpsa.ko 2024-04-17T05:15:06.764 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hptiop.ko 2024-04-17T05:15:06.764 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hv_storvsc.ko 2024-04-17T05:15:06.764 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/initio.ko 2024-04-17T05:15:06.764 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ipr.ko 2024-04-17T05:15:06.764 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ips.ko 2024-04-17T05:15:06.764 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci 2024-04-17T05:15:06.764 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci/isci.ko 2024-04-17T05:15:06.764 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-17T05:15:06.764 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-17T05:15:06.764 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc 2024-04-17T05:15:06.764 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc/libfc.ko 2024-04-17T05:15:06.764 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi.ko 2024-04-17T05:15:06.765 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-17T05:15:06.765 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas 2024-04-17T05:15:06.765 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas/libsas.ko 2024-04-17T05:15:06.765 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc 2024-04-17T05:15:06.765 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-17T05:15:06.765 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid 2024-04-17T05:15:06.765 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid.ko 2024-04-17T05:15:06.765 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-17T05:15:06.765 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-17T05:15:06.765 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-17T05:15:06.765 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas 2024-04-17T05:15:06.765 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-17T05:15:06.765 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas 2024-04-17T05:15:06.765 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-17T05:15:06.766 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvumi.ko 2024-04-17T05:15:06.766 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001 2024-04-17T05:15:06.766 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-17T05:15:06.766 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pmcraid.ko 2024-04-17T05:15:06.766 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla1280.ko 2024-04-17T05:15:06.766 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx 2024-04-17T05:15:06.766 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-17T05:15:06.766 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-17T05:15:06.766 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx 2024-04-17T05:15:06.766 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-17T05:15:06.766 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/raid_class.ko 2024-04-17T05:15:06.766 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_debug.ko 2024-04-17T05:15:06.766 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-17T05:15:06.766 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-17T05:15:06.767 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-17T05:15:06.767 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-17T05:15:06.767 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-17T05:15:06.767 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ses.ko 2024-04-17T05:15:06.767 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/st.ko 2024-04-17T05:15:06.767 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/stex.ko 2024-04-17T05:15:06.767 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2 2024-04-17T05:15:06.767 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-17T05:15:06.767 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/virtio_scsi.ko 2024-04-17T05:15:06.767 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-17T05:15:06.767 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/wd719x.ko 2024-04-17T05:15:06.767 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb 2024-04-17T05:15:06.767 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb/ssb.ko 2024-04-17T05:15:06.767 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target 2024-04-17T05:15:06.767 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi 2024-04-17T05:15:06.768 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-17T05:15:06.768 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback 2024-04-17T05:15:06.768 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-17T05:15:06.768 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_file.ko 2024-04-17T05:15:06.768 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_iblock.ko 2024-04-17T05:15:06.768 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_mod.ko 2024-04-17T05:15:06.768 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_pscsi.ko 2024-04-17T05:15:06.768 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_user.ko 2024-04-17T05:15:06.768 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc 2024-04-17T05:15:06.768 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-17T05:15:06.768 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal 2024-04-17T05:15:06.768 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel 2024-04-17T05:15:06.768 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal 2024-04-17T05:15:06.768 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-17T05:15:06.769 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-17T05:15:06.769 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-17T05:15:06.769 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-17T05:15:06.769 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-17T05:15:06.769 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-17T05:15:06.769 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-17T05:15:06.769 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-17T05:15:06.769 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-17T05:15:06.769 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-17T05:15:06.769 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-17T05:15:06.769 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-17T05:15:06.769 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-17T05:15:06.769 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-17T05:15:06.769 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-17T05:15:06.769 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-17T05:15:06.770 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-17T05:15:06.770 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-17T05:15:06.770 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty 2024-04-17T05:15:06.770 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless 2024-04-17T05:15:06.770 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-17T05:15:06.770 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_gsm.ko 2024-04-17T05:15:06.770 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_hdlc.ko 2024-04-17T05:15:06.770 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/nozomi.ko 2024-04-17T05:15:06.770 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial 2024-04-17T05:15:06.770 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250 2024-04-17T05:15:06.770 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-17T05:15:06.770 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/arc_uart.ko 2024-04-17T05:15:06.770 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm 2024-04-17T05:15:06.770 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-17T05:15:06.771 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs 2024-04-17T05:15:06.771 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core 2024-04-17T05:15:06.771 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-17T05:15:06.771 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host 2024-04-17T05:15:06.771 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-17T05:15:06.771 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio 2024-04-17T05:15:06.771 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio.ko 2024-04-17T05:15:06.771 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_aec.ko 2024-04-17T05:15:06.771 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_cif.ko 2024-04-17T05:15:06.771 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_pci_generic.ko 2024-04-17T05:15:06.771 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_sercos3.ko 2024-04-17T05:15:06.771 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb 2024-04-17T05:15:06.771 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class 2024-04-17T05:15:06.771 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-acm.ko 2024-04-17T05:15:06.771 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-17T05:15:06.772 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usblp.ko 2024-04-17T05:15:06.772 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usbtmc.ko 2024-04-17T05:15:06.772 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host 2024-04-17T05:15:06.772 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-17T05:15:06.772 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image 2024-04-17T05:15:06.772 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/mdc800.ko 2024-04-17T05:15:06.772 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/microtek.ko 2024-04-17T05:15:06.772 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc 2024-04-17T05:15:06.772 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/adutux.ko 2024-04-17T05:15:06.772 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/appledisplay.ko 2024-04-17T05:15:06.772 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi26.ko 2024-04-17T05:15:06.772 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi62.ko 2024-04-17T05:15:06.772 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ezusb.ko 2024-04-17T05:15:06.772 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/idmouse.ko 2024-04-17T05:15:06.773 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/iowarrior.ko 2024-04-17T05:15:06.773 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-17T05:15:06.773 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ldusb.ko 2024-04-17T05:15:06.773 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/legousbtower.ko 2024-04-17T05:15:06.773 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga 2024-04-17T05:15:06.773 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-17T05:15:06.773 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-17T05:15:06.773 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usb3503.ko 2024-04-17T05:15:06.773 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usblcd.ko 2024-04-17T05:15:06.773 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-17T05:15:06.773 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/uss720.ko 2024-04-17T05:15:06.773 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/yurex.ko 2024-04-17T05:15:06.773 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy 2024-04-17T05:15:06.773 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-generic.ko 2024-04-17T05:15:06.774 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial 2024-04-17T05:15:06.774 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/aircable.ko 2024-04-17T05:15:06.774 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ark3116.ko 2024-04-17T05:15:06.774 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-17T05:15:06.774 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ch341.ko 2024-04-17T05:15:06.774 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cp210x.ko 2024-04-17T05:15:06.774 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cyberjack.ko 2024-04-17T05:15:06.774 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-17T05:15:06.774 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-17T05:15:06.774 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/empeg.ko 2024-04-17T05:15:06.774 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-17T05:15:06.774 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-17T05:15:06.774 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-17T05:15:06.774 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_ti.ko 2024-04-17T05:15:06.774 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipaq.ko 2024-04-17T05:15:06.775 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipw.ko 2024-04-17T05:15:06.775 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ir-usb.ko 2024-04-17T05:15:06.775 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-17T05:15:06.775 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan.ko 2024-04-17T05:15:06.775 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-17T05:15:06.775 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-17T05:15:06.775 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-17T05:15:06.775 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mct_u232.ko 2024-04-17T05:15:06.775 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7720.ko 2024-04-17T05:15:06.775 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7840.ko 2024-04-17T05:15:06.775 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/navman.ko 2024-04-17T05:15:06.775 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/omninet.ko 2024-04-17T05:15:06.775 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/opticon.ko 2024-04-17T05:15:06.775 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/option.ko 2024-04-17T05:15:06.775 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/oti6858.ko 2024-04-17T05:15:06.775 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/pl2303.ko 2024-04-17T05:15:06.776 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcaux.ko 2024-04-17T05:15:06.776 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcserial.ko 2024-04-17T05:15:06.776 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/quatech2.ko 2024-04-17T05:15:06.776 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/safe_serial.ko 2024-04-17T05:15:06.776 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/sierra.ko 2024-04-17T05:15:06.776 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-17T05:15:06.776 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ssu100.ko 2024-04-17T05:15:06.776 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/symbolserial.ko 2024-04-17T05:15:06.776 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-17T05:15:06.776 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-17T05:15:06.776 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_debug.ko 2024-04-17T05:15:06.776 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-17T05:15:06.776 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/visor.ko 2024-04-17T05:15:06.776 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/whiteheat.ko 2024-04-17T05:15:06.776 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-17T05:15:06.777 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage 2024-04-17T05:15:06.777 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/uas.ko 2024-04-17T05:15:06.777 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-17T05:15:06.777 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-17T05:15:06.777 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-17T05:15:06.777 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-17T05:15:06.777 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-17T05:15:06.777 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-17T05:15:06.777 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-17T05:15:06.777 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-karma.ko 2024-04-17T05:15:06.777 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-17T05:15:06.777 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-17T05:15:06.777 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-17T05:15:06.777 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-17T05:15:06.778 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-17T05:15:06.778 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/usb-storage.ko 2024-04-17T05:15:06.778 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip 2024-04-17T05:15:06.778 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-17T05:15:06.778 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-17T05:15:06.778 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-17T05:15:06.778 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio 2024-04-17T05:15:06.778 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci 2024-04-17T05:15:06.778 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-17T05:15:06.778 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-17T05:15:06.778 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio.ko 2024-04-17T05:15:06.778 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-17T05:15:06.778 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost 2024-04-17T05:15:06.778 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost.ko 2024-04-17T05:15:06.778 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-17T05:15:06.779 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_net.ko 2024-04-17T05:15:06.779 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_scsi.ko 2024-04-17T05:15:06.779 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video 2024-04-17T05:15:06.779 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight 2024-04-17T05:15:06.779 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/apple_bl.ko 2024-04-17T05:15:06.779 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lcd.ko 2024-04-17T05:15:06.779 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-17T05:15:06.779 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio 2024-04-17T05:15:06.779 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio.ko 2024-04-17T05:15:06.779 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_balloon.ko 2024-04-17T05:15:06.779 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_mmio.ko 2024-04-17T05:15:06.779 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_pci.ko 2024-04-17T05:15:06.779 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-17T05:15:06.779 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-17T05:15:06.779 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_ring.ko 2024-04-17T05:15:06.780 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1 2024-04-17T05:15:06.780 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters 2024-04-17T05:15:06.780 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2482.ko 2024-04-17T05:15:06.780 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2490.ko 2024-04-17T05:15:06.780 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves 2024-04-17T05:15:06.780 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-17T05:15:06.780 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-17T05:15:06.780 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-17T05:15:06.780 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-17T05:15:06.780 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-17T05:15:06.780 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-17T05:15:06.780 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-17T05:15:06.780 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-17T05:15:06.780 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-17T05:15:06.781 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-17T05:15:06.781 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-17T05:15:06.781 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/wire.ko 2024-04-17T05:15:06.781 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog 2024-04-17T05:15:06.781 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-17T05:15:06.781 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-17T05:15:06.781 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-17T05:15:06.781 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/hpwdt.ko 2024-04-17T05:15:06.781 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/i6300esb.ko 2024-04-17T05:15:06.781 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-17T05:15:06.781 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-17T05:15:06.781 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ib700wdt.ko 2024-04-17T05:15:06.781 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ibmasr.ko 2024-04-17T05:15:06.781 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-17T05:15:06.781 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-17T05:15:06.782 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it87_wdt.ko 2024-04-17T05:15:06.782 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/machzwd.ko 2024-04-17T05:15:06.782 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/nv_tco.ko 2024-04-17T05:15:06.782 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-17T05:15:06.782 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-17T05:15:06.782 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-17T05:15:06.782 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-17T05:15:06.782 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/softdog.ko 2024-04-17T05:15:06.782 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-17T05:15:06.782 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/via_wdt.ko 2024-04-17T05:15:06.782 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-17T05:15:06.782 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-17T05:15:06.782 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-17T05:15:06.782 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wdt_pci.ko 2024-04-17T05:15:06.782 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/xen_wdt.ko 2024-04-17T05:15:06.783 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen 2024-04-17T05:15:06.783 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-17T05:15:06.783 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-evtchn.ko 2024-04-17T05:15:06.783 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntalloc.ko 2024-04-17T05:15:06.783 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntdev.ko 2024-04-17T05:15:06.783 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback 2024-04-17T05:15:06.783 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-17T05:15:06.783 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-privcmd.ko 2024-04-17T05:15:06.783 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs 2024-04-17T05:15:06.783 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-17T05:15:06.783 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs 2024-04-17T05:15:06.783 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p 2024-04-17T05:15:06.783 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p/9p.ko 2024-04-17T05:15:06.783 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs 2024-04-17T05:15:06.783 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs/affs.ko 2024-04-17T05:15:06.783 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs 2024-04-17T05:15:06.784 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs/befs.ko 2024-04-17T05:15:06.784 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/binfmt_misc.ko 2024-04-17T05:15:06.784 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs 2024-04-17T05:15:06.784 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs/btrfs.ko 2024-04-17T05:15:06.784 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles 2024-04-17T05:15:06.784 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles/cachefiles.ko 2024-04-17T05:15:06.784 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph 2024-04-17T05:15:06.784 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph/ceph.ko 2024-04-17T05:15:06.784 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda 2024-04-17T05:15:06.784 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda/coda.ko 2024-04-17T05:15:06.784 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs 2024-04-17T05:15:06.784 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs/cramfs.ko 2024-04-17T05:15:06.784 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm 2024-04-17T05:15:06.784 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm/dlm.ko 2024-04-17T05:15:06.784 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ecryptfs 2024-04-17T05:15:06.784 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-17T05:15:06.785 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs 2024-04-17T05:15:06.785 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs/f2fs.ko 2024-04-17T05:15:06.785 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat 2024-04-17T05:15:06.785 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/fat.ko 2024-04-17T05:15:06.785 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/msdos.ko 2024-04-17T05:15:06.785 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/vfat.ko 2024-04-17T05:15:06.785 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse 2024-04-17T05:15:06.785 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/cuse.ko 2024-04-17T05:15:06.785 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/fuse.ko 2024-04-17T05:15:06.785 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2 2024-04-17T05:15:06.785 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2/gfs2.ko 2024-04-17T05:15:06.785 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs 2024-04-17T05:15:06.785 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs/hfs.ko 2024-04-17T05:15:06.785 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus 2024-04-17T05:15:06.786 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus/hfsplus.ko 2024-04-17T05:15:06.786 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs 2024-04-17T05:15:06.786 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs/isofs.ko 2024-04-17T05:15:06.786 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs 2024-04-17T05:15:06.786 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs/jfs.ko 2024-04-17T05:15:06.786 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd 2024-04-17T05:15:06.786 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd/lockd.ko 2024-04-17T05:15:06.786 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix 2024-04-17T05:15:06.786 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix/minix.ko 2024-04-17T05:15:06.786 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs 2024-04-17T05:15:06.786 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs/netfs.ko 2024-04-17T05:15:06.786 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs 2024-04-17T05:15:06.786 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout 2024-04-17T05:15:06.786 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-17T05:15:06.787 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout 2024-04-17T05:15:06.787 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-17T05:15:06.787 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout 2024-04-17T05:15:06.787 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-17T05:15:06.787 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfs.ko 2024-04-17T05:15:06.787 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv3.ko 2024-04-17T05:15:06.787 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv4.ko 2024-04-17T05:15:06.787 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common 2024-04-17T05:15:06.789 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/grace.ko 2024-04-17T05:15:06.789 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/nfs_acl.ko 2024-04-17T05:15:06.790 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd 2024-04-17T05:15:06.790 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd/nfsd.ko 2024-04-17T05:15:06.790 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2 2024-04-17T05:15:06.790 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2/nilfs2.ko 2024-04-17T05:15:06.790 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls 2024-04-17T05:15:06.790 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-celtic.ko 2024-04-17T05:15:06.790 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-centeuro.ko 2024-04-17T05:15:06.790 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-croatian.ko 2024-04-17T05:15:06.790 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-cyrillic.ko 2024-04-17T05:15:06.790 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-gaelic.ko 2024-04-17T05:15:06.790 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-greek.ko 2024-04-17T05:15:06.790 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-iceland.ko 2024-04-17T05:15:06.790 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-inuit.ko 2024-04-17T05:15:06.790 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-roman.ko 2024-04-17T05:15:06.790 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-romanian.ko 2024-04-17T05:15:06.791 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-turkish.ko 2024-04-17T05:15:06.791 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1250.ko 2024-04-17T05:15:06.791 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1251.ko 2024-04-17T05:15:06.791 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1255.ko 2024-04-17T05:15:06.791 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp737.ko 2024-04-17T05:15:06.791 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp775.ko 2024-04-17T05:15:06.791 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp850.ko 2024-04-17T05:15:06.791 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp852.ko 2024-04-17T05:15:06.791 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp855.ko 2024-04-17T05:15:06.791 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp857.ko 2024-04-17T05:15:06.791 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp860.ko 2024-04-17T05:15:06.791 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp861.ko 2024-04-17T05:15:06.791 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp862.ko 2024-04-17T05:15:06.791 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp863.ko 2024-04-17T05:15:06.791 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp864.ko 2024-04-17T05:15:06.792 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp865.ko 2024-04-17T05:15:06.792 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp866.ko 2024-04-17T05:15:06.792 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp869.ko 2024-04-17T05:15:06.792 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp874.ko 2024-04-17T05:15:06.792 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp932.ko 2024-04-17T05:15:06.792 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp936.ko 2024-04-17T05:15:06.792 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp949.ko 2024-04-17T05:15:06.792 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp950.ko 2024-04-17T05:15:06.792 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_euc-jp.ko 2024-04-17T05:15:06.792 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-1.ko 2024-04-17T05:15:06.792 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-13.ko 2024-04-17T05:15:06.792 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-14.ko 2024-04-17T05:15:06.792 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-15.ko 2024-04-17T05:15:06.792 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-2.ko 2024-04-17T05:15:06.792 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-3.ko 2024-04-17T05:15:06.793 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-4.ko 2024-04-17T05:15:06.793 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-5.ko 2024-04-17T05:15:06.793 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-6.ko 2024-04-17T05:15:06.793 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-7.ko 2024-04-17T05:15:06.793 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-9.ko 2024-04-17T05:15:06.793 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-r.ko 2024-04-17T05:15:06.793 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-ru.ko 2024-04-17T05:15:06.793 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-u.ko 2024-04-17T05:15:06.793 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-17T05:15:06.793 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_utf8.ko 2024-04-17T05:15:06.793 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2 2024-04-17T05:15:06.793 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster 2024-04-17T05:15:06.793 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-17T05:15:06.793 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm 2024-04-17T05:15:06.793 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-17T05:15:06.794 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs 2024-04-17T05:15:06.794 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-17T05:15:06.794 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2.ko 2024-04-17T05:15:06.794 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-17T05:15:06.794 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-17T05:15:06.794 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-17T05:15:06.794 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs 2024-04-17T05:15:06.794 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs/overlay.ko 2024-04-17T05:15:06.794 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore 2024-04-17T05:15:06.794 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore/ramoops.ko 2024-04-17T05:15:06.794 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs 2024-04-17T05:15:06.794 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs/reiserfs.ko 2024-04-17T05:15:06.794 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs 2024-04-17T05:15:06.794 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs/romfs.ko 2024-04-17T05:15:06.795 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb 2024-04-17T05:15:06.795 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client 2024-04-17T05:15:06.795 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client/cifs.ko 2024-04-17T05:15:06.795 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common 2024-04-17T05:15:06.795 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_arc4.ko 2024-04-17T05:15:06.795 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_md4.ko 2024-04-17T05:15:06.795 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs 2024-04-17T05:15:06.795 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs/squashfs.ko 2024-04-17T05:15:06.795 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv 2024-04-17T05:15:06.795 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv/sysv.ko 2024-04-17T05:15:06.795 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf 2024-04-17T05:15:06.795 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf/udf.ko 2024-04-17T05:15:06.795 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs 2024-04-17T05:15:06.795 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs/ufs.ko 2024-04-17T05:15:06.796 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs 2024-04-17T05:15:06.796 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs/xfs.ko 2024-04-17T05:15:06.796 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel 2024-04-17T05:15:06.796 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/rcu 2024-04-17T05:15:06.796 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/rcu/rcutorture.ko 2024-04-17T05:15:06.796 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/torture.ko 2024-04-17T05:15:06.796 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/trace 2024-04-17T05:15:06.796 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-17T05:15:06.796 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib 2024-04-17T05:15:06.796 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/asn1_encoder.ko 2024-04-17T05:15:06.796 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc-itu-t.ko 2024-04-17T05:15:06.796 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc8.ko 2024-04-17T05:15:06.796 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto 2024-04-17T05:15:06.797 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libarc4.ko 2024-04-17T05:15:06.797 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libdes.ko 2024-04-17T05:15:06.797 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/libcrc32c.ko 2024-04-17T05:15:06.797 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lru_cache.ko 2024-04-17T05:15:06.797 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4 2024-04-17T05:15:06.797 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4_compress.ko 2024-04-17T05:15:06.797 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4hc_compress.ko 2024-04-17T05:15:06.797 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math 2024-04-17T05:15:06.797 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math/cordic.ko 2024-04-17T05:15:06.797 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6 2024-04-17T05:15:06.797 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6/raid6_pq.ko 2024-04-17T05:15:06.797 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon 2024-04-17T05:15:06.797 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-17T05:15:06.797 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_bm.ko 2024-04-17T05:15:06.798 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_fsm.ko 2024-04-17T05:15:06.798 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_kmp.ko 2024-04-17T05:15:06.798 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/zstd 2024-04-17T05:15:06.798 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/zstd/zstd_compress.ko 2024-04-17T05:15:06.798 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm 2024-04-17T05:15:06.798 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm/hwpoison-inject.ko 2024-04-17T05:15:06.798 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net 2024-04-17T05:15:06.798 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan 2024-04-17T05:15:06.798 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/6lowpan.ko 2024-04-17T05:15:06.798 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_dest.ko 2024-04-17T05:15:06.798 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_fragment.ko 2024-04-17T05:15:06.798 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_hop.ko 2024-04-17T05:15:06.798 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-17T05:15:06.798 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_mobility.ko 2024-04-17T05:15:06.798 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_routing.ko 2024-04-17T05:15:06.799 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_udp.ko 2024-04-17T05:15:06.799 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802 2024-04-17T05:15:06.799 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/garp.ko 2024-04-17T05:15:06.799 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/mrp.ko 2024-04-17T05:15:06.799 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/p8022.ko 2024-04-17T05:15:06.799 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/psnap.ko 2024-04-17T05:15:06.799 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/stp.ko 2024-04-17T05:15:06.799 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q 2024-04-17T05:15:06.799 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q/8021q.ko 2024-04-17T05:15:06.799 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p 2024-04-17T05:15:06.799 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet.ko 2024-04-17T05:15:06.799 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_fd.ko 2024-04-17T05:15:06.799 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_rdma.ko 2024-04-17T05:15:06.800 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_virtio.ko 2024-04-17T05:15:06.800 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv 2024-04-17T05:15:06.800 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv/batman-adv.ko 2024-04-17T05:15:06.800 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge 2024-04-17T05:15:06.800 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/br_netfilter.ko 2024-04-17T05:15:06.800 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/bridge.ko 2024-04-17T05:15:06.800 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter 2024-04-17T05:15:06.800 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-17T05:15:06.800 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-17T05:15:06.800 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-17T05:15:06.800 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-17T05:15:06.800 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-17T05:15:06.800 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-17T05:15:06.800 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-17T05:15:06.801 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-17T05:15:06.801 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-17T05:15:06.801 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-17T05:15:06.801 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-17T05:15:06.801 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-17T05:15:06.801 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-17T05:15:06.801 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-17T05:15:06.801 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-17T05:15:06.801 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-17T05:15:06.801 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-17T05:15:06.801 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-17T05:15:06.801 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-17T05:15:06.801 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-17T05:15:06.801 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtables.ko 2024-04-17T05:15:06.801 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-17T05:15:06.802 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-17T05:15:06.802 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-17T05:15:06.802 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph 2024-04-17T05:15:06.802 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph/libceph.ko 2024-04-17T05:15:06.802 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core 2024-04-17T05:15:06.802 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/failover.ko 2024-04-17T05:15:06.802 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/pktgen.ko 2024-04-17T05:15:06.802 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp 2024-04-17T05:15:06.802 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp.ko 2024-04-17T05:15:06.802 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_diag.ko 2024-04-17T05:15:06.802 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv4.ko 2024-04-17T05:15:06.802 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv6.ko 2024-04-17T05:15:06.802 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dns_resolver 2024-04-17T05:15:06.802 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dns_resolver/dns_resolver.ko 2024-04-17T05:15:06.803 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa 2024-04-17T05:15:06.803 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/dsa_core.ko 2024-04-17T05:15:06.803 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_brcm.ko 2024-04-17T05:15:06.803 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_dsa.ko 2024-04-17T05:15:06.803 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_none.ko 2024-04-17T05:15:06.803 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_trailer.ko 2024-04-17T05:15:06.803 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154 2024-04-17T05:15:06.803 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan 2024-04-17T05:15:06.803 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-17T05:15:06.803 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154.ko 2024-04-17T05:15:06.803 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-17T05:15:06.803 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4 2024-04-17T05:15:06.803 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ah4.ko 2024-04-17T05:15:06.803 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/esp4.ko 2024-04-17T05:15:06.803 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/fou.ko 2024-04-17T05:15:06.804 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/gre.ko 2024-04-17T05:15:06.804 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/inet_diag.ko 2024-04-17T05:15:06.804 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_gre.ko 2024-04-17T05:15:06.804 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_tunnel.ko 2024-04-17T05:15:06.804 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_vti.ko 2024-04-17T05:15:06.804 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipcomp.ko 2024-04-17T05:15:06.804 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipip.ko 2024-04-17T05:15:06.804 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter 2024-04-17T05:15:06.804 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-17T05:15:06.804 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-17T05:15:06.804 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-17T05:15:06.804 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-17T05:15:06.804 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-17T05:15:06.804 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-17T05:15:06.804 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-17T05:15:06.805 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-17T05:15:06.805 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-17T05:15:06.805 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-17T05:15:06.805 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-17T05:15:06.805 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-17T05:15:06.805 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-17T05:15:06.805 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-17T05:15:06.805 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-17T05:15:06.805 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-17T05:15:06.805 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-17T05:15:06.805 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-17T05:15:06.805 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-17T05:15:06.805 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-17T05:15:06.805 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-17T05:15:06.806 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_bic.ko 2024-04-17T05:15:06.806 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_dctcp.ko 2024-04-17T05:15:06.806 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_diag.ko 2024-04-17T05:15:06.806 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_highspeed.ko 2024-04-17T05:15:06.806 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_htcp.ko 2024-04-17T05:15:06.806 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_hybla.ko 2024-04-17T05:15:06.806 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_illinois.ko 2024-04-17T05:15:06.806 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_lp.ko 2024-04-17T05:15:06.806 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_scalable.ko 2024-04-17T05:15:06.806 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_vegas.ko 2024-04-17T05:15:06.806 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_veno.ko 2024-04-17T05:15:06.806 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_westwood.ko 2024-04-17T05:15:06.806 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_yeah.ko 2024-04-17T05:15:06.806 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tunnel4.ko 2024-04-17T05:15:06.806 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_diag.ko 2024-04-17T05:15:06.807 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_tunnel.ko 2024-04-17T05:15:06.807 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-17T05:15:06.807 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6 2024-04-17T05:15:06.807 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ah6.ko 2024-04-17T05:15:06.807 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/esp6.ko 2024-04-17T05:15:06.807 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/fou6.ko 2024-04-17T05:15:06.807 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_tunnel.ko 2024-04-17T05:15:06.807 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-17T05:15:06.807 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_vti.ko 2024-04-17T05:15:06.807 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ipcomp6.ko 2024-04-17T05:15:06.807 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter 2024-04-17T05:15:06.807 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-17T05:15:06.807 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-17T05:15:06.807 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-17T05:15:06.807 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-17T05:15:06.808 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-17T05:15:06.808 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-17T05:15:06.808 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-17T05:15:06.808 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-17T05:15:06.808 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-17T05:15:06.808 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-17T05:15:06.808 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-17T05:15:06.808 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-17T05:15:06.808 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-17T05:15:06.808 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-17T05:15:06.808 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-17T05:15:06.808 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-17T05:15:06.808 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-17T05:15:06.808 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-17T05:15:06.808 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-17T05:15:06.808 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-17T05:15:06.809 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-17T05:15:06.809 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-17T05:15:06.809 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-17T05:15:06.809 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-17T05:15:06.809 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/sit.ko 2024-04-17T05:15:06.809 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/tunnel6.ko 2024-04-17T05:15:06.809 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-17T05:15:06.809 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key 2024-04-17T05:15:06.809 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key/af_key.ko 2024-04-17T05:15:06.809 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp 2024-04-17T05:15:06.809 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_core.ko 2024-04-17T05:15:06.809 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-17T05:15:06.809 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_eth.ko 2024-04-17T05:15:06.809 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip.ko 2024-04-17T05:15:06.809 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip6.ko 2024-04-17T05:15:06.810 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_netlink.ko 2024-04-17T05:15:06.810 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ppp.ko 2024-04-17T05:15:06.810 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc 2024-04-17T05:15:06.810 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc/llc.ko 2024-04-17T05:15:06.810 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154 2024-04-17T05:15:06.810 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154/mac802154.ko 2024-04-17T05:15:06.810 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls 2024-04-17T05:15:06.810 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls/mpls_gso.ko 2024-04-17T05:15:06.810 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter 2024-04-17T05:15:06.810 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset 2024-04-17T05:15:06.810 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set.ko 2024-04-17T05:15:06.810 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-17T05:15:06.810 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-17T05:15:06.810 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-17T05:15:06.811 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-17T05:15:06.811 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-17T05:15:06.811 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-17T05:15:06.811 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-17T05:15:06.811 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-17T05:15:06.811 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-17T05:15:06.811 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-17T05:15:06.811 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-17T05:15:06.811 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-17T05:15:06.811 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-17T05:15:06.811 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-17T05:15:06.811 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-17T05:15:06.811 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs 2024-04-17T05:15:06.811 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-17T05:15:06.811 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-17T05:15:06.812 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-17T05:15:06.812 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-17T05:15:06.812 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-17T05:15:06.812 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-17T05:15:06.812 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-17T05:15:06.812 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-17T05:15:06.812 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-17T05:15:06.812 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-17T05:15:06.812 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-17T05:15:06.812 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-17T05:15:06.812 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-17T05:15:06.812 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-17T05:15:06.812 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conncount.ko 2024-04-17T05:15:06.812 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack.ko 2024-04-17T05:15:06.812 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-17T05:15:06.812 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-17T05:15:06.813 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-17T05:15:06.813 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-17T05:15:06.813 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-17T05:15:06.813 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-17T05:15:06.813 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-17T05:15:06.813 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-17T05:15:06.813 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-17T05:15:06.813 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-17T05:15:06.813 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-17T05:15:06.813 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-17T05:15:06.813 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-17T05:15:06.813 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table.ko 2024-04-17T05:15:06.813 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-17T05:15:06.813 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_log_syslog.ko 2024-04-17T05:15:06.814 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat.ko 2024-04-17T05:15:06.814 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-17T05:15:06.814 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-17T05:15:06.814 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_irc.ko 2024-04-17T05:15:06.814 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_sip.ko 2024-04-17T05:15:06.814 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-17T05:15:06.814 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-17T05:15:06.814 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_tables.ko 2024-04-17T05:15:06.814 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink.ko 2024-04-17T05:15:06.814 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-17T05:15:06.814 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_log.ko 2024-04-17T05:15:06.814 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-17T05:15:06.814 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-17T05:15:06.814 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_chain_nat.ko 2024-04-17T05:15:06.814 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_compat.ko 2024-04-17T05:15:06.815 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_ct.ko 2024-04-17T05:15:06.815 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-17T05:15:06.815 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fib.ko 2024-04-17T05:15:06.815 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-17T05:15:06.815 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_hash.ko 2024-04-17T05:15:06.815 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_limit.ko 2024-04-17T05:15:06.815 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_log.ko 2024-04-17T05:15:06.815 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_masq.ko 2024-04-17T05:15:06.815 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_nat.ko 2024-04-17T05:15:06.815 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_numgen.ko 2024-04-17T05:15:06.815 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_queue.ko 2024-04-17T05:15:06.815 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_quota.ko 2024-04-17T05:15:06.815 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_redir.ko 2024-04-17T05:15:06.815 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject.ko 2024-04-17T05:15:06.815 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject_inet.ko 2024-04-17T05:15:06.816 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_socket.ko 2024-04-17T05:15:06.816 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_tunnel.ko 2024-04-17T05:15:06.816 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_AUDIT.ko 2024-04-17T05:15:06.816 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-17T05:15:06.816 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-17T05:15:06.816 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-17T05:15:06.816 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CT.ko 2024-04-17T05:15:06.816 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_DSCP.ko 2024-04-17T05:15:06.816 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HL.ko 2024-04-17T05:15:06.816 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HMARK.ko 2024-04-17T05:15:06.816 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-17T05:15:06.816 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LED.ko 2024-04-17T05:15:06.816 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LOG.ko 2024-04-17T05:15:06.816 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-17T05:15:06.817 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NETMAP.ko 2024-04-17T05:15:06.817 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFLOG.ko 2024-04-17T05:15:06.817 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-17T05:15:06.817 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_RATEEST.ko 2024-04-17T05:15:06.817 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-17T05:15:06.817 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_SECMARK.ko 2024-04-17T05:15:06.817 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-17T05:15:06.817 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-17T05:15:06.817 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TEE.ko 2024-04-17T05:15:06.817 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TPROXY.ko 2024-04-17T05:15:06.817 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TRACE.ko 2024-04-17T05:15:06.817 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_addrtype.ko 2024-04-17T05:15:06.817 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_bpf.ko 2024-04-17T05:15:06.817 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cgroup.ko 2024-04-17T05:15:06.817 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cluster.ko 2024-04-17T05:15:06.817 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_comment.ko 2024-04-17T05:15:06.818 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connbytes.ko 2024-04-17T05:15:06.818 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlabel.ko 2024-04-17T05:15:06.818 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlimit.ko 2024-04-17T05:15:06.818 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connmark.ko 2024-04-17T05:15:06.818 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_conntrack.ko 2024-04-17T05:15:06.818 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cpu.ko 2024-04-17T05:15:06.818 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dccp.ko 2024-04-17T05:15:06.818 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_devgroup.ko 2024-04-17T05:15:06.818 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dscp.ko 2024-04-17T05:15:06.818 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ecn.ko 2024-04-17T05:15:06.818 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_esp.ko 2024-04-17T05:15:06.818 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hashlimit.ko 2024-04-17T05:15:06.818 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_helper.ko 2024-04-17T05:15:06.818 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hl.ko 2024-04-17T05:15:06.819 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipcomp.ko 2024-04-17T05:15:06.819 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_iprange.ko 2024-04-17T05:15:06.819 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipvs.ko 2024-04-17T05:15:06.819 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_l2tp.ko 2024-04-17T05:15:06.819 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_length.ko 2024-04-17T05:15:06.819 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_limit.ko 2024-04-17T05:15:06.819 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mac.ko 2024-04-17T05:15:06.819 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mark.ko 2024-04-17T05:15:06.819 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_multiport.ko 2024-04-17T05:15:06.819 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nat.ko 2024-04-17T05:15:06.819 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nfacct.ko 2024-04-17T05:15:06.819 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_osf.ko 2024-04-17T05:15:06.819 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_owner.ko 2024-04-17T05:15:06.819 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_physdev.ko 2024-04-17T05:15:06.819 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_pkttype.ko 2024-04-17T05:15:06.820 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_policy.ko 2024-04-17T05:15:06.820 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_quota.ko 2024-04-17T05:15:06.820 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_rateest.ko 2024-04-17T05:15:06.820 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_realm.ko 2024-04-17T05:15:06.820 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_recent.ko 2024-04-17T05:15:06.820 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_sctp.ko 2024-04-17T05:15:06.820 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_set.ko 2024-04-17T05:15:06.820 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_socket.ko 2024-04-17T05:15:06.820 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_state.ko 2024-04-17T05:15:06.820 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_statistic.ko 2024-04-17T05:15:06.820 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_string.ko 2024-04-17T05:15:06.820 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_tcpmss.ko 2024-04-17T05:15:06.820 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_time.ko 2024-04-17T05:15:06.820 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_u32.ko 2024-04-17T05:15:06.821 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink 2024-04-17T05:15:06.821 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink/netlink_diag.ko 2024-04-17T05:15:06.821 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh 2024-04-17T05:15:06.821 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh/nsh.ko 2024-04-17T05:15:06.821 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch 2024-04-17T05:15:06.821 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/openvswitch.ko 2024-04-17T05:15:06.821 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-geneve.ko 2024-04-17T05:15:06.821 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-gre.ko 2024-04-17T05:15:06.821 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-vxlan.ko 2024-04-17T05:15:06.821 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet 2024-04-17T05:15:06.821 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet/af_packet_diag.ko 2024-04-17T05:15:06.821 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds 2024-04-17T05:15:06.821 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds.ko 2024-04-17T05:15:06.821 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_rdma.ko 2024-04-17T05:15:06.822 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_tcp.ko 2024-04-17T05:15:06.822 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched 2024-04-17T05:15:06.822 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_csum.ko 2024-04-17T05:15:06.822 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_gact.ko 2024-04-17T05:15:06.822 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_mirred.ko 2024-04-17T05:15:06.822 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_nat.ko 2024-04-17T05:15:06.822 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_pedit.ko 2024-04-17T05:15:06.822 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_police.ko 2024-04-17T05:15:06.822 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_simple.ko 2024-04-17T05:15:06.822 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_skbedit.ko 2024-04-17T05:15:06.822 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_vlan.ko 2024-04-17T05:15:06.822 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_basic.ko 2024-04-17T05:15:06.822 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_bpf.ko 2024-04-17T05:15:06.822 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_flow.ko 2024-04-17T05:15:06.822 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_fw.ko 2024-04-17T05:15:06.823 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_route.ko 2024-04-17T05:15:06.823 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_u32.ko 2024-04-17T05:15:06.823 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_cmp.ko 2024-04-17T05:15:06.823 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_ipset.ko 2024-04-17T05:15:06.823 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_meta.ko 2024-04-17T05:15:06.823 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_nbyte.ko 2024-04-17T05:15:06.823 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_text.ko 2024-04-17T05:15:06.823 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_u32.ko 2024-04-17T05:15:06.823 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_choke.ko 2024-04-17T05:15:06.823 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_codel.ko 2024-04-17T05:15:06.823 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_drr.ko 2024-04-17T05:15:06.823 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_fq.ko 2024-04-17T05:15:06.823 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_gred.ko 2024-04-17T05:15:06.824 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hfsc.ko 2024-04-17T05:15:06.824 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hhf.ko 2024-04-17T05:15:06.824 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_htb.ko 2024-04-17T05:15:06.824 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_ingress.ko 2024-04-17T05:15:06.824 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio.ko 2024-04-17T05:15:06.824 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio_lib.ko 2024-04-17T05:15:06.824 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_multiq.ko 2024-04-17T05:15:06.824 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_netem.ko 2024-04-17T05:15:06.824 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_pie.ko 2024-04-17T05:15:06.824 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_plug.ko 2024-04-17T05:15:06.824 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_prio.ko 2024-04-17T05:15:06.824 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_qfq.ko 2024-04-17T05:15:06.824 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_red.ko 2024-04-17T05:15:06.824 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfb.ko 2024-04-17T05:15:06.824 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfq.ko 2024-04-17T05:15:06.824 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_tbf.ko 2024-04-17T05:15:06.825 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_teql.ko 2024-04-17T05:15:06.825 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp 2024-04-17T05:15:06.825 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp.ko 2024-04-17T05:15:06.825 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp_diag.ko 2024-04-17T05:15:06.825 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc 2024-04-17T05:15:06.825 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss 2024-04-17T05:15:06.825 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-17T05:15:06.825 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-17T05:15:06.825 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/sunrpc.ko 2024-04-17T05:15:06.825 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma 2024-04-17T05:15:06.825 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-17T05:15:06.825 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc 2024-04-17T05:15:06.825 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc.ko 2024-04-17T05:15:06.825 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc_diag.ko 2024-04-17T05:15:06.826 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix 2024-04-17T05:15:06.826 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix/unix_diag.ko 2024-04-17T05:15:06.826 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock 2024-04-17T05:15:06.826 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-17T05:15:06.826 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-17T05:15:06.826 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock.ko 2024-04-17T05:15:06.826 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-17T05:15:06.826 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-17T05:15:06.826 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm 2024-04-17T05:15:06.826 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-17T05:15:06.826 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security 2024-04-17T05:15:06.826 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys 2024-04-17T05:15:06.826 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/encrypted-keys 2024-04-17T05:15:06.826 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-17T05:15:06.827 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/trusted-keys 2024-04-17T05:15:06.827 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/trusted-keys/trusted.ko 2024-04-17T05:15:06.827 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias 2024-04-17T05:15:06.827 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias.bin 2024-04-17T05:15:06.827 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin 2024-04-17T05:15:06.827 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.alias.bin 2024-04-17T05:15:06.827 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.bin 2024-04-17T05:15:06.827 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.modinfo 2024-04-17T05:15:06.827 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep 2024-04-17T05:15:06.827 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep.bin 2024-04-17T05:15:06.827 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.devname 2024-04-17T05:15:06.827 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.order 2024-04-17T05:15:06.827 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.softdep 2024-04-17T05:15:06.827 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols 2024-04-17T05:15:06.827 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols.bin 2024-04-17T05:15:06.828 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/vmlinuz 2024-04-17T05:15:06.831 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g3f60ed14f7c1 2024-04-17T05:15:06.831 DEBUG:teuthology.orchestra.run.smithi164:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-17T05:15:06.853 INFO:teuthology.orchestra.run.smithi164.stdout:postinstall scriptlet (using /bin/sh): 2024-04-17T05:15:06.853 INFO:teuthology.orchestra.run.smithi164.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-17T05:15:06.853 INFO:teuthology.orchestra.run.smithi164.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g3f60ed14f7c1 /lib/modules/6.9.0-rc3-g3f60ed14f7c1/vmlinuz 2024-04-17T05:15:06.853 INFO:teuthology.orchestra.run.smithi164.stdout:fi 2024-04-17T05:15:06.853 INFO:teuthology.orchestra.run.smithi164.stdout:for file in vmlinuz System.map config; do 2024-04-17T05:15:06.854 INFO:teuthology.orchestra.run.smithi164.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/${file}" "/boot/${file}-6.9.0-rc3-g3f60ed14f7c1"; then 2024-04-17T05:15:06.854 INFO:teuthology.orchestra.run.smithi164.stdout: cp "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/${file}" "/boot/${file}-6.9.0-rc3-g3f60ed14f7c1" 2024-04-17T05:15:06.854 INFO:teuthology.orchestra.run.smithi164.stdout: fi 2024-04-17T05:15:06.854 INFO:teuthology.orchestra.run.smithi164.stdout:done 2024-04-17T05:15:06.854 INFO:teuthology.orchestra.run.smithi164.stdout:if [ -d "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/dtb" ] && \ 2024-04-17T05:15:06.854 INFO:teuthology.orchestra.run.smithi164.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/dtb" "/boot/dtb-6.9.0-rc3-g3f60ed14f7c1" >/dev/null 2>&1; then 2024-04-17T05:15:06.854 INFO:teuthology.orchestra.run.smithi164.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g3f60ed14f7c1" 2024-04-17T05:15:06.854 INFO:teuthology.orchestra.run.smithi164.stdout: cp -r "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/dtb" "/boot/dtb-6.9.0-rc3-g3f60ed14f7c1" 2024-04-17T05:15:06.854 INFO:teuthology.orchestra.run.smithi164.stdout:fi 2024-04-17T05:15:06.854 INFO:teuthology.orchestra.run.smithi164.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep" ]; then 2024-04-17T05:15:06.854 INFO:teuthology.orchestra.run.smithi164.stdout: /usr/sbin/depmod 6.9.0-rc3-g3f60ed14f7c1 2024-04-17T05:15:06.854 INFO:teuthology.orchestra.run.smithi164.stdout:fi 2024-04-17T05:15:06.854 INFO:teuthology.orchestra.run.smithi164.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-17T05:15:06.854 INFO:teuthology.orchestra.run.smithi164.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-17T05:15:06.855 INFO:teuthology.orchestra.run.smithi164.stdout:kernel-install remove 6.9.0-rc3-g3f60ed14f7c1 2024-04-17T05:15:06.855 INFO:teuthology.orchestra.run.smithi164.stdout:fi 2024-04-17T05:15:06.855 DEBUG:teuthology.orchestra.run.smithi164:> sudo rpm -qi grub2-tools 2024-04-17T05:15:06.933 INFO:teuthology.orchestra.run.smithi164.stdout:Name : grub2-tools 2024-04-17T05:15:06.934 INFO:teuthology.orchestra.run.smithi164.stdout:Epoch : 1 2024-04-17T05:15:06.934 INFO:teuthology.orchestra.run.smithi164.stdout:Version : 2.06 2024-04-17T05:15:06.934 INFO:teuthology.orchestra.run.smithi164.stdout:Release : 68.el9 2024-04-17T05:15:06.934 INFO:teuthology.orchestra.run.smithi164.stdout:Architecture: x86_64 2024-04-17T05:15:06.934 INFO:teuthology.orchestra.run.smithi164.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-17T05:15:06.934 INFO:teuthology.orchestra.run.smithi164.stdout:Group : Unspecified 2024-04-17T05:15:06.934 INFO:teuthology.orchestra.run.smithi164.stdout:Size : 8264254 2024-04-17T05:15:06.934 INFO:teuthology.orchestra.run.smithi164.stdout:License : GPLv3+ 2024-04-17T05:15:06.934 INFO:teuthology.orchestra.run.smithi164.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-17T05:15:06.934 INFO:teuthology.orchestra.run.smithi164.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-17T05:15:06.934 INFO:teuthology.orchestra.run.smithi164.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-17T05:15:06.934 INFO:teuthology.orchestra.run.smithi164.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-17T05:15:06.934 INFO:teuthology.orchestra.run.smithi164.stdout:Packager : builder@centos.org 2024-04-17T05:15:06.935 INFO:teuthology.orchestra.run.smithi164.stdout:Vendor : CentOS 2024-04-17T05:15:06.935 INFO:teuthology.orchestra.run.smithi164.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-17T05:15:06.935 INFO:teuthology.orchestra.run.smithi164.stdout:Summary : Support tools for GRUB. 2024-04-17T05:15:06.935 INFO:teuthology.orchestra.run.smithi164.stdout:Description : 2024-04-17T05:15:06.935 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:15:06.935 INFO:teuthology.orchestra.run.smithi164.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-17T05:15:06.935 INFO:teuthology.orchestra.run.smithi164.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-17T05:15:06.935 INFO:teuthology.orchestra.run.smithi164.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-17T05:15:06.935 INFO:teuthology.orchestra.run.smithi164.stdout:hardware devices. 2024-04-17T05:15:06.935 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:15:06.935 INFO:teuthology.orchestra.run.smithi164.stdout:This subpackage provides tools for support of all platforms. 2024-04-17T05:15:06.936 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-17T05:15:06.936 INFO:teuthology.task.kernel:Updating grub on smithi164 to boot 6.9.0-rc3-g3f60ed14f7c1 2024-04-17T05:15:06.936 DEBUG:teuthology.orchestra.run.smithi164:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-17T05:15:07.554 INFO:teuthology.orchestra.run.smithi164.stderr:Generating grub configuration file ... 2024-04-17T05:15:08.985 INFO:teuthology.orchestra.run.smithi164.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-17T05:15:09.016 INFO:teuthology.orchestra.run.smithi164.stderr:done 2024-04-17T05:15:09.019 DEBUG:teuthology.orchestra.run.smithi164:> mktemp 2024-04-17T05:15:09.033 INFO:teuthology.orchestra.run.smithi164.stdout:/tmp/tmp.VT1WYAMkzl 2024-04-17T05:15:09.033 DEBUG:teuthology.orchestra.run.smithi164:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.VT1WYAMkzl 2024-04-17T05:15:09.103 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0666 /tmp/tmp.VT1WYAMkzl 2024-04-17T05:15:09.240 DEBUG:teuthology.orchestra.remote:smithi164:/tmp/tmp.VT1WYAMkzl is 6KB 2024-04-17T05:15:09.260 DEBUG:teuthology.orchestra.run.smithi164:> rm -fr /tmp/tmp.VT1WYAMkzl 2024-04-17T05:15:09.274 DEBUG:teuthology.orchestra.run.smithi164:> sudo /bin/ls /boot/loader/entries || true 2024-04-17T05:15:09.344 INFO:teuthology.orchestra.run.smithi164.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-17T05:15:09.345 INFO:teuthology.orchestra.run.smithi164.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-17T05:15:09.345 INFO:teuthology.orchestra.run.smithi164.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-17T05:15:09.345 INFO:teuthology.orchestra.run.smithi164.stdout:15949e3c88704300882482eddfd7baae-6.9.0-rc3-g3f60ed14f7c1.conf 2024-04-17T05:15:09.346 DEBUG:teuthology.orchestra.run.smithi164:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.9.0-rc3-g3f60ed14f7c1 2024-04-17T05:15:09.516 DEBUG:teuthology.orchestra.run.smithi164:> sudo shutdown -r now 2024-04-17T05:15:21.102 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-17T05:15:21.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-04-17T05:15:21.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:15:39.534 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-17T05:15:39.535 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-17T05:15:39.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:16:13.983 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-04-17T05:16:21.113 DEBUG:teuthology.orchestra.remote:timed out 2024-04-17T05:16:22.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-17T05:16:22.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:16:30.118 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-04-17T05:16:30.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:16:41.374 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-04-17T05:16:45.921 DEBUG:teuthology.orchestra.run.smithi123:> true 2024-04-17T05:16:46.502 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-04-17T05:16:46.502 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.9.0-rc3-g3f60ed14f7c1"... 2024-04-17T05:16:46.503 DEBUG:teuthology.orchestra.run.smithi123:> uname -r 2024-04-17T05:16:46.540 INFO:teuthology.orchestra.run.smithi123.stdout:6.9.0-rc3-g3f60ed14f7c1 2024-04-17T05:16:46.540 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g3f60ed14f7c1 vs 6.9.0-rc3-g3f60ed14f7c1 2024-04-17T05:16:46.540 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-17T05:16:46.540 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-17T05:16:47.541 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-17T05:16:47.541 DEBUG:teuthology.orchestra.run.smithi123:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-17T05:16:47.652 INFO:teuthology.orchestra.run.smithi123.stdout:ttyS1 2024-04-17T05:16:47.704 DEBUG:teuthology.parallel:result is None 2024-04-17T05:16:53.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-17T05:16:53.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:16:56.446 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-04-17T05:17:11.447 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-17T05:17:11.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:17:11.957 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-04-17T05:17:12.566 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-17T05:17:12.567 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.9.0-rc3-g3f60ed14f7c1"... 2024-04-17T05:17:12.567 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2024-04-17T05:17:12.605 INFO:teuthology.orchestra.run.smithi164.stdout:6.9.0-rc3-g3f60ed14f7c1 2024-04-17T05:17:12.605 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g3f60ed14f7c1 vs 6.9.0-rc3-g3f60ed14f7c1 2024-04-17T05:17:12.605 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-17T05:17:12.606 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-17T05:17:13.606 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-17T05:17:13.607 DEBUG:teuthology.orchestra.run.smithi164:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-17T05:17:13.744 INFO:teuthology.orchestra.run.smithi164.stdout:ttyS1 2024-04-17T05:17:13.801 DEBUG:teuthology.parallel:result is None 2024-04-17T05:17:13.802 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-17T05:17:13.811 INFO:teuthology.task.internal:Creating test directory... 2024-04-17T05:17:13.811 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-17T05:17:13.819 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-17T05:17:13.868 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-17T05:17:13.876 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-17T05:17:13.885 INFO:teuthology.task.internal:Creating archive directory... 2024-04-17T05:17:13.885 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-17T05:17:13.890 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-17T05:17:13.976 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-17T05:17:13.984 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-17T05:17:13.984 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-17T05:17:13.991 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-17T05:17:14.074 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-17T05:17:14.089 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-17T05:17:14.109 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-17T05:17:14.127 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-17T05:17:14.132 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-17T05:17:14.140 INFO:teuthology.task.internal:Configuring sudo... 2024-04-17T05:17:14.141 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-17T05:17:14.148 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-17T05:17:14.233 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-17T05:17:14.244 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-17T05:17:14.244 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-17T05:17:14.251 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-17T05:17:14.298 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-17T05:17:14.378 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-17T05:17:14.502 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-17T05:17:14.583 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-17T05:17:14.676 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-17T05:17:14.676 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-17T05:17:14.763 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-17T05:17:14.827 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-17T05:17:14.922 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-17T05:17:14.986 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-17T05:17:15.065 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-17T05:17:15.065 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-17T05:17:15.130 DEBUG:teuthology.orchestra.run.smithi123:> sudo service rsyslog restart 2024-04-17T05:17:15.138 DEBUG:teuthology.orchestra.run.smithi164:> sudo service rsyslog restart 2024-04-17T05:17:15.268 INFO:teuthology.orchestra.run.smithi164.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-17T05:17:15.269 INFO:teuthology.orchestra.run.smithi123.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-17T05:17:15.604 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-17T05:17:15.615 INFO:teuthology.task.internal:Starting timer... 2024-04-17T05:17:15.615 INFO:teuthology.run_tasks:Running task pcp... 2024-04-17T05:17:15.626 INFO:teuthology.run_tasks:Running task selinux... 2024-04-17T05:17:15.639 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-17T05:17:15.639 DEBUG:teuthology.orchestra.run.smithi123:> sudo service auditd rotate 2024-04-17T05:17:15.782 INFO:teuthology.orchestra.run.smithi123.stdout:Rotating logs: 2024-04-17T05:17:15.786 DEBUG:teuthology.orchestra.run.smithi164:> sudo service auditd rotate 2024-04-17T05:17:15.888 INFO:teuthology.orchestra.run.smithi164.stdout:Rotating logs: 2024-04-17T05:17:15.893 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-17T05:17:15.893 DEBUG:teuthology.orchestra.run.smithi123:> /usr/sbin/getenforce 2024-04-17T05:17:15.970 INFO:teuthology.orchestra.run.smithi123.stdout:Permissive 2024-04-17T05:17:15.970 DEBUG:teuthology.orchestra.run.smithi164:> /usr/sbin/getenforce 2024-04-17T05:17:16.048 INFO:teuthology.orchestra.run.smithi164.stdout:Permissive 2024-04-17T05:17:16.048 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi123.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi164.front.sepia.ceph.com': 'permissive'} 2024-04-17T05:17:16.049 DEBUG:teuthology.orchestra.run.smithi123:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-17T05:17:16.134 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T05:17:16.134 DEBUG:teuthology.orchestra.run.smithi164:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-17T05:17:16.219 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T05:17:16.220 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-17T05:17:16.220 DEBUG:teuthology.orchestra.run.smithi123:> sudo /usr/sbin/setenforce permissive 2024-04-17T05:17:16.308 DEBUG:teuthology.orchestra.run.smithi164:> sudo /usr/sbin/setenforce permissive 2024-04-17T05:17:16.403 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-17T05:17:16.416 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-17T05:17:16.433 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-17T05:17:16.434 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi123.front.sepia.ceph.com,smithi164.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-17T05:23:28.141 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi123.front.sepia.ceph.com'), Remote(name='ubuntu@smithi164.front.sepia.ceph.com')] 2024-04-17T05:23:28.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-04-17T05:23:28.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:23:28.284 DEBUG:teuthology.orchestra.run.smithi123:> true 2024-04-17T05:23:28.451 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-04-17T05:23:28.451 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-17T05:23:28.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:23:28.592 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-04-17T05:23:28.755 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-17T05:23:28.755 INFO:teuthology.run_tasks:Running task clock... 2024-04-17T05:23:28.766 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-17T05:23:28.767 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-17T05:23:28.767 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-17T05:23:28.775 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-17T05:23:28.775 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-17T05:23:28.872 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-17T05:23:28.874 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-17T05:23:28.923 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-17T05:23:28.927 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-17T05:23:29.010 INFO:teuthology.orchestra.run.smithi164.stderr:sudo: ntpd: command not found 2024-04-17T05:23:29.023 INFO:teuthology.orchestra.run.smithi123.stderr:sudo: ntpd: command not found 2024-04-17T05:23:29.052 INFO:teuthology.orchestra.run.smithi164.stdout:506 Cannot talk to daemon 2024-04-17T05:23:29.066 INFO:teuthology.orchestra.run.smithi123.stdout:506 Cannot talk to daemon 2024-04-17T05:23:29.102 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-17T05:23:29.118 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-17T05:23:29.150 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-17T05:23:29.170 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-17T05:23:29.292 INFO:teuthology.orchestra.run.smithi164.stderr:bash: line 1: ntpq: command not found 2024-04-17T05:23:29.300 INFO:teuthology.orchestra.run.smithi164.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-17T05:23:29.300 INFO:teuthology.orchestra.run.smithi164.stdout:=============================================================================== 2024-04-17T05:23:29.300 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-17T05:23:29.301 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-17T05:23:29.301 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-17T05:23:29.301 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-17T05:23:29.303 INFO:teuthology.orchestra.run.smithi123.stderr:bash: line 1: ntpq: command not found 2024-04-17T05:23:29.311 INFO:teuthology.orchestra.run.smithi123.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-17T05:23:29.311 INFO:teuthology.orchestra.run.smithi123.stdout:=============================================================================== 2024-04-17T05:23:29.311 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-17T05:23:29.311 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-17T05:23:29.311 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-17T05:23:29.311 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-17T05:23:29.313 INFO:teuthology.run_tasks:Running task install... 2024-04-17T05:23:29.321 DEBUG:teuthology.task.install:project ceph 2024-04-17T05:23:29.321 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda'}} 2024-04-17T05:23:29.321 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda'} 2024-04-17T05:23:29.321 INFO:teuthology.task.install:Using flavor: default 2024-04-17T05:23:29.327 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-17T05:23:29.327 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-17T05:23:29.328 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda', 'tag': None, 'wait_for_package': False} 2024-04-17T05:23:29.328 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a8c84f5997950fd7d008204839253291d52e6eda 2024-04-17T05:23:29.330 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda', 'tag': None, 'wait_for_package': False} 2024-04-17T05:23:29.330 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a8c84f5997950fd7d008204839253291d52e6eda 2024-04-17T05:23:29.479 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/ 2024-04-17T05:23:29.479 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3133.ga8c84f59 2024-04-17T05:23:29.558 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/ 2024-04-17T05:23:29.558 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3133.ga8c84f59 2024-04-17T05:23:29.830 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-17T05:23:29.830 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-17T05:23:29.830 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-17T05:23:29.922 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-17T05:23:29.923 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-17T05:23:29.923 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-17T05:23:29.931 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-17T05:23:29.931 DEBUG:teuthology.orchestra.run.smithi123:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a8c84f5997950fd7d008204839253291d52e6eda/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-17T05:23:30.022 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-17T05:23:30.023 DEBUG:teuthology.orchestra.run.smithi164:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a8c84f5997950fd7d008204839253291d52e6eda/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-17T05:23:30.072 DEBUG:teuthology.orchestra.run.smithi123:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-17T05:23:30.162 DEBUG:teuthology.orchestra.run.smithi164:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-17T05:23:30.208 DEBUG:teuthology.orchestra.run.smithi123:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-17T05:23:30.296 DEBUG:teuthology.orchestra.run.smithi164:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-17T05:23:30.302 INFO:teuthology.orchestra.run.smithi123.stdout:check_obsoletes = 1 2024-04-17T05:23:30.306 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum clean all 2024-04-17T05:23:30.384 INFO:teuthology.orchestra.run.smithi164.stdout:check_obsoletes = 1 2024-04-17T05:23:30.388 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum clean all 2024-04-17T05:23:30.658 INFO:teuthology.orchestra.run.smithi123.stdout:74 files removed 2024-04-17T05:23:30.697 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-17T05:23:30.736 INFO:teuthology.orchestra.run.smithi164.stdout:74 files removed 2024-04-17T05:23:30.775 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-17T05:23:31.805 INFO:teuthology.orchestra.run.smithi123.stdout:ceph packages for x86_64 139 kB/s | 84 kB 00:00 2024-04-17T05:23:31.903 INFO:teuthology.orchestra.run.smithi164.stdout:ceph packages for x86_64 136 kB/s | 84 kB 00:00 2024-04-17T05:23:32.405 INFO:teuthology.orchestra.run.smithi123.stdout:ceph noarch packages 23 kB/s | 12 kB 00:00 2024-04-17T05:23:32.428 INFO:teuthology.orchestra.run.smithi164.stdout:ceph noarch packages 27 kB/s | 12 kB 00:00 2024-04-17T05:23:33.006 INFO:teuthology.orchestra.run.smithi123.stdout:ceph source packages 3.6 kB/s | 1.9 kB 00:00 2024-04-17T05:23:33.087 INFO:teuthology.orchestra.run.smithi164.stdout:ceph source packages 3.2 kB/s | 1.9 kB 00:00 2024-04-17T05:23:34.433 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS-9 - AppStream 5.3 MB/s | 6.7 MB 00:01 2024-04-17T05:23:36.234 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS-9 - AppStream 2.1 MB/s | 6.7 MB 00:03 2024-04-17T05:23:36.442 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS-9 - BaseOS 2.8 MB/s | 2.0 MB 00:00 2024-04-17T05:23:38.035 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS-9 - BaseOS 3.6 MB/s | 2.0 MB 00:00 2024-04-17T05:23:39.055 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.0 MB 00:00 2024-04-17T05:23:40.154 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - BaseOS 2.4 MB/s | 8.0 MB 00:03 2024-04-17T05:23:42.230 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-04-17T05:23:43.548 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - AppStream 5.9 MB/s | 19 MB 00:03 2024-04-17T05:23:47.447 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 6.2 MB 00:01 2024-04-17T05:23:49.065 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - Extras packages 70 kB/s | 16 kB 00:00 2024-04-17T05:23:51.075 INFO:teuthology.orchestra.run.smithi164.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-04-17T05:23:55.414 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - CRB 787 kB/s | 6.2 MB 00:08 2024-04-17T05:23:56.949 INFO:teuthology.orchestra.run.smithi164.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-04-17T05:23:57.935 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 16 kB 00:01 2024-04-17T05:23:59.159 INFO:teuthology.orchestra.run.smithi123.stdout:Extra Packages for Enterprise Linux 21 MB/s | 21 MB 00:01 2024-04-17T05:23:59.889 INFO:teuthology.orchestra.run.smithi164.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-17T05:23:59.890 INFO:teuthology.orchestra.run.smithi164.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-17T05:23:59.911 INFO:teuthology.orchestra.run.smithi164.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-17T05:23:59.912 INFO:teuthology.orchestra.run.smithi164.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-17T05:23:59.913 INFO:teuthology.orchestra.run.smithi164.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-17T05:23:59.915 INFO:teuthology.orchestra.run.smithi164.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-17T05:23:59.917 INFO:teuthology.orchestra.run.smithi164.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-17T05:23:59.920 INFO:teuthology.orchestra.run.smithi164.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-17T05:23:59.922 INFO:teuthology.orchestra.run.smithi164.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-17T05:24:00.009 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-04-17T05:24:00.040 INFO:teuthology.orchestra.run.smithi164.stdout:============================================================================================ 2024-04-17T05:24:00.040 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-04-17T05:24:00.041 INFO:teuthology.orchestra.run.smithi164.stdout:============================================================================================ 2024-04-17T05:24:00.041 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-04-17T05:24:00.041 INFO:teuthology.orchestra.run.smithi164.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-04-17T05:24:00.041 INFO:teuthology.orchestra.run.smithi164.stdout: ceph x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 6.6 k 2024-04-17T05:24:00.041 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 5.4 M 2024-04-17T05:24:00.041 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 893 k 2024-04-17T05:24:00.041 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 145 k 2024-04-17T05:24:00.041 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 1.5 M 2024-04-17T05:24:00.041 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 142 k 2024-04-17T05:24:00.041 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 3.5 M 2024-04-17T05:24:00.041 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 7.4 M 2024-04-17T05:24:00.041 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-rook noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 49 k 2024-04-17T05:24:00.042 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 11 M 2024-04-17T05:24:00.042 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 49 M 2024-04-17T05:24:00.042 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-volume noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 273 k 2024-04-17T05:24:00.042 INFO:teuthology.orchestra.run.smithi164.stdout: cephadm noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 763 k 2024-04-17T05:24:00.042 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-mirror x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 225 k 2024-04-17T05:24:00.042 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-shell x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 27 k 2024-04-17T05:24:00.042 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-top noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 18 k 2024-04-17T05:24:00.042 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-17T05:24:00.042 INFO:teuthology.orchestra.run.smithi164.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-04-17T05:24:00.042 INFO:teuthology.orchestra.run.smithi164.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-04-17T05:24:00.042 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 32 k 2024-04-17T05:24:00.042 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 748 k 2024-04-17T05:24:00.043 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 126 k 2024-04-17T05:24:00.043 INFO:teuthology.orchestra.run.smithi164.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-04-17T05:24:00.043 INFO:teuthology.orchestra.run.smithi164.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-17T05:24:00.043 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-17T05:24:00.043 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-04-17T05:24:00.043 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-04-17T05:24:00.043 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-04-17T05:24:00.043 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 162 k 2024-04-17T05:24:00.043 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 321 k 2024-04-17T05:24:00.043 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 299 k 2024-04-17T05:24:00.043 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 99 k 2024-04-17T05:24:00.043 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 85 k 2024-04-17T05:24:00.043 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 3.1 M 2024-04-17T05:24:00.044 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 170 k 2024-04-17T05:24:00.044 INFO:teuthology.orchestra.run.smithi164.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-17T05:24:00.044 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrading: 2024-04-17T05:24:00.044 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager x86_64 1:1.47.4-1.el9 CentOS-BaseOS 2.3 M 2024-04-17T05:24:00.044 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-libnm x86_64 1:1.47.4-1.el9 CentOS-BaseOS 1.8 M 2024-04-17T05:24:00.044 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-team x86_64 1:1.47.4-1.el9 CentOS-BaseOS 41 k 2024-04-17T05:24:00.044 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-tui x86_64 1:1.47.4-1.el9 CentOS-BaseOS 248 k 2024-04-17T05:24:00.044 INFO:teuthology.orchestra.run.smithi164.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-17T05:24:00.044 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-17T05:24:00.044 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-17T05:24:00.044 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-17T05:24:00.044 INFO:teuthology.orchestra.run.smithi164.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-17T05:24:00.045 INFO:teuthology.orchestra.run.smithi164.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-17T05:24:00.045 INFO:teuthology.orchestra.run.smithi164.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-17T05:24:00.045 INFO:teuthology.orchestra.run.smithi164.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-17T05:24:00.045 INFO:teuthology.orchestra.run.smithi164.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-17T05:24:00.045 INFO:teuthology.orchestra.run.smithi164.stdout: librados2 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 3.4 M 2024-04-17T05:24:00.045 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 3.1 M 2024-04-17T05:24:00.045 INFO:teuthology.orchestra.run.smithi164.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-17T05:24:00.045 INFO:teuthology.orchestra.run.smithi164.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-17T05:24:00.045 INFO:teuthology.orchestra.run.smithi164.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-17T05:24:00.045 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-17T05:24:00.045 INFO:teuthology.orchestra.run.smithi164.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-17T05:24:00.045 INFO:teuthology.orchestra.run.smithi164.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-17T05:24:00.045 INFO:teuthology.orchestra.run.smithi164.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-17T05:24:00.045 INFO:teuthology.orchestra.run.smithi164.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-04-17T05:24:00.045 INFO:teuthology.orchestra.run.smithi164.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-17T05:24:00.046 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-04-17T05:24:00.046 INFO:teuthology.orchestra.run.smithi164.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-17T05:24:00.046 INFO:teuthology.orchestra.run.smithi164.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-04-17T05:24:00.046 INFO:teuthology.orchestra.run.smithi164.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-17T05:24:00.046 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 21 M 2024-04-17T05:24:00.046 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 34 k 2024-04-17T05:24:00.046 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 2.4 M 2024-04-17T05:24:00.046 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 249 k 2024-04-17T05:24:00.046 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 4.7 M 2024-04-17T05:24:00.046 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 17 M 2024-04-17T05:24:00.046 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 16 k 2024-04-17T05:24:00.046 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 25 k 2024-04-17T05:24:00.046 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-17T05:24:00.047 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-17T05:24:00.047 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-17T05:24:00.047 INFO:teuthology.orchestra.run.smithi164.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-17T05:24:00.047 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-17T05:24:00.047 INFO:teuthology.orchestra.run.smithi164.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-17T05:24:00.047 INFO:teuthology.orchestra.run.smithi164.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-17T05:24:00.047 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-17T05:24:00.047 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-17T05:24:00.047 INFO:teuthology.orchestra.run.smithi164.stdout: libcephsqlite x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 163 k 2024-04-17T05:24:00.047 INFO:teuthology.orchestra.run.smithi164.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-17T05:24:00.047 INFO:teuthology.orchestra.run.smithi164.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-17T05:24:00.047 INFO:teuthology.orchestra.run.smithi164.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-17T05:24:00.047 INFO:teuthology.orchestra.run.smithi164.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-17T05:24:00.047 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-17T05:24:00.048 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 501 k 2024-04-17T05:24:00.048 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-17T05:24:00.048 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 5.4 M 2024-04-17T05:24:00.048 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-17T05:24:00.048 INFO:teuthology.orchestra.run.smithi164.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-04-17T05:24:00.048 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-17T05:24:00.048 INFO:teuthology.orchestra.run.smithi164.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-04-17T05:24:00.048 INFO:teuthology.orchestra.run.smithi164.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-17T05:24:00.048 INFO:teuthology.orchestra.run.smithi164.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-17T05:24:00.048 INFO:teuthology.orchestra.run.smithi164.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-17T05:24:00.048 INFO:teuthology.orchestra.run.smithi164.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-17T05:24:00.048 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-17T05:24:00.048 INFO:teuthology.orchestra.run.smithi164.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-17T05:24:00.048 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-04-17T05:24:00.049 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-04-17T05:24:00.049 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-17T05:24:00.049 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-17T05:24:00.049 INFO:teuthology.orchestra.run.smithi164.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-04-17T05:24:00.049 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-17T05:24:00.049 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-17T05:24:00.049 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-17T05:24:00.049 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 45 k 2024-04-17T05:24:00.049 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 135 k 2024-04-17T05:24:00.049 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-17T05:24:00.049 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-17T05:24:00.049 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-17T05:24:00.049 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-17T05:24:00.049 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-17T05:24:00.050 INFO:teuthology.orchestra.run.smithi164.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-17T05:24:00.050 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-17T05:24:00.050 INFO:teuthology.orchestra.run.smithi164.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-17T05:24:00.050 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-17T05:24:00.050 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-17T05:24:00.050 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-17T05:24:00.050 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-17T05:24:00.050 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-17T05:24:00.050 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-17T05:24:00.050 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-17T05:24:00.050 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-17T05:24:00.050 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-17T05:24:00.050 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-17T05:24:00.051 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-17T05:24:00.051 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-17T05:24:00.051 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-17T05:24:00.051 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-17T05:24:00.051 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-17T05:24:00.051 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-17T05:24:00.051 INFO:teuthology.orchestra.run.smithi164.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-17T05:24:00.051 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-17T05:24:00.051 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-17T05:24:00.051 INFO:teuthology.orchestra.run.smithi164.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-17T05:24:00.051 INFO:teuthology.orchestra.run.smithi164.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-04-17T05:24:00.051 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-17T05:24:00.051 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-17T05:24:00.051 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-17T05:24:00.052 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-17T05:24:00.052 INFO:teuthology.orchestra.run.smithi164.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-04-17T05:24:00.052 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-17T05:24:00.052 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-17T05:24:00.052 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-17T05:24:00.052 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-17T05:24:00.052 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-17T05:24:00.052 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-17T05:24:00.052 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-17T05:24:00.052 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-17T05:24:00.052 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-17T05:24:00.052 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-17T05:24:00.052 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-17T05:24:00.052 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-17T05:24:00.052 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-17T05:24:00.053 INFO:teuthology.orchestra.run.smithi164.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-17T05:24:00.053 INFO:teuthology.orchestra.run.smithi164.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-17T05:24:00.053 INFO:teuthology.orchestra.run.smithi164.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-17T05:24:00.053 INFO:teuthology.orchestra.run.smithi164.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-04-17T05:24:00.053 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-17T05:24:00.053 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-17T05:24:00.053 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-17T05:24:00.053 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-17T05:24:00.053 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-04-17T05:24:00.053 INFO:teuthology.orchestra.run.smithi164.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-04-17T05:24:00.053 INFO:teuthology.orchestra.run.smithi164.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-17T05:24:00.053 INFO:teuthology.orchestra.run.smithi164.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-17T05:24:00.053 INFO:teuthology.orchestra.run.smithi164.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-17T05:24:00.053 INFO:teuthology.orchestra.run.smithi164.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-04-17T05:24:00.054 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-17T05:24:00.054 INFO:teuthology.orchestra.run.smithi164.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-04-17T05:24:00.054 INFO:teuthology.orchestra.run.smithi164.stdout:Installing weak dependencies: 2024-04-17T05:24:00.054 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-04-17T05:24:00.054 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:24:00.054 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-04-17T05:24:00.054 INFO:teuthology.orchestra.run.smithi164.stdout:============================================================================================ 2024-04-17T05:24:00.054 INFO:teuthology.orchestra.run.smithi164.stdout:Install 150 Packages 2024-04-17T05:24:00.054 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrade 24 Packages 2024-04-17T05:24:00.054 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:24:00.055 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 229 M 2024-04-17T05:24:00.055 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-04-17T05:24:00.734 INFO:teuthology.orchestra.run.smithi164.stdout:(1/174): ceph-19.0.0-3133.ga8c84f59.el9.x86_64. 21 kB/s | 6.6 kB 00:00 2024-04-17T05:24:01.610 INFO:teuthology.orchestra.run.smithi164.stdout:(2/174): ceph-fuse-19.0.0-3133.ga8c84f59.el9.x8 1.0 MB/s | 893 kB 00:00 2024-04-17T05:24:01.710 INFO:teuthology.orchestra.run.smithi164.stdout:(3/174): ceph-immutable-object-cache-19.0.0-313 1.4 MB/s | 145 kB 00:00 2024-04-17T05:24:02.927 INFO:teuthology.orchestra.run.smithi164.stdout:(4/174): ceph-base-19.0.0-3133.ga8c84f59.el9.x8 2.1 MB/s | 5.4 MB 00:02 2024-04-17T05:24:03.277 INFO:teuthology.orchestra.run.smithi164.stdout:(5/174): ceph-mgr-19.0.0-3133.ga8c84f59.el9.x86 4.3 MB/s | 1.5 MB 00:00 2024-04-17T05:24:03.344 INFO:teuthology.orchestra.run.smithi164.stdout:(6/174): ceph-mds-19.0.0-3133.ga8c84f59.el9.x86 1.4 MB/s | 2.4 MB 00:01 2024-04-17T05:24:03.611 INFO:teuthology.orchestra.run.smithi164.stdout:(7/174): ceph-common-19.0.0-3133.ga8c84f59.el9. 6.6 MB/s | 21 MB 00:03 2024-04-17T05:24:04.161 INFO:teuthology.orchestra.run.smithi164.stdout:(8/174): ceph-mon-19.0.0-3133.ga8c84f59.el9.x86 5.3 MB/s | 4.7 MB 00:00 2024-04-17T05:24:04.244 INFO:teuthology.orchestra.run.smithi164.stdout:(9/174): ceph-selinux-19.0.0-3133.ga8c84f59.el9 306 kB/s | 25 kB 00:00 2024-04-17T05:24:04.686 INFO:teuthology.orchestra.run.smithi164.stdout:(10/174): ceph-radosgw-19.0.0-3133.ga8c84f59.el 9.9 MB/s | 11 MB 00:01 2024-04-17T05:24:04.745 INFO:teuthology.orchestra.run.smithi164.stdout:(11/174): cephfs-mirror-19.0.0-3133.ga8c84f59.e 3.8 MB/s | 225 kB 00:00 2024-04-17T05:24:04.828 INFO:teuthology.orchestra.run.smithi164.stdout:(12/174): cephfs-shell-19.0.0-3133.ga8c84f59.el 328 kB/s | 27 kB 00:00 2024-04-17T05:24:04.950 INFO:teuthology.orchestra.run.smithi123.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-04-17T05:24:05.204 INFO:teuthology.orchestra.run.smithi164.stdout:(13/174): libcephfs-devel-19.0.0-3133.ga8c84f59 85 kB/s | 32 kB 00:00 2024-04-17T05:24:05.345 INFO:teuthology.orchestra.run.smithi164.stdout:(14/174): libcephfs2-19.0.0-3133.ga8c84f59.el9. 5.2 MB/s | 748 kB 00:00 2024-04-17T05:24:05.404 INFO:teuthology.orchestra.run.smithi164.stdout:(15/174): libcephsqlite-19.0.0-3133.ga8c84f59.e 2.8 MB/s | 163 kB 00:00 2024-04-17T05:24:05.454 INFO:teuthology.orchestra.run.smithi164.stdout:(16/174): librados-devel-19.0.0-3133.ga8c84f59. 2.5 MB/s | 126 kB 00:00 2024-04-17T05:24:05.563 INFO:teuthology.orchestra.run.smithi164.stdout:(17/174): libradosstriper1-19.0.0-3133.ga8c84f5 4.5 MB/s | 501 kB 00:00 2024-04-17T05:24:06.255 INFO:teuthology.orchestra.run.smithi164.stdout:(18/174): librgw2-19.0.0-3133.ga8c84f59.el9.x86 7.8 MB/s | 5.4 MB 00:00 2024-04-17T05:24:06.305 INFO:teuthology.orchestra.run.smithi164.stdout:(19/174): python3-ceph-argparse-19.0.0-3133.ga8 919 kB/s | 45 kB 00:00 2024-04-17T05:24:06.364 INFO:teuthology.orchestra.run.smithi164.stdout:(20/174): python3-ceph-common-19.0.0-3133.ga8c8 2.3 MB/s | 135 kB 00:00 2024-04-17T05:24:06.439 INFO:teuthology.orchestra.run.smithi164.stdout:(21/174): python3-cephfs-19.0.0-3133.ga8c84f59. 2.1 MB/s | 162 kB 00:00 2024-04-17T05:24:06.506 INFO:teuthology.orchestra.run.smithi164.stdout:(22/174): python3-rados-19.0.0-3133.ga8c84f59.e 4.8 MB/s | 321 kB 00:00 2024-04-17T05:24:06.590 INFO:teuthology.orchestra.run.smithi164.stdout:(23/174): python3-rbd-19.0.0-3133.ga8c84f59.el9 3.5 MB/s | 299 kB 00:00 2024-04-17T05:24:06.640 INFO:teuthology.orchestra.run.smithi164.stdout:(24/174): python3-rgw-19.0.0-3133.ga8c84f59.el9 2.0 MB/s | 99 kB 00:00 2024-04-17T05:24:06.699 INFO:teuthology.orchestra.run.smithi164.stdout:(25/174): rbd-fuse-19.0.0-3133.ga8c84f59.el9.x8 1.4 MB/s | 85 kB 00:00 2024-04-17T05:24:07.024 INFO:teuthology.orchestra.run.smithi164.stdout:(26/174): rbd-mirror-19.0.0-3133.ga8c84f59.el9. 9.5 MB/s | 3.1 MB 00:00 2024-04-17T05:24:07.083 INFO:teuthology.orchestra.run.smithi164.stdout:(27/174): rbd-nbd-19.0.0-3133.ga8c84f59.el9.x86 2.9 MB/s | 170 kB 00:00 2024-04-17T05:24:07.133 INFO:teuthology.orchestra.run.smithi164.stdout:(28/174): ceph-grafana-dashboards-19.0.0-3133.g 698 kB/s | 34 kB 00:00 2024-04-17T05:24:07.183 INFO:teuthology.orchestra.run.smithi164.stdout:(29/174): ceph-mgr-cephadm-19.0.0-3133.ga8c84f5 2.8 MB/s | 142 kB 00:00 2024-04-17T05:24:07.485 INFO:teuthology.orchestra.run.smithi164.stdout:(30/174): ceph-mgr-dashboard-19.0.0-3133.ga8c84 12 MB/s | 3.5 MB 00:00 2024-04-17T05:24:07.910 INFO:teuthology.orchestra.run.smithi123.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-17T05:24:07.912 INFO:teuthology.orchestra.run.smithi123.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-17T05:24:07.932 INFO:teuthology.orchestra.run.smithi123.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-17T05:24:07.933 INFO:teuthology.orchestra.run.smithi123.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-17T05:24:07.935 INFO:teuthology.orchestra.run.smithi123.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-17T05:24:07.936 INFO:teuthology.orchestra.run.smithi123.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-17T05:24:07.939 INFO:teuthology.orchestra.run.smithi123.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-17T05:24:07.942 INFO:teuthology.orchestra.run.smithi123.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-17T05:24:07.944 INFO:teuthology.orchestra.run.smithi123.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-17T05:24:08.030 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-04-17T05:24:08.059 INFO:teuthology.orchestra.run.smithi123.stdout:============================================================================================ 2024-04-17T05:24:08.059 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2024-04-17T05:24:08.059 INFO:teuthology.orchestra.run.smithi123.stdout:============================================================================================ 2024-04-17T05:24:08.059 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-04-17T05:24:08.059 INFO:teuthology.orchestra.run.smithi123.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-04-17T05:24:08.059 INFO:teuthology.orchestra.run.smithi123.stdout: ceph x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 6.6 k 2024-04-17T05:24:08.059 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 5.4 M 2024-04-17T05:24:08.060 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-fuse x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 893 k 2024-04-17T05:24:08.060 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 145 k 2024-04-17T05:24:08.060 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 1.5 M 2024-04-17T05:24:08.060 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 142 k 2024-04-17T05:24:08.060 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 3.5 M 2024-04-17T05:24:08.060 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 7.4 M 2024-04-17T05:24:08.060 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-rook noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 49 k 2024-04-17T05:24:08.060 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-radosgw x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 11 M 2024-04-17T05:24:08.060 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-test x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 49 M 2024-04-17T05:24:08.060 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-volume noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 273 k 2024-04-17T05:24:08.061 INFO:teuthology.orchestra.run.smithi123.stdout: cephadm noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 763 k 2024-04-17T05:24:08.061 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-mirror x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 225 k 2024-04-17T05:24:08.061 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-shell x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 27 k 2024-04-17T05:24:08.061 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-top noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 18 k 2024-04-17T05:24:08.061 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-17T05:24:08.061 INFO:teuthology.orchestra.run.smithi123.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-04-17T05:24:08.061 INFO:teuthology.orchestra.run.smithi123.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-04-17T05:24:08.061 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs-devel x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 32 k 2024-04-17T05:24:08.061 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 748 k 2024-04-17T05:24:08.061 INFO:teuthology.orchestra.run.smithi123.stdout: librados-devel x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 126 k 2024-04-17T05:24:08.061 INFO:teuthology.orchestra.run.smithi123.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-04-17T05:24:08.062 INFO:teuthology.orchestra.run.smithi123.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-17T05:24:08.062 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-17T05:24:08.062 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-04-17T05:24:08.062 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-04-17T05:24:08.062 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-04-17T05:24:08.062 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cephfs x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 162 k 2024-04-17T05:24:08.062 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rados x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 321 k 2024-04-17T05:24:08.062 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rbd x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 299 k 2024-04-17T05:24:08.062 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rgw x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 99 k 2024-04-17T05:24:08.063 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-fuse x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 85 k 2024-04-17T05:24:08.063 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-mirror x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 3.1 M 2024-04-17T05:24:08.063 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-nbd x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 170 k 2024-04-17T05:24:08.063 INFO:teuthology.orchestra.run.smithi123.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-17T05:24:08.063 INFO:teuthology.orchestra.run.smithi123.stdout:Upgrading: 2024-04-17T05:24:08.063 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager x86_64 1:1.47.4-1.el9 CentOS-BaseOS 2.3 M 2024-04-17T05:24:08.063 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-libnm x86_64 1:1.47.4-1.el9 CentOS-BaseOS 1.8 M 2024-04-17T05:24:08.063 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-team x86_64 1:1.47.4-1.el9 CentOS-BaseOS 41 k 2024-04-17T05:24:08.063 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-tui x86_64 1:1.47.4-1.el9 CentOS-BaseOS 248 k 2024-04-17T05:24:08.063 INFO:teuthology.orchestra.run.smithi123.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-17T05:24:08.063 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-17T05:24:08.063 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-17T05:24:08.064 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-17T05:24:08.064 INFO:teuthology.orchestra.run.smithi123.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-17T05:24:08.064 INFO:teuthology.orchestra.run.smithi123.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-17T05:24:08.064 INFO:teuthology.orchestra.run.smithi123.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-17T05:24:08.064 INFO:teuthology.orchestra.run.smithi123.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-17T05:24:08.064 INFO:teuthology.orchestra.run.smithi123.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-17T05:24:08.064 INFO:teuthology.orchestra.run.smithi123.stdout: librados2 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 3.4 M 2024-04-17T05:24:08.064 INFO:teuthology.orchestra.run.smithi123.stdout: librbd1 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 3.1 M 2024-04-17T05:24:08.064 INFO:teuthology.orchestra.run.smithi123.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-17T05:24:08.064 INFO:teuthology.orchestra.run.smithi123.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-17T05:24:08.064 INFO:teuthology.orchestra.run.smithi123.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-17T05:24:08.064 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-17T05:24:08.064 INFO:teuthology.orchestra.run.smithi123.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-17T05:24:08.064 INFO:teuthology.orchestra.run.smithi123.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-17T05:24:08.064 INFO:teuthology.orchestra.run.smithi123.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-17T05:24:08.065 INFO:teuthology.orchestra.run.smithi123.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-04-17T05:24:08.065 INFO:teuthology.orchestra.run.smithi123.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-17T05:24:08.065 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2024-04-17T05:24:08.065 INFO:teuthology.orchestra.run.smithi123.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-17T05:24:08.065 INFO:teuthology.orchestra.run.smithi123.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-04-17T05:24:08.065 INFO:teuthology.orchestra.run.smithi123.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-17T05:24:08.065 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-common x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 21 M 2024-04-17T05:24:08.065 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 34 k 2024-04-17T05:24:08.065 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mds x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 2.4 M 2024-04-17T05:24:08.065 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 249 k 2024-04-17T05:24:08.065 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mon x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 4.7 M 2024-04-17T05:24:08.065 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-osd x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 17 M 2024-04-17T05:24:08.065 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 16 k 2024-04-17T05:24:08.066 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-selinux x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 25 k 2024-04-17T05:24:08.066 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-17T05:24:08.066 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-17T05:24:08.066 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-17T05:24:08.066 INFO:teuthology.orchestra.run.smithi123.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-17T05:24:08.066 INFO:teuthology.orchestra.run.smithi123.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-17T05:24:08.066 INFO:teuthology.orchestra.run.smithi123.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-17T05:24:08.066 INFO:teuthology.orchestra.run.smithi123.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-17T05:24:08.066 INFO:teuthology.orchestra.run.smithi123.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-17T05:24:08.066 INFO:teuthology.orchestra.run.smithi123.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-17T05:24:08.066 INFO:teuthology.orchestra.run.smithi123.stdout: libcephsqlite x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 163 k 2024-04-17T05:24:08.066 INFO:teuthology.orchestra.run.smithi123.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-17T05:24:08.066 INFO:teuthology.orchestra.run.smithi123.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-17T05:24:08.067 INFO:teuthology.orchestra.run.smithi123.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-17T05:24:08.067 INFO:teuthology.orchestra.run.smithi123.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-17T05:24:08.067 INFO:teuthology.orchestra.run.smithi123.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-17T05:24:08.067 INFO:teuthology.orchestra.run.smithi123.stdout: libradosstriper1 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 501 k 2024-04-17T05:24:08.067 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-17T05:24:08.067 INFO:teuthology.orchestra.run.smithi123.stdout: librgw2 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 5.4 M 2024-04-17T05:24:08.067 INFO:teuthology.orchestra.run.smithi123.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-17T05:24:08.067 INFO:teuthology.orchestra.run.smithi123.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-04-17T05:24:08.067 INFO:teuthology.orchestra.run.smithi123.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-17T05:24:08.067 INFO:teuthology.orchestra.run.smithi123.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-04-17T05:24:08.067 INFO:teuthology.orchestra.run.smithi123.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-17T05:24:08.067 INFO:teuthology.orchestra.run.smithi123.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-17T05:24:08.067 INFO:teuthology.orchestra.run.smithi123.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-17T05:24:08.067 INFO:teuthology.orchestra.run.smithi123.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-17T05:24:08.068 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-17T05:24:08.068 INFO:teuthology.orchestra.run.smithi123.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-17T05:24:08.068 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-04-17T05:24:08.068 INFO:teuthology.orchestra.run.smithi123.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-04-17T05:24:08.068 INFO:teuthology.orchestra.run.smithi123.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-17T05:24:08.068 INFO:teuthology.orchestra.run.smithi123.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-17T05:24:08.068 INFO:teuthology.orchestra.run.smithi123.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-04-17T05:24:08.068 INFO:teuthology.orchestra.run.smithi123.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-17T05:24:08.068 INFO:teuthology.orchestra.run.smithi123.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-17T05:24:08.068 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-17T05:24:08.068 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-argparse x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 45 k 2024-04-17T05:24:08.068 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 135 k 2024-04-17T05:24:08.068 INFO:teuthology.orchestra.run.smithi123.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-17T05:24:08.068 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-17T05:24:08.068 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-17T05:24:08.069 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-17T05:24:08.069 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-17T05:24:08.069 INFO:teuthology.orchestra.run.smithi123.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-17T05:24:08.069 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-17T05:24:08.069 INFO:teuthology.orchestra.run.smithi123.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-17T05:24:08.069 INFO:teuthology.orchestra.run.smithi123.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-17T05:24:08.069 INFO:teuthology.orchestra.run.smithi123.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-17T05:24:08.069 INFO:teuthology.orchestra.run.smithi123.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-17T05:24:08.069 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-17T05:24:08.069 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-17T05:24:08.069 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-17T05:24:08.069 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-17T05:24:08.069 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-17T05:24:08.069 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-17T05:24:08.069 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-17T05:24:08.070 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-17T05:24:08.070 INFO:teuthology.orchestra.run.smithi123.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-17T05:24:08.070 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-17T05:24:08.070 INFO:teuthology.orchestra.run.smithi123.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-17T05:24:08.070 INFO:teuthology.orchestra.run.smithi123.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-17T05:24:08.070 INFO:teuthology.orchestra.run.smithi123.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-17T05:24:08.070 INFO:teuthology.orchestra.run.smithi123.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-17T05:24:08.070 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-17T05:24:08.070 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-17T05:24:08.070 INFO:teuthology.orchestra.run.smithi123.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-17T05:24:08.070 INFO:teuthology.orchestra.run.smithi123.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-04-17T05:24:08.070 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-17T05:24:08.071 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-17T05:24:08.071 INFO:teuthology.orchestra.run.smithi123.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-17T05:24:08.071 INFO:teuthology.orchestra.run.smithi123.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-17T05:24:08.071 INFO:teuthology.orchestra.run.smithi123.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-04-17T05:24:08.071 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-17T05:24:08.071 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-17T05:24:08.071 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-17T05:24:08.071 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-17T05:24:08.071 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-17T05:24:08.071 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-17T05:24:08.071 INFO:teuthology.orchestra.run.smithi123.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-17T05:24:08.072 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-17T05:24:08.072 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-17T05:24:08.072 INFO:teuthology.orchestra.run.smithi123.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-17T05:24:08.072 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-17T05:24:08.072 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-17T05:24:08.072 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-17T05:24:08.072 INFO:teuthology.orchestra.run.smithi123.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-17T05:24:08.072 INFO:teuthology.orchestra.run.smithi123.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-17T05:24:08.072 INFO:teuthology.orchestra.run.smithi123.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-17T05:24:08.072 INFO:teuthology.orchestra.run.smithi123.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-04-17T05:24:08.072 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-17T05:24:08.072 INFO:teuthology.orchestra.run.smithi123.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-17T05:24:08.072 INFO:teuthology.orchestra.run.smithi123.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-17T05:24:08.072 INFO:teuthology.orchestra.run.smithi123.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-17T05:24:08.072 INFO:teuthology.orchestra.run.smithi123.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-04-17T05:24:08.072 INFO:teuthology.orchestra.run.smithi123.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-04-17T05:24:08.073 INFO:teuthology.orchestra.run.smithi123.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-17T05:24:08.073 INFO:teuthology.orchestra.run.smithi123.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-17T05:24:08.073 INFO:teuthology.orchestra.run.smithi123.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-17T05:24:08.073 INFO:teuthology.orchestra.run.smithi123.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-04-17T05:24:08.073 INFO:teuthology.orchestra.run.smithi123.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-17T05:24:08.073 INFO:teuthology.orchestra.run.smithi123.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-04-17T05:24:08.073 INFO:teuthology.orchestra.run.smithi123.stdout:Installing weak dependencies: 2024-04-17T05:24:08.073 INFO:teuthology.orchestra.run.smithi123.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-04-17T05:24:08.073 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:24:08.074 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-04-17T05:24:08.074 INFO:teuthology.orchestra.run.smithi123.stdout:============================================================================================ 2024-04-17T05:24:08.074 INFO:teuthology.orchestra.run.smithi123.stdout:Install 150 Packages 2024-04-17T05:24:08.074 INFO:teuthology.orchestra.run.smithi123.stdout:Upgrade 24 Packages 2024-04-17T05:24:08.074 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:24:08.074 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 229 M 2024-04-17T05:24:08.074 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-04-17T05:24:08.092 INFO:teuthology.orchestra.run.smithi164.stdout:(31/174): ceph-mgr-diskprediction-local-19.0.0- 12 MB/s | 7.4 MB 00:00 2024-04-17T05:24:08.309 INFO:teuthology.orchestra.run.smithi164.stdout:(32/174): ceph-osd-19.0.0-3133.ga8c84f59.el9.x8 3.4 MB/s | 17 MB 00:04 2024-04-17T05:24:08.343 INFO:teuthology.orchestra.run.smithi164.stdout:(33/174): ceph-mgr-modules-core-19.0.0-3133.ga8 998 kB/s | 249 kB 00:00 2024-04-17T05:24:08.368 INFO:teuthology.orchestra.run.smithi164.stdout:(34/174): ceph-mgr-rook-19.0.0-3133.ga8c84f59.e 857 kB/s | 49 kB 00:00 2024-04-17T05:24:08.393 INFO:teuthology.orchestra.run.smithi164.stdout:(35/174): ceph-prometheus-alerts-19.0.0-3133.ga 334 kB/s | 16 kB 00:00 2024-04-17T05:24:08.444 INFO:teuthology.orchestra.run.smithi164.stdout:(36/174): ceph-volume-19.0.0-3133.ga8c84f59.el9 3.6 MB/s | 273 kB 00:00 2024-04-17T05:24:08.502 INFO:teuthology.orchestra.run.smithi164.stdout:(37/174): cephadm-19.0.0-3133.ga8c84f59.el9.noa 6.9 MB/s | 763 kB 00:00 2024-04-17T05:24:08.528 INFO:teuthology.orchestra.run.smithi164.stdout:(38/174): cephfs-top-19.0.0-3133.ga8c84f59.el9. 221 kB/s | 18 kB 00:00 2024-04-17T05:24:09.036 INFO:teuthology.orchestra.run.smithi164.stdout:(39/174): automake-1.16.2-8.el9.noarch.rpm 1.2 MB/s | 662 kB 00:00 2024-04-17T05:24:09.079 INFO:teuthology.orchestra.run.smithi164.stdout:(40/174): bison-3.7.4-5.el9.x86_64.rpm 1.6 MB/s | 920 kB 00:00 2024-04-17T05:24:09.103 INFO:teuthology.orchestra.run.smithi164.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 1.7 MB/s | 106 kB 00:00 2024-04-17T05:24:09.162 INFO:teuthology.orchestra.run.smithi164.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 307 kB 00:00 2024-04-17T05:24:09.187 INFO:teuthology.orchestra.run.smithi164.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 385 kB/s | 32 kB 00:00 2024-04-17T05:24:09.226 INFO:teuthology.orchestra.run.smithi123.stdout:(1/174): ceph-19.0.0-3133.ga8c84f59.el9.x86_64. 24 kB/s | 6.6 kB 00:00 2024-04-17T05:24:09.371 INFO:teuthology.orchestra.run.smithi164.stdout:(44/174): flexiblas-openblas-openmp-3.0.4-8.el9 94 kB/s | 17 kB 00:00 2024-04-17T05:24:09.468 INFO:teuthology.orchestra.run.smithi123.stdout:(2/174): ceph-fuse-19.0.0-3133.ga8c84f59.el9.x8 3.6 MB/s | 893 kB 00:00 2024-04-17T05:24:09.479 INFO:teuthology.orchestra.run.smithi164.stdout:(45/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 9.5 MB/s | 3.0 MB 00:00 2024-04-17T05:24:09.504 INFO:teuthology.orchestra.run.smithi164.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 80 kB/s | 10 kB 00:00 2024-04-17T05:24:09.518 INFO:teuthology.orchestra.run.smithi123.stdout:(3/174): ceph-immutable-object-cache-19.0.0-313 2.9 MB/s | 145 kB 00:00 2024-04-17T05:24:09.580 INFO:teuthology.orchestra.run.smithi164.stdout:(47/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 601 kB/s | 44 kB 00:00 2024-04-17T05:24:09.605 INFO:teuthology.orchestra.run.smithi164.stdout:(48/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 159 kB 00:00 2024-04-17T05:24:09.689 INFO:teuthology.orchestra.run.smithi164.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 6.1 MB/s | 661 kB 00:00 2024-04-17T05:24:09.748 INFO:teuthology.orchestra.run.smithi164.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 4.0 MB/s | 578 kB 00:00 2024-04-17T05:24:09.773 INFO:teuthology.orchestra.run.smithi164.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 601 kB/s | 46 kB 00:00 2024-04-17T05:24:09.807 INFO:teuthology.orchestra.run.smithi164.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2024-04-17T05:24:09.810 INFO:teuthology.orchestra.run.smithi123.stdout:(4/174): ceph-mds-19.0.0-3133.ga8c84f59.el9.x86 8.1 MB/s | 2.4 MB 00:00 2024-04-17T05:24:09.840 INFO:teuthology.orchestra.run.smithi164.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 2.9 MB/s | 187 kB 00:00 2024-04-17T05:24:09.873 INFO:teuthology.orchestra.run.smithi164.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.3 MB/s | 217 kB 00:00 2024-04-17T05:24:09.899 INFO:teuthology.orchestra.run.smithi164.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 611 kB/s | 34 kB 00:00 2024-04-17T05:24:09.961 INFO:teuthology.orchestra.run.smithi123.stdout:(5/174): ceph-mgr-19.0.0-3133.ga8c84f59.el9.x86 10 MB/s | 1.5 MB 00:00 2024-04-17T05:24:10.191 INFO:teuthology.orchestra.run.smithi164.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 15 MB/s | 4.7 MB 00:00 2024-04-17T05:24:10.250 INFO:teuthology.orchestra.run.smithi164.stdout:(57/174): postgresql-13.14-1.el9.x86_64.rpm 4.5 MB/s | 1.5 MB 00:00 2024-04-17T05:24:10.286 INFO:teuthology.orchestra.run.smithi123.stdout:(6/174): ceph-mon-19.0.0-3133.ga8c84f59.el9.x86 14 MB/s | 4.7 MB 00:00 2024-04-17T05:24:10.325 INFO:teuthology.orchestra.run.smithi164.stdout:(58/174): postgresql-contrib-13.14-1.el9.x86_64 6.5 MB/s | 817 kB 00:00 2024-04-17T05:24:10.350 INFO:teuthology.orchestra.run.smithi164.stdout:(59/174): postgresql-private-libs-13.14-1.el9.x 1.3 MB/s | 132 kB 00:00 2024-04-17T05:24:10.567 INFO:teuthology.orchestra.run.smithi164.stdout:(60/174): postgresql-server-13.14-1.el9.x86_64. 24 MB/s | 5.7 MB 00:00 2024-04-17T05:24:10.617 INFO:teuthology.orchestra.run.smithi164.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 3.9 MB/s | 1.0 MB 00:00 2024-04-17T05:24:10.643 INFO:teuthology.orchestra.run.smithi164.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.2 MB/s | 78 kB 00:00 2024-04-17T05:24:10.901 INFO:teuthology.orchestra.run.smithi164.stdout:(63/174): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 5.8 MB 00:00 2024-04-17T05:24:10.927 INFO:teuthology.orchestra.run.smithi164.stdout:(64/174): python3-jsonpatch-1.21-16.el9.noarch. 88 kB/s | 24 kB 00:00 2024-04-17T05:24:10.977 INFO:teuthology.orchestra.run.smithi164.stdout:(65/174): python3-jsonpointer-2.0-4.el9.noarch. 372 kB/s | 18 kB 00:00 2024-04-17T05:24:11.002 INFO:teuthology.orchestra.run.smithi164.stdout:(66/174): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 144 kB 00:00 2024-04-17T05:24:11.027 INFO:teuthology.orchestra.run.smithi164.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 658 kB/s | 32 kB 00:00 2024-04-17T05:24:11.170 INFO:teuthology.orchestra.run.smithi123.stdout:(7/174): ceph-osd-19.0.0-3133.ga8c84f59.el9.x86 19 MB/s | 17 MB 00:00 2024-04-17T05:24:11.278 INFO:teuthology.orchestra.run.smithi164.stdout:(68/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 17 MB/s | 4.8 MB 00:00 2024-04-17T05:24:11.320 INFO:teuthology.orchestra.run.smithi164.stdout:(69/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 751 kB/s | 217 kB 00:00 2024-04-17T05:24:11.353 INFO:teuthology.orchestra.run.smithi164.stdout:(70/174): python3-oauthlib-3.1.1-5.el9.noarch.r 2.3 MB/s | 174 kB 00:00 2024-04-17T05:24:11.378 INFO:teuthology.orchestra.run.smithi164.stdout:(71/174): python3-packaging-20.9-5.el9.noarch.r 1.2 MB/s | 69 kB 00:00 2024-04-17T05:24:11.404 INFO:teuthology.orchestra.run.smithi164.stdout:(72/174): python3-prettytable-0.7.2-27.el9.noar 846 kB/s | 41 kB 00:00 2024-04-17T05:24:11.454 INFO:teuthology.orchestra.run.smithi164.stdout:(73/174): python3-protobuf-3.14.0-13.el9.noarch 3.1 MB/s | 238 kB 00:00 2024-04-17T05:24:11.480 INFO:teuthology.orchestra.run.smithi164.stdout:(74/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.8 MB/s | 132 kB 00:00 2024-04-17T05:24:11.513 INFO:teuthology.orchestra.run.smithi164.stdout:(75/174): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 211 kB 00:00 2024-04-17T05:24:11.538 INFO:teuthology.orchestra.run.smithi164.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 848 kB/s | 47 kB 00:00 2024-04-17T05:24:11.564 INFO:teuthology.orchestra.run.smithi164.stdout:(77/174): python3-requests-oauthlib-1.3.0-12.el 876 kB/s | 43 kB 00:00 2024-04-17T05:24:11.745 INFO:teuthology.orchestra.run.smithi123.stdout:(8/174): ceph-radosgw-19.0.0-3133.ga8c84f59.el9 18 MB/s | 11 MB 00:00 2024-04-17T05:24:11.772 INFO:teuthology.orchestra.run.smithi164.stdout:(78/174): python3-toml-0.10.2-6.el9.noarch.rpm 198 kB/s | 39 kB 00:00 2024-04-17T05:24:11.787 INFO:teuthology.orchestra.run.smithi123.stdout:(9/174): ceph-selinux-19.0.0-3133.ga8c84f59.el9 621 kB/s | 25 kB 00:00 2024-04-17T05:24:12.022 INFO:teuthology.orchestra.run.smithi164.stdout:(79/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-04-17T05:24:12.048 INFO:teuthology.orchestra.run.smithi164.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 153 kB/s | 41 kB 00:00 2024-04-17T05:24:12.081 INFO:teuthology.orchestra.run.smithi164.stdout:(81/174): qatlib-service-24.02.0-1.el9.x86_64.r 1.1 MB/s | 35 kB 00:00 2024-04-17T05:24:12.115 INFO:teuthology.orchestra.run.smithi164.stdout:(82/174): qatlib-24.02.0-1.el9.x86_64.rpm 3.3 MB/s | 220 kB 00:00 2024-04-17T05:24:12.141 INFO:teuthology.orchestra.run.smithi164.stdout:(83/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 828 kB/s | 46 kB 00:00 2024-04-17T05:24:12.174 INFO:teuthology.orchestra.run.smithi164.stdout:(84/174): socat-1.7.4.1-5.el9.x86_64.rpm 5.1 MB/s | 300 kB 00:00 2024-04-17T05:24:12.199 INFO:teuthology.orchestra.run.smithi164.stdout:(85/174): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 56 kB 00:00 2024-04-17T05:24:12.225 INFO:teuthology.orchestra.run.smithi164.stdout:(86/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 63 kB 00:00 2024-04-17T05:24:12.250 INFO:teuthology.orchestra.run.smithi164.stdout:(87/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 903 kB/s | 44 kB 00:00 2024-04-17T05:24:12.275 INFO:teuthology.orchestra.run.smithi164.stdout:(88/174): fuse-2.9.9-15.el9.x86_64.rpm 1.6 MB/s | 79 kB 00:00 2024-04-17T05:24:12.309 INFO:teuthology.orchestra.run.smithi164.stdout:(89/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.1 MB/s | 241 kB 00:00 2024-04-17T05:24:12.368 INFO:teuthology.orchestra.run.smithi164.stdout:(90/174): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.1 MB 00:00 2024-04-17T05:24:12.393 INFO:teuthology.orchestra.run.smithi164.stdout:(91/174): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 103 kB 00:00 2024-04-17T05:24:12.418 INFO:teuthology.orchestra.run.smithi164.stdout:(92/174): python3-pycparser-2.20-6.el9.noarch.r 2.5 MB/s | 124 kB 00:00 2024-04-17T05:24:12.452 INFO:teuthology.orchestra.run.smithi164.stdout:(93/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2024-04-17T05:24:12.610 INFO:teuthology.orchestra.run.smithi164.stdout:(94/174): jq-1.6-16.el9.x86_64.rpm 989 kB/s | 187 kB 00:00 2024-04-17T05:24:12.669 INFO:teuthology.orchestra.run.smithi164.stdout:(95/174): libquadmath-11.4.1-3.el9.x86_64.rpm 3.3 MB/s | 195 kB 00:00 2024-04-17T05:24:12.711 INFO:teuthology.orchestra.run.smithi164.stdout:(96/174): libgfortran-11.4.1-3.el9.x86_64.rpm 3.0 MB/s | 803 kB 00:00 2024-04-17T05:24:12.747 INFO:teuthology.orchestra.run.smithi164.stdout:(97/174): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-04-17T05:24:13.339 INFO:teuthology.orchestra.run.smithi164.stdout:(98/174): elfutils-libelf-devel-0.190-2.el9.x86 34 kB/s | 21 kB 00:00 2024-04-17T05:24:13.408 INFO:teuthology.orchestra.run.smithi164.stdout:(99/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 39 kB/s | 25 kB 00:00 2024-04-17T05:24:14.187 INFO:teuthology.orchestra.run.smithi123.stdout:(10/174): ceph-test-19.0.0-3133.ga8c84f59.el9.x 20 MB/s | 49 MB 00:02 2024-04-17T05:24:14.245 INFO:teuthology.orchestra.run.smithi123.stdout:(11/174): cephfs-mirror-19.0.0-3133.ga8c84f59.e 3.9 MB/s | 225 kB 00:00 2024-04-17T05:24:14.287 INFO:teuthology.orchestra.run.smithi123.stdout:(12/174): cephfs-shell-19.0.0-3133.ga8c84f59.el 663 kB/s | 27 kB 00:00 2024-04-17T05:24:14.390 INFO:teuthology.orchestra.run.smithi164.stdout:(100/174): python3-devel-3.9.17-2.el9.x86_64.rp 250 kB/s | 245 kB 00:00 2024-04-17T05:24:14.396 INFO:teuthology.orchestra.run.smithi123.stdout:(13/174): ceph-base-19.0.0-3133.ga8c84f59.el9.x 1.0 MB/s | 5.4 MB 00:05 2024-04-17T05:24:14.413 INFO:teuthology.orchestra.run.smithi123.stdout:(14/174): libcephfs-devel-19.0.0-3133.ga8c84f59 255 kB/s | 32 kB 00:00 2024-04-17T05:24:14.463 INFO:teuthology.orchestra.run.smithi123.stdout:(15/174): libcephsqlite-19.0.0-3133.ga8c84f59.e 3.2 MB/s | 163 kB 00:00 2024-04-17T05:24:14.513 INFO:teuthology.orchestra.run.smithi123.stdout:(16/174): librados-devel-19.0.0-3133.ga8c84f59. 2.5 MB/s | 126 kB 00:00 2024-04-17T05:24:14.580 INFO:teuthology.orchestra.run.smithi123.stdout:(17/174): libradosstriper1-19.0.0-3133.ga8c84f5 7.4 MB/s | 501 kB 00:00 2024-04-17T05:24:14.906 INFO:teuthology.orchestra.run.smithi123.stdout:(18/174): librgw2-19.0.0-3133.ga8c84f59.el9.x86 17 MB/s | 5.4 MB 00:00 2024-04-17T05:24:14.956 INFO:teuthology.orchestra.run.smithi123.stdout:(19/174): python3-ceph-argparse-19.0.0-3133.ga8 920 kB/s | 45 kB 00:00 2024-04-17T05:24:14.989 INFO:teuthology.orchestra.run.smithi123.stdout:(20/174): libcephfs2-19.0.0-3133.ga8c84f59.el9. 1.2 MB/s | 748 kB 00:00 2024-04-17T05:24:15.023 INFO:teuthology.orchestra.run.smithi123.stdout:(21/174): python3-ceph-common-19.0.0-3133.ga8c8 2.0 MB/s | 135 kB 00:00 2024-04-17T05:24:15.082 INFO:teuthology.orchestra.run.smithi123.stdout:(22/174): python3-rados-19.0.0-3133.ga8c84f59.e 5.4 MB/s | 321 kB 00:00 2024-04-17T05:24:15.115 INFO:teuthology.orchestra.run.smithi123.stdout:(23/174): python3-cephfs-19.0.0-3133.ga8c84f59. 1.3 MB/s | 162 kB 00:00 2024-04-17T05:24:15.149 INFO:teuthology.orchestra.run.smithi123.stdout:(24/174): python3-rbd-19.0.0-3133.ga8c84f59.el9 4.4 MB/s | 299 kB 00:00 2024-04-17T05:24:15.191 INFO:teuthology.orchestra.run.smithi123.stdout:(25/174): rbd-fuse-19.0.0-3133.ga8c84f59.el9.x8 2.0 MB/s | 85 kB 00:00 2024-04-17T05:24:15.208 INFO:teuthology.orchestra.run.smithi123.stdout:(26/174): python3-rgw-19.0.0-3133.ga8c84f59.el9 1.1 MB/s | 99 kB 00:00 2024-04-17T05:24:15.398 INFO:teuthology.orchestra.run.smithi164.stdout:(101/174): python3-jinja2-2.11.3-5.el9.noarch.r 246 kB/s | 248 kB 00:01 2024-04-17T05:24:15.399 INFO:teuthology.orchestra.run.smithi123.stdout:(27/174): rbd-mirror-19.0.0-3133.ga8c84f59.el9. 15 MB/s | 3.1 MB 00:00 2024-04-17T05:24:15.489 INFO:teuthology.orchestra.run.smithi123.stdout:(28/174): rbd-nbd-19.0.0-3133.ga8c84f59.el9.x86 607 kB/s | 170 kB 00:00 2024-04-17T05:24:15.517 INFO:teuthology.orchestra.run.smithi123.stdout:(29/174): ceph-grafana-dashboards-19.0.0-3133.g 294 kB/s | 34 kB 00:00 2024-04-17T05:24:15.642 INFO:teuthology.orchestra.run.smithi123.stdout:(30/174): ceph-mgr-cephadm-19.0.0-3133.ga8c84f5 939 kB/s | 142 kB 00:00 2024-04-17T05:24:15.734 INFO:teuthology.orchestra.run.smithi123.stdout:(31/174): ceph-mgr-dashboard-19.0.0-3133.ga8c84 16 MB/s | 3.5 MB 00:00 2024-04-17T05:24:15.784 INFO:teuthology.orchestra.run.smithi123.stdout:(32/174): ceph-mgr-modules-core-19.0.0-3133.ga8 4.9 MB/s | 249 kB 00:00 2024-04-17T05:24:15.835 INFO:teuthology.orchestra.run.smithi123.stdout:(33/174): ceph-mgr-rook-19.0.0-3133.ga8c84f59.e 995 kB/s | 49 kB 00:00 2024-04-17T05:24:15.876 INFO:teuthology.orchestra.run.smithi123.stdout:(34/174): ceph-prometheus-alerts-19.0.0-3133.ga 404 kB/s | 16 kB 00:00 2024-04-17T05:24:15.935 INFO:teuthology.orchestra.run.smithi123.stdout:(35/174): ceph-volume-19.0.0-3133.ga8c84f59.el9 4.7 MB/s | 273 kB 00:00 2024-04-17T05:24:16.010 INFO:teuthology.orchestra.run.smithi123.stdout:(36/174): cephadm-19.0.0-3133.ga8c84f59.el9.noa 10 MB/s | 763 kB 00:00 2024-04-17T05:24:16.053 INFO:teuthology.orchestra.run.smithi123.stdout:(37/174): cephfs-top-19.0.0-3133.ga8c84f59.el9. 444 kB/s | 18 kB 00:00 2024-04-17T05:24:16.190 INFO:teuthology.orchestra.run.smithi164.stdout:(102/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 119 kB/s | 94 kB 00:00 2024-04-17T05:24:16.245 INFO:teuthology.orchestra.run.smithi123.stdout:(38/174): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 662 kB 00:00 2024-04-17T05:24:16.275 INFO:teuthology.orchestra.run.smithi164.stdout:(103/174): lua-devel-5.4.4-4.el9.x86_64.rpm 273 kB/s | 22 kB 00:00 2024-04-17T05:24:16.303 INFO:teuthology.orchestra.run.smithi123.stdout:(39/174): bison-3.7.4-5.el9.x86_64.rpm 16 MB/s | 920 kB 00:00 2024-04-17T05:24:16.337 INFO:teuthology.orchestra.run.smithi123.stdout:(40/174): boost-program-options-1.75.0-8.el9.x8 3.2 MB/s | 106 kB 00:00 2024-04-17T05:24:16.370 INFO:teuthology.orchestra.run.smithi123.stdout:(41/174): flex-2.6.4-9.el9.x86_64.rpm 9.1 MB/s | 307 kB 00:00 2024-04-17T05:24:16.396 INFO:teuthology.orchestra.run.smithi123.stdout:(42/174): flexiblas-3.0.4-8.el9.x86_64.rpm 1.3 MB/s | 32 kB 00:00 2024-04-17T05:24:16.474 INFO:teuthology.orchestra.run.smithi164.stdout:(104/174): protobuf-compiler-3.14.0-13.el9.x86_ 4.2 MB/s | 863 kB 00:00 2024-04-17T05:24:16.521 INFO:teuthology.orchestra.run.smithi123.stdout:(43/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-04-17T05:24:16.546 INFO:teuthology.orchestra.run.smithi123.stdout:(44/174): flexiblas-openblas-openmp-3.0.4-8.el9 713 kB/s | 17 kB 00:00 2024-04-17T05:24:16.601 INFO:teuthology.orchestra.run.smithi123.stdout:(45/174): libaio-devel-0.3.111-13.el9.x86_64.rp 186 kB/s | 10 kB 00:00 2024-04-17T05:24:16.647 INFO:teuthology.orchestra.run.smithi123.stdout:(46/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.5 MB/s | 159 kB 00:00 2024-04-17T05:24:16.672 INFO:teuthology.orchestra.run.smithi123.stdout:(47/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.8 MB/s | 44 kB 00:00 2024-04-17T05:24:16.722 INFO:teuthology.orchestra.run.smithi123.stdout:(48/174): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2024-04-17T05:24:16.773 INFO:teuthology.orchestra.run.smithi123.stdout:(49/174): libtool-2.4.6-45.el9.x86_64.rpm 11 MB/s | 578 kB 00:00 2024-04-17T05:24:16.774 INFO:teuthology.orchestra.run.smithi164.stdout:(105/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.8 MB/s | 548 kB 00:00 2024-04-17T05:24:16.806 INFO:teuthology.orchestra.run.smithi123.stdout:(50/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2024-04-17T05:24:16.848 INFO:teuthology.orchestra.run.smithi123.stdout:(51/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.7 MB/s | 282 kB 00:00 2024-04-17T05:24:16.890 INFO:teuthology.orchestra.run.smithi123.stdout:(52/174): lua-5.4.4-4.el9.x86_64.rpm 4.5 MB/s | 187 kB 00:00 2024-04-17T05:24:16.891 INFO:teuthology.orchestra.run.smithi164.stdout:(106/174): gperftools-libs-2.9.1-2.el9.x86_64.r 2.6 MB/s | 309 kB 00:00 2024-04-17T05:24:16.932 INFO:teuthology.orchestra.run.smithi123.stdout:(53/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.2 MB/s | 217 kB 00:00 2024-04-17T05:24:16.950 INFO:teuthology.orchestra.run.smithi164.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 339 kB/s | 19 kB 00:00 2024-04-17T05:24:16.974 INFO:teuthology.orchestra.run.smithi123.stdout:(54/174): openblas-0.3.21-2.el9.x86_64.rpm 839 kB/s | 34 kB 00:00 2024-04-17T05:24:17.125 INFO:teuthology.orchestra.run.smithi123.stdout:(55/174): openblas-openmp-0.3.21-2.el9.x86_64.r 32 MB/s | 4.7 MB 00:00 2024-04-17T05:24:17.208 INFO:teuthology.orchestra.run.smithi123.stdout:(56/174): postgresql-13.14-1.el9.x86_64.rpm 19 MB/s | 1.5 MB 00:00 2024-04-17T05:24:17.242 INFO:teuthology.orchestra.run.smithi164.stdout:(108/174): libarrow-9.0.0-10.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-04-17T05:24:17.267 INFO:teuthology.orchestra.run.smithi123.stdout:(57/174): postgresql-contrib-13.14-1.el9.x86_64 14 MB/s | 817 kB 00:00 2024-04-17T05:24:17.302 INFO:teuthology.orchestra.run.smithi164.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 452 kB/s | 26 kB 00:00 2024-04-17T05:24:17.309 INFO:teuthology.orchestra.run.smithi123.stdout:(58/174): postgresql-private-libs-13.14-1.el9.x 3.1 MB/s | 132 kB 00:00 2024-04-17T05:24:17.401 INFO:teuthology.orchestra.run.smithi164.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 492 kB/s | 49 kB 00:00 2024-04-17T05:24:17.460 INFO:teuthology.orchestra.run.smithi164.stdout:(111/174): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-04-17T05:24:17.467 INFO:teuthology.orchestra.run.smithi123.stdout:(59/174): postgresql-server-13.14-1.el9.x86_64. 36 MB/s | 5.7 MB 00:00 2024-04-17T05:24:17.519 INFO:teuthology.orchestra.run.smithi164.stdout:(112/174): luarocks-3.9.2-1.el9.noarch.rpm 2.6 MB/s | 151 kB 00:00 2024-04-17T05:24:17.526 INFO:teuthology.orchestra.run.smithi123.stdout:(60/174): protobuf-3.14.0-13.el9.x86_64.rpm 18 MB/s | 1.0 MB 00:00 2024-04-17T05:24:17.568 INFO:teuthology.orchestra.run.smithi123.stdout:(61/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.9 MB/s | 78 kB 00:00 2024-04-17T05:24:17.619 INFO:teuthology.orchestra.run.smithi164.stdout:(113/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 8.3 MB/s | 838 kB 00:00 2024-04-17T05:24:17.735 INFO:teuthology.orchestra.run.smithi123.stdout:(62/174): python3-babel-2.9.1-2.el9.noarch.rpm 35 MB/s | 5.8 MB 00:00 2024-04-17T05:24:17.744 INFO:teuthology.orchestra.run.smithi164.stdout:(114/174): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-04-17T05:24:17.769 INFO:teuthology.orchestra.run.smithi123.stdout:(63/174): python3-jsonpatch-1.21-16.el9.noarch. 760 kB/s | 24 kB 00:00 2024-04-17T05:24:17.802 INFO:teuthology.orchestra.run.smithi123.stdout:(64/174): python3-jsonpointer-2.0-4.el9.noarch. 555 kB/s | 18 kB 00:00 2024-04-17T05:24:17.811 INFO:teuthology.orchestra.run.smithi164.stdout:(115/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 661 kB/s | 43 kB 00:00 2024-04-17T05:24:17.853 INFO:teuthology.orchestra.run.smithi123.stdout:(65/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-04-17T05:24:17.870 INFO:teuthology.orchestra.run.smithi164.stdout:(116/174): python3-cachetools-4.2.4-1.el9.noarc 560 kB/s | 32 kB 00:00 2024-04-17T05:24:17.886 INFO:teuthology.orchestra.run.smithi123.stdout:(66/174): python3-markupsafe-1.1.1-12.el9.x86_6 971 kB/s | 32 kB 00:00 2024-04-17T05:24:17.937 INFO:teuthology.orchestra.run.smithi164.stdout:(117/174): python3-certifi-2021.10.8-2.el9.noar 227 kB/s | 15 kB 00:00 2024-04-17T05:24:18.020 INFO:teuthology.orchestra.run.smithi123.stdout:(67/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 4.8 MB 00:00 2024-04-17T05:24:18.062 INFO:teuthology.orchestra.run.smithi123.stdout:(68/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.2 MB/s | 217 kB 00:00 2024-04-17T05:24:18.104 INFO:teuthology.orchestra.run.smithi123.stdout:(69/174): python3-oauthlib-3.1.1-5.el9.noarch.r 4.2 MB/s | 174 kB 00:00 2024-04-17T05:24:18.138 INFO:teuthology.orchestra.run.smithi123.stdout:(70/174): python3-packaging-20.9-5.el9.noarch.r 2.1 MB/s | 69 kB 00:00 2024-04-17T05:24:18.163 INFO:teuthology.orchestra.run.smithi123.stdout:(71/174): python3-prettytable-0.7.2-27.el9.noar 1.6 MB/s | 41 kB 00:00 2024-04-17T05:24:18.205 INFO:teuthology.orchestra.run.smithi123.stdout:(72/174): python3-protobuf-3.14.0-13.el9.noarch 5.7 MB/s | 238 kB 00:00 2024-04-17T05:24:18.247 INFO:teuthology.orchestra.run.smithi123.stdout:(73/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 132 kB 00:00 2024-04-17T05:24:18.289 INFO:teuthology.orchestra.run.smithi123.stdout:(74/174): python3-pyasn1-modules-0.4.8-6.el9.no 5.1 MB/s | 211 kB 00:00 2024-04-17T05:24:18.314 INFO:teuthology.orchestra.run.smithi123.stdout:(75/174): python3-pytz-2021.1-5.el9.noarch.rpm 1.9 MB/s | 47 kB 00:00 2024-04-17T05:24:18.339 INFO:teuthology.orchestra.run.smithi123.stdout:(76/174): python3-requests-oauthlib-1.3.0-12.el 1.7 MB/s | 43 kB 00:00 2024-04-17T05:24:18.487 INFO:teuthology.orchestra.run.smithi164.stdout:(118/174): ceph-test-19.0.0-3133.ga8c84f59.el9. 3.4 MB/s | 49 MB 00:14 2024-04-17T05:24:18.520 INFO:teuthology.orchestra.run.smithi164.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 295 kB/s | 172 kB 00:00 2024-04-17T05:24:18.604 INFO:teuthology.orchestra.run.smithi164.stdout:(120/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.6 MB/s | 303 kB 00:00 2024-04-17T05:24:18.654 INFO:teuthology.orchestra.run.smithi164.stdout:(121/174): python3-colorama-0.4.4-12.el9.noarch 718 kB/s | 35 kB 00:00 2024-04-17T05:24:18.721 INFO:teuthology.orchestra.run.smithi164.stdout:(122/174): python3-google-auth-2.28.2-1.el9.noa 3.0 MB/s | 203 kB 00:00 2024-04-17T05:24:18.742 INFO:teuthology.orchestra.run.smithi123.stdout:(77/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 39 MB/s | 16 MB 00:00 2024-04-17T05:24:18.773 INFO:teuthology.orchestra.run.smithi123.stdout:(78/174): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 39 kB 00:00 2024-04-17T05:24:18.788 INFO:teuthology.orchestra.run.smithi164.stdout:(123/174): python3-cherrypy-18.6.1-2.el9.noarch 1.2 MB/s | 358 kB 00:00 2024-04-17T05:24:18.815 INFO:teuthology.orchestra.run.smithi123.stdout:(79/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 41 kB 00:00 2024-04-17T05:24:18.857 INFO:teuthology.orchestra.run.smithi123.stdout:(80/174): qatlib-24.02.0-1.el9.x86_64.rpm 5.2 MB/s | 220 kB 00:00 2024-04-17T05:24:18.880 INFO:teuthology.orchestra.run.smithi164.stdout:(124/174): python3-grpcio-1.46.7-10.el9.x86_64. 13 MB/s | 2.0 MB 00:00 2024-04-17T05:24:18.882 INFO:teuthology.orchestra.run.smithi123.stdout:(81/174): qatlib-service-24.02.0-1.el9.x86_64.r 1.4 MB/s | 35 kB 00:00 2024-04-17T05:24:18.908 INFO:teuthology.orchestra.run.smithi123.stdout:(82/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.9 MB/s | 46 kB 00:00 2024-04-17T05:24:18.914 INFO:teuthology.orchestra.run.smithi164.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-04-17T05:24:18.939 INFO:teuthology.orchestra.run.smithi164.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 186 kB/s | 11 kB 00:00 2024-04-17T05:24:18.949 INFO:teuthology.orchestra.run.smithi123.stdout:(83/174): socat-1.7.4.1-5.el9.x86_64.rpm 7.2 MB/s | 300 kB 00:00 2024-04-17T05:24:18.983 INFO:teuthology.orchestra.run.smithi123.stdout:(84/174): uuid-1.6.2-55.el9.x86_64.rpm 1.7 MB/s | 56 kB 00:00 2024-04-17T05:24:18.995 INFO:teuthology.orchestra.run.smithi164.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 219 kB/s | 18 kB 00:00 2024-04-17T05:24:19.008 INFO:teuthology.orchestra.run.smithi123.stdout:(85/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.5 MB/s | 63 kB 00:00 2024-04-17T05:24:19.023 INFO:teuthology.orchestra.run.smithi164.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 279 kB/s | 23 kB 00:00 2024-04-17T05:24:19.034 INFO:teuthology.orchestra.run.smithi123.stdout:(86/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.8 MB/s | 44 kB 00:00 2024-04-17T05:24:19.057 INFO:teuthology.orchestra.run.smithi164.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 324 kB/s | 19 kB 00:00 2024-04-17T05:24:19.076 INFO:teuthology.orchestra.run.smithi123.stdout:(87/174): fuse-2.9.9-15.el9.x86_64.rpm 1.9 MB/s | 79 kB 00:00 2024-04-17T05:24:19.082 INFO:teuthology.orchestra.run.smithi164.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 340 kB/s | 20 kB 00:00 2024-04-17T05:24:19.141 INFO:teuthology.orchestra.run.smithi164.stdout:(131/174): python3-logutils-0.3.5-21.el9.noarch 804 kB/s | 46 kB 00:00 2024-04-17T05:24:19.182 INFO:teuthology.orchestra.run.smithi164.stdout:(132/174): python3-kubernetes-26.1.0-2.el9.noar 8.2 MB/s | 1.0 MB 00:00 2024-04-17T05:24:19.208 INFO:teuthology.orchestra.run.smithi164.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-04-17T05:24:19.217 INFO:teuthology.orchestra.run.smithi123.stdout:(88/174): ceph-mgr-diskprediction-local-19.0.0- 2.1 MB/s | 7.4 MB 00:03 2024-04-17T05:24:19.241 INFO:teuthology.orchestra.run.smithi164.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 999 kB/s | 58 kB 00:00 2024-04-17T05:24:19.251 INFO:teuthology.orchestra.run.smithi123.stdout:(89/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 241 kB 00:00 2024-04-17T05:24:19.283 INFO:teuthology.orchestra.run.smithi164.stdout:(135/174): python3-pecan-1.4.2-3.el9.noarch.rpm 3.6 MB/s | 272 kB 00:00 2024-04-17T05:24:19.308 INFO:teuthology.orchestra.run.smithi164.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 249 kB/s | 16 kB 00:00 2024-04-17T05:24:19.309 INFO:teuthology.orchestra.run.smithi123.stdout:(90/174): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.1 MB 00:00 2024-04-17T05:24:19.335 INFO:teuthology.orchestra.run.smithi123.stdout:(91/174): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 103 kB 00:00 2024-04-17T05:24:19.350 INFO:teuthology.orchestra.run.smithi164.stdout:(137/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-04-17T05:24:19.360 INFO:teuthology.orchestra.run.smithi123.stdout:(92/174): python3-pycparser-2.20-6.el9.noarch.r 2.5 MB/s | 124 kB 00:00 2024-04-17T05:24:19.368 INFO:teuthology.orchestra.run.smithi164.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 486 kB/s | 28 kB 00:00 2024-04-17T05:24:19.394 INFO:teuthology.orchestra.run.smithi123.stdout:(93/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2024-04-17T05:24:19.401 INFO:teuthology.orchestra.run.smithi164.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 620 kB/s | 31 kB 00:00 2024-04-17T05:24:19.435 INFO:teuthology.orchestra.run.smithi164.stdout:(140/174): python3-routes-2.5.1-5.el9.noarch.rp 2.8 MB/s | 188 kB 00:00 2024-04-17T05:24:19.452 INFO:teuthology.orchestra.run.smithi164.stdout:(141/174): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-04-17T05:24:19.581 INFO:teuthology.orchestra.run.smithi164.stdout:(142/174): openssl-devel-3.0.7-27.el9.x86_64.rp 678 kB/s | 4.1 MB 00:06 2024-04-17T05:24:19.611 INFO:teuthology.orchestra.run.smithi164.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 204 kB/s | 36 kB 00:00 2024-04-17T05:24:19.636 INFO:teuthology.orchestra.run.smithi164.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 278 kB/s | 51 kB 00:00 2024-04-17T05:24:19.678 INFO:teuthology.orchestra.run.smithi164.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-04-17T05:24:19.729 INFO:teuthology.orchestra.run.smithi164.stdout:(146/174): python3-werkzeug-2.0.3-3.el9.1.noarc 4.6 MB/s | 427 kB 00:00 2024-04-17T05:24:19.754 INFO:teuthology.orchestra.run.smithi164.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 269 kB/s | 20 kB 00:00 2024-04-17T05:24:19.796 INFO:teuthology.orchestra.run.smithi164.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2024-04-17T05:24:19.846 INFO:teuthology.orchestra.run.smithi164.stdout:(149/174): python3-webob-1.8.7-6.el9.noarch.rpm 872 kB/s | 230 kB 00:00 2024-04-17T05:24:19.913 INFO:teuthology.orchestra.run.smithi164.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-04-17T05:24:20.014 INFO:teuthology.orchestra.run.smithi164.stdout:(151/174): NetworkManager-1.47.4-1.el9.x86_64.r 23 MB/s | 2.3 MB 00:00 2024-04-17T05:24:20.019 INFO:teuthology.orchestra.run.smithi123.stdout:(94/174): jq-1.6-16.el9.x86_64.rpm 285 kB/s | 187 kB 00:00 2024-04-17T05:24:20.097 INFO:teuthology.orchestra.run.smithi164.stdout:(152/174): NetworkManager-libnm-1.47.4-1.el9.x8 22 MB/s | 1.8 MB 00:00 2024-04-17T05:24:20.159 INFO:teuthology.orchestra.run.smithi164.stdout:(153/174): NetworkManager-team-1.47.4-1.el9.x86 669 kB/s | 41 kB 00:00 2024-04-17T05:24:20.170 INFO:teuthology.orchestra.run.smithi123.stdout:(95/174): libgfortran-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 803 kB 00:00 2024-04-17T05:24:20.206 INFO:teuthology.orchestra.run.smithi164.stdout:(154/174): NetworkManager-tui-1.47.4-1.el9.x86_ 5.3 MB/s | 248 kB 00:00 2024-04-17T05:24:20.220 INFO:teuthology.orchestra.run.smithi123.stdout:(96/174): libquadmath-11.4.1-3.el9.x86_64.rpm 978 kB/s | 195 kB 00:00 2024-04-17T05:24:20.248 INFO:teuthology.orchestra.run.smithi164.stdout:(155/174): xfsdump-3.1.12-4.el9.x86_64.rpm 7.7 MB/s | 321 kB 00:00 2024-04-17T05:24:20.287 INFO:teuthology.orchestra.run.smithi123.stdout:(97/174): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-04-17T05:24:20.331 INFO:teuthology.orchestra.run.smithi164.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 866 kB/s | 71 kB 00:00 2024-04-17T05:24:20.475 INFO:teuthology.orchestra.run.smithi164.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 256 kB/s | 36 kB 00:00 2024-04-17T05:24:20.549 INFO:teuthology.orchestra.run.smithi164.stdout:(158/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.6 MB/s | 192 kB 00:00 2024-04-17T05:24:20.632 INFO:teuthology.orchestra.run.smithi164.stdout:(159/174): librados2-19.0.0-3133.ga8c84f59.el9. 4.1 MB/s | 3.4 MB 00:00 2024-04-17T05:24:20.666 INFO:teuthology.orchestra.run.smithi164.stdout:(160/174): elfutils-libs-0.190-2.el9.x86_64.rpm 2.2 MB/s | 256 kB 00:00 2024-04-17T05:24:20.749 INFO:teuthology.orchestra.run.smithi164.stdout:(161/174): libacl-2.3.1-4.el9.x86_64.rpm 198 kB/s | 23 kB 00:00 2024-04-17T05:24:20.783 INFO:teuthology.orchestra.run.smithi164.stdout:(162/174): libblkid-2.37.4-18.el9.x86_64.rpm 935 kB/s | 108 kB 00:00 2024-04-17T05:24:20.829 INFO:teuthology.orchestra.run.smithi123.stdout:(98/174): ceph-common-19.0.0-3133.ga8c84f59.el9 1.8 MB/s | 21 MB 00:11 2024-04-17T05:24:20.850 INFO:teuthology.orchestra.run.smithi164.stdout:(163/174): libfdisk-2.37.4-18.el9.x86_64.rpm 1.5 MB/s | 155 kB 00:00 2024-04-17T05:24:20.884 INFO:teuthology.orchestra.run.smithi164.stdout:(164/174): libmount-2.37.4-18.el9.x86_64.rpm 1.3 MB/s | 136 kB 00:00 2024-04-17T05:24:20.909 INFO:teuthology.orchestra.run.smithi164.stdout:(165/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.1 MB/s | 64 kB 00:00 2024-04-17T05:24:20.951 INFO:teuthology.orchestra.run.smithi164.stdout:(166/174): libuuid-2.37.4-18.el9.x86_64.rpm 435 kB/s | 29 kB 00:00 2024-04-17T05:24:21.026 INFO:teuthology.orchestra.run.smithi164.stdout:(167/174): openssl-3.0.7-27.el9.x86_64.rpm 10 MB/s | 1.2 MB 00:00 2024-04-17T05:24:21.135 INFO:teuthology.orchestra.run.smithi164.stdout:(168/174): librbd1-19.0.0-3133.ga8c84f59.el9.x8 2.4 MB/s | 3.1 MB 00:01 2024-04-17T05:24:21.154 INFO:teuthology.orchestra.run.smithi123.stdout:(99/174): elfutils-libelf-devel-0.190-2.el9.x86 23 kB/s | 21 kB 00:00 2024-04-17T05:24:21.179 INFO:teuthology.orchestra.run.smithi123.stdout:(100/174): libuuid-devel-2.37.4-18.el9.x86_64.r 29 kB/s | 25 kB 00:00 2024-04-17T05:24:21.311 INFO:teuthology.orchestra.run.smithi164.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 2.6 MB/s | 465 kB 00:00 2024-04-17T05:24:21.402 INFO:teuthology.orchestra.run.smithi164.stdout:(170/174): util-linux-user-2.37.4-18.el9.x86_64 342 kB/s | 31 kB 00:00 2024-04-17T05:24:21.502 INFO:teuthology.orchestra.run.smithi164.stdout:(171/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 11 MB/s | 1.1 MB 00:00 2024-04-17T05:24:21.845 INFO:teuthology.orchestra.run.smithi164.stdout:(172/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 2.4 MB/s | 2.2 MB 00:00 2024-04-17T05:24:21.903 INFO:teuthology.orchestra.run.smithi164.stdout:(173/174): util-linux-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 2.3 MB 00:00 2024-04-17T05:24:22.121 INFO:teuthology.orchestra.run.smithi123.stdout:(101/174): python3-jinja2-2.11.3-5.el9.noarch.r 264 kB/s | 248 kB 00:00 2024-04-17T05:24:22.238 INFO:teuthology.orchestra.run.smithi123.stdout:(102/174): python3-devel-3.9.17-2.el9.x86_64.rp 232 kB/s | 245 kB 00:01 2024-04-17T05:24:22.295 INFO:teuthology.orchestra.run.smithi164.stdout:(174/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 94 kB/s | 74 kB 00:00 2024-04-17T05:24:22.303 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-04-17T05:24:22.304 INFO:teuthology.orchestra.run.smithi164.stdout:Total 10 MB/s | 229 MB 00:22 2024-04-17T05:24:22.313 INFO:teuthology.orchestra.run.smithi123.stdout:(103/174): lua-devel-5.4.4-4.el9.x86_64.rpm 303 kB/s | 22 kB 00:00 2024-04-17T05:24:22.530 INFO:teuthology.orchestra.run.smithi123.stdout:(104/174): protobuf-compiler-3.14.0-13.el9.x86_ 3.9 MB/s | 863 kB 00:00 2024-04-17T05:24:22.864 INFO:teuthology.orchestra.run.smithi123.stdout:(105/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.6 MB/s | 548 kB 00:00 2024-04-17T05:24:22.964 INFO:teuthology.orchestra.run.smithi123.stdout:(106/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 111 kB/s | 94 kB 00:00 2024-04-17T05:24:22.997 INFO:teuthology.orchestra.run.smithi123.stdout:(107/174): gperftools-libs-2.9.1-2.el9.x86_64.r 2.3 MB/s | 309 kB 00:00 2024-04-17T05:24:23.023 INFO:teuthology.orchestra.run.smithi123.stdout:(108/174): grpc-data-1.46.7-10.el9.noarch.rpm 359 kB/s | 19 kB 00:00 2024-04-17T05:24:23.140 INFO:teuthology.orchestra.run.smithi123.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 224 kB/s | 26 kB 00:00 2024-04-17T05:24:23.315 INFO:teuthology.orchestra.run.smithi123.stdout:(110/174): libarrow-9.0.0-10.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-04-17T05:24:23.340 INFO:teuthology.orchestra.run.smithi123.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 254 kB/s | 49 kB 00:00 2024-04-17T05:24:23.365 INFO:teuthology.orchestra.run.smithi123.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-04-17T05:24:23.407 INFO:teuthology.orchestra.run.smithi123.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 2.3 MB/s | 151 kB 00:00 2024-04-17T05:24:23.414 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-04-17T05:24:23.766 INFO:teuthology.orchestra.run.smithi123.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.0 MB/s | 838 kB 00:00 2024-04-17T05:24:23.796 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-04-17T05:24:23.796 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-04-17T05:24:23.838 INFO:teuthology.orchestra.run.smithi123.stdout:(115/174): python3-asyncssh-2.13.2-5.el9.noarch 1.2 MB/s | 548 kB 00:00 2024-04-17T05:24:23.867 INFO:teuthology.orchestra.run.smithi123.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 460 kB/s | 43 kB 00:00 2024-04-17T05:24:23.917 INFO:teuthology.orchestra.run.smithi123.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 414 kB/s | 32 kB 00:00 2024-04-17T05:24:23.951 INFO:teuthology.orchestra.run.smithi123.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 181 kB/s | 15 kB 00:00 2024-04-17T05:24:23.992 INFO:teuthology.orchestra.run.smithi123.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-04-17T05:24:24.026 INFO:teuthology.orchestra.run.smithi123.stdout:(120/174): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-04-17T05:24:24.093 INFO:teuthology.orchestra.run.smithi123.stdout:(121/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.1 MB/s | 303 kB 00:00 2024-04-17T05:24:24.118 INFO:teuthology.orchestra.run.smithi123.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 386 kB/s | 35 kB 00:00 2024-04-17T05:24:24.169 INFO:teuthology.orchestra.run.smithi123.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 2.7 MB/s | 203 kB 00:00 2024-04-17T05:24:24.269 INFO:teuthology.orchestra.run.smithi123.stdout:(124/174): python3-grpcio-1.46.7-10.el9.x86_64. 14 MB/s | 2.0 MB 00:00 2024-04-17T05:24:24.294 INFO:teuthology.orchestra.run.smithi123.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 1.2 MB/s | 144 kB 00:00 2024-04-17T05:24:24.328 INFO:teuthology.orchestra.run.smithi123.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 190 kB/s | 11 kB 00:00 2024-04-17T05:24:24.353 INFO:teuthology.orchestra.run.smithi123.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 305 kB/s | 18 kB 00:00 2024-04-17T05:24:24.406 INFO:teuthology.orchestra.run.smithi123.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 302 kB/s | 23 kB 00:00 2024-04-17T05:24:24.431 INFO:teuthology.orchestra.run.smithi123.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 252 kB/s | 19 kB 00:00 2024-04-17T05:24:24.473 INFO:teuthology.orchestra.run.smithi123.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 299 kB/s | 20 kB 00:00 2024-04-17T05:24:24.565 INFO:teuthology.orchestra.run.smithi123.stdout:(131/174): python3-kubernetes-26.1.0-2.el9.noar 7.7 MB/s | 1.0 MB 00:00 2024-04-17T05:24:24.591 INFO:teuthology.orchestra.run.smithi123.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 398 kB/s | 46 kB 00:00 2024-04-17T05:24:24.616 INFO:teuthology.orchestra.run.smithi123.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 1.6 MB/s | 79 kB 00:00 2024-04-17T05:24:24.633 INFO:teuthology.orchestra.run.smithi123.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 1.4 MB/s | 58 kB 00:00 2024-04-17T05:24:24.692 INFO:teuthology.orchestra.run.smithi123.stdout:(135/174): python3-pecan-1.4.2-3.el9.noarch.rpm 3.6 MB/s | 272 kB 00:00 2024-04-17T05:24:24.725 INFO:teuthology.orchestra.run.smithi123.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 180 kB/s | 16 kB 00:00 2024-04-17T05:24:24.776 INFO:teuthology.orchestra.run.smithi123.stdout:(137/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.1 MB/s | 90 kB 00:00 2024-04-17T05:24:24.792 INFO:teuthology.orchestra.run.smithi123.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 425 kB/s | 28 kB 00:00 2024-04-17T05:24:24.818 INFO:teuthology.orchestra.run.smithi123.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 755 kB/s | 31 kB 00:00 2024-04-17T05:24:24.868 INFO:teuthology.orchestra.run.smithi123.stdout:(140/174): python3-routes-2.5.1-5.el9.noarch.rp 2.5 MB/s | 188 kB 00:00 2024-04-17T05:24:24.893 INFO:teuthology.orchestra.run.smithi123.stdout:(141/174): python3-rsa-4.9-2.el9.noarch.rpm 795 kB/s | 59 kB 00:00 2024-04-17T05:24:24.927 INFO:teuthology.orchestra.run.smithi123.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 622 kB/s | 36 kB 00:00 2024-04-17T05:24:24.952 INFO:teuthology.orchestra.run.smithi123.stdout:(143/174): python3-typing-extensions-4.4.0-2.el 882 kB/s | 51 kB 00:00 2024-04-17T05:24:25.011 INFO:teuthology.orchestra.run.smithi123.stdout:(144/174): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-04-17T05:24:25.036 INFO:teuthology.orchestra.run.smithi123.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 1.1 MB/s | 90 kB 00:00 2024-04-17T05:24:25.070 INFO:teuthology.orchestra.run.smithi123.stdout:(146/174): python3-werkzeug-2.0.3-3.el9.1.noarc 7.3 MB/s | 427 kB 00:00 2024-04-17T05:24:25.112 INFO:teuthology.orchestra.run.smithi123.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 286 kB/s | 20 kB 00:00 2024-04-17T05:24:25.145 INFO:teuthology.orchestra.run.smithi123.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-04-17T05:24:25.304 INFO:teuthology.orchestra.run.smithi123.stdout:(149/174): thrift-0.15.0-2.el9.x86_64.rpm 8.3 MB/s | 1.6 MB 00:00 2024-04-17T05:24:25.490 INFO:teuthology.orchestra.run.smithi123.stdout:(150/174): librados2-19.0.0-3133.ga8c84f59.el9. 10 MB/s | 3.4 MB 00:00 2024-04-17T05:24:25.604 INFO:teuthology.orchestra.run.smithi123.stdout:(151/174): NetworkManager-1.47.4-1.el9.x86_64.r 20 MB/s | 2.3 MB 00:00 2024-04-17T05:24:25.713 INFO:teuthology.orchestra.run.smithi123.stdout:(152/174): NetworkManager-libnm-1.47.4-1.el9.x8 17 MB/s | 1.8 MB 00:00 2024-04-17T05:24:25.747 INFO:teuthology.orchestra.run.smithi123.stdout:(153/174): NetworkManager-team-1.47.4-1.el9.x86 1.2 MB/s | 41 kB 00:00 2024-04-17T05:24:25.806 INFO:teuthology.orchestra.run.smithi123.stdout:(154/174): NetworkManager-tui-1.47.4-1.el9.x86_ 4.2 MB/s | 248 kB 00:00 2024-04-17T05:24:25.875 INFO:teuthology.orchestra.run.smithi123.stdout:(155/174): xfsdump-3.1.12-4.el9.x86_64.rpm 4.6 MB/s | 321 kB 00:00 2024-04-17T05:24:26.195 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-04-17T05:24:26.195 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-04-17T05:24:26.239 INFO:teuthology.orchestra.run.smithi123.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 196 kB/s | 71 kB 00:00 2024-04-17T05:24:26.448 INFO:teuthology.orchestra.run.smithi123.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 175 kB/s | 36 kB 00:00 2024-04-17T05:24:26.532 INFO:teuthology.orchestra.run.smithi123.stdout:(158/174): librbd1-19.0.0-3133.ga8c84f59.el9.x8 2.6 MB/s | 3.1 MB 00:01 2024-04-17T05:24:26.749 INFO:teuthology.orchestra.run.smithi123.stdout:(159/174): elfutils-libelf-0.190-2.el9.x86_64.r 642 kB/s | 192 kB 00:00 2024-04-17T05:24:26.902 INFO:teuthology.orchestra.run.smithi123.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 151 kB/s | 23 kB 00:00 2024-04-17T05:24:27.066 INFO:teuthology.orchestra.run.smithi123.stdout:(161/174): libblkid-2.37.4-18.el9.x86_64.rpm 667 kB/s | 108 kB 00:00 2024-04-17T05:24:27.174 INFO:teuthology.orchestra.run.smithi123.stdout:(162/174): openssl-devel-3.0.7-27.el9.x86_64.rp 668 kB/s | 4.1 MB 00:06 2024-04-17T05:24:27.208 INFO:teuthology.orchestra.run.smithi123.stdout:(163/174): elfutils-libs-0.190-2.el9.x86_64.rpm 379 kB/s | 256 kB 00:00 2024-04-17T05:24:27.233 INFO:teuthology.orchestra.run.smithi123.stdout:(164/174): libfdisk-2.37.4-18.el9.x86_64.rpm 928 kB/s | 155 kB 00:00 2024-04-17T05:24:27.358 INFO:teuthology.orchestra.run.smithi123.stdout:(165/174): libsmartcols-2.37.4-18.el9.x86_64.rp 426 kB/s | 64 kB 00:00 2024-04-17T05:24:27.383 INFO:teuthology.orchestra.run.smithi123.stdout:(166/174): libuuid-2.37.4-18.el9.x86_64.rpm 191 kB/s | 29 kB 00:00 2024-04-17T05:24:27.834 INFO:teuthology.orchestra.run.smithi123.stdout:(167/174): openssl-3.0.7-27.el9.x86_64.rpm 2.5 MB/s | 1.2 MB 00:00 2024-04-17T05:24:27.859 INFO:teuthology.orchestra.run.smithi123.stdout:(168/174): libmount-2.37.4-18.el9.x86_64.rpm 198 kB/s | 136 kB 00:00 2024-04-17T05:24:27.993 INFO:teuthology.orchestra.run.smithi123.stdout:(169/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 3.5 MB/s | 2.2 MB 00:00 2024-04-17T05:24:28.126 INFO:teuthology.orchestra.run.smithi123.stdout:(170/174): util-linux-user-2.37.4-18.el9.x86_64 235 kB/s | 31 kB 00:00 2024-04-17T05:24:28.235 INFO:teuthology.orchestra.run.smithi123.stdout:(171/174): util-linux-2.37.4-18.el9.x86_64.rpm 5.7 MB/s | 2.3 MB 00:00 2024-04-17T05:24:28.269 INFO:teuthology.orchestra.run.smithi123.stdout:(172/174): util-linux-core-2.37.4-18.el9.x86_64 1.1 MB/s | 465 kB 00:00 2024-04-17T05:24:28.369 INFO:teuthology.orchestra.run.smithi123.stdout:(173/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 4.4 MB/s | 1.1 MB 00:00 2024-04-17T05:24:29.077 INFO:teuthology.orchestra.run.smithi123.stdout:(174/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 88 kB/s | 74 kB 00:00 2024-04-17T05:24:29.083 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-04-17T05:24:29.083 INFO:teuthology.orchestra.run.smithi123.stdout:Total 11 MB/s | 229 MB 00:21 2024-04-17T05:24:30.157 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-04-17T05:24:30.512 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-04-17T05:24:30.512 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-04-17T05:24:32.848 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-04-17T05:24:32.848 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-04-17T05:24:33.909 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-04-17T05:24:34.050 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-04-17T05:24:34.101 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-04-17T05:24:34.139 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-17T05:24:34.184 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-17T05:24:34.240 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-04-17T05:24:34.333 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-04-17T05:24:34.394 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-04-17T05:24:34.428 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-04-17T05:24:34.515 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-04-17T05:24:34.928 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-04-17T05:24:34.985 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 10/198 2024-04-17T05:24:35.139 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 10/198 2024-04-17T05:24:35.199 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 11/198 2024-04-17T05:24:35.330 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 11/198 2024-04-17T05:24:35.360 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rados-2:19.0.0-3133.ga8c84f59.el9.x86_64 12/198 2024-04-17T05:24:35.415 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-04-17T05:24:35.714 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-04-17T05:24:35.793 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-04-17T05:24:35.824 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 16/198 2024-04-17T05:24:35.982 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 16/198 2024-04-17T05:24:36.011 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86 17/198 2024-04-17T05:24:36.084 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86 17/198 2024-04-17T05:24:36.138 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-04-17T05:24:36.163 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-17T05:24:36.226 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-17T05:24:36.583 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-17T05:24:36.629 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-17T05:24:36.679 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-04-17T05:24:37.025 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-04-17T05:24:37.195 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-17T05:24:37.266 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-17T05:24:37.466 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-17T05:24:37.540 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-17T05:24:37.849 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-17T05:24:38.034 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-04-17T05:24:38.191 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-04-17T05:24:38.229 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-04-17T05:24:38.265 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-04-17T05:24:38.325 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-04-17T05:24:38.436 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-04-17T05:24:38.502 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-04-17T05:24:38.545 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-04-17T05:24:38.633 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-04-17T05:24:38.684 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-04-17T05:24:38.744 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-04-17T05:24:38.789 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-04-17T05:24:38.821 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-04-17T05:24:38.933 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-04-17T05:24:38.974 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-common-2:19.0.0-3133.ga8c84f59.el9. 39/198 2024-04-17T05:24:39.020 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-argparse-2:19.0.0-3133.ga8c84f59.el 40/198 2024-04-17T05:24:39.047 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cephfs-2:19.0.0-3133.ga8c84f59.el9.x86_6 41/198 2024-04-17T05:24:39.161 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-04-17T05:24:39.219 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-04-17T05:24:39.323 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-04-17T05:24:39.497 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-04-17T05:24:39.562 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-04-17T05:24:40.260 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-04-17T05:24:40.368 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-04-17T05:24:40.453 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-04-17T05:24:40.505 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-04-17T05:24:40.560 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-17T05:24:40.577 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-04-17T05:24:40.588 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-17T05:24:40.625 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-04-17T05:24:40.645 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-04-17T05:24:40.680 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-17T05:24:40.720 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-04-17T05:24:40.726 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-17T05:24:40.780 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librados-devel-2:19.0.0-3133.ga8c84f59.el9.x86_6 53/198 2024-04-17T05:24:40.827 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-04-17T05:24:40.831 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-04-17T05:24:40.955 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-04-17T05:24:41.005 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-04-17T05:24:41.036 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-04-17T05:24:41.143 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-04-17T05:24:41.266 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-04-17T05:24:41.531 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-04-17T05:24:41.556 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-04-17T05:24:41.610 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 10/198 2024-04-17T05:24:41.633 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-04-17T05:24:41.695 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-04-17T05:24:41.751 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 10/198 2024-04-17T05:24:41.777 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 11/198 2024-04-17T05:24:41.881 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 11/198 2024-04-17T05:24:41.902 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-04-17T05:24:41.918 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rados-2:19.0.0-3133.ga8c84f59.el9.x86_64 12/198 2024-04-17T05:24:41.981 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-04-17T05:24:41.985 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-04-17T05:24:42.060 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-04-17T05:24:42.185 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-04-17T05:24:42.221 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-04-17T05:24:42.261 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-04-17T05:24:42.279 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-04-17T05:24:42.329 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-04-17T05:24:42.366 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-04-17T05:24:42.377 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-04-17T05:24:42.382 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 16/198 2024-04-17T05:24:42.442 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-04-17T05:24:42.507 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-04-17T05:24:42.532 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 16/198 2024-04-17T05:24:42.567 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86 17/198 2024-04-17T05:24:42.649 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86 17/198 2024-04-17T05:24:42.702 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-04-17T05:24:42.709 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-04-17T05:24:42.727 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-17T05:24:42.766 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-04-17T05:24:42.788 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-17T05:24:42.803 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-04-17T05:24:42.853 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-04-17T05:24:42.982 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-04-17T05:24:43.027 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-04-17T05:24:43.074 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-04-17T05:24:43.094 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-17T05:24:43.110 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-04-17T05:24:43.135 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-17T05:24:43.146 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-04-17T05:24:43.179 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-04-17T05:24:43.311 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-04-17T05:24:43.484 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-04-17T05:24:43.508 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-04-17T05:24:43.619 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-04-17T05:24:43.688 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-04-17T05:24:43.703 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-17T05:24:43.751 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-04-17T05:24:43.791 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-17T05:24:43.825 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-04-17T05:24:43.981 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-17T05:24:44.039 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-17T05:24:44.056 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-04-17T05:24:44.109 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-04-17T05:24:44.269 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-04-17T05:24:44.315 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-04-17T05:24:44.350 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-17T05:24:44.355 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-04-17T05:24:44.411 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-17T05:24:44.452 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-04-17T05:24:44.499 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-04-17T05:24:44.537 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-04-17T05:24:44.567 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-04-17T05:24:44.626 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-04-17T05:24:44.665 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-04-17T05:24:44.674 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-04-17T05:24:44.707 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-04-17T05:24:44.740 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-04-17T05:24:44.799 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-04-17T05:24:44.801 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-04-17T05:24:44.845 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-04-17T05:24:44.888 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-04-17T05:24:44.908 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-04-17T05:24:44.952 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-04-17T05:24:44.967 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-04-17T05:24:45.009 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-04-17T05:24:45.017 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-04-17T05:24:45.099 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-04-17T05:24:45.141 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-04-17T05:24:45.166 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-04-17T05:24:45.209 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-04-17T05:24:45.251 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-04-17T05:24:45.286 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-04-17T05:24:45.292 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-04-17T05:24:45.355 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-04-17T05:24:45.383 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-04-17T05:24:45.390 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-04-17T05:24:45.431 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ceph-common-2:19.0.0-3133.ga8c84f59.el9. 39/198 2024-04-17T05:24:45.449 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-04-17T05:24:45.485 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ceph-argparse-2:19.0.0-3133.ga8c84f59.el 40/198 2024-04-17T05:24:45.522 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cephfs-2:19.0.0-3133.ga8c84f59.el9.x86_6 41/198 2024-04-17T05:24:45.587 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-04-17T05:24:45.620 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-04-17T05:24:45.657 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-04-17T05:24:45.699 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-04-17T05:24:45.793 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-04-17T05:24:45.969 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-04-17T05:24:46.035 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-04-17T05:24:46.631 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-04-17T05:24:46.680 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-04-17T05:24:46.710 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-04-17T05:24:46.730 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-04-17T05:24:46.791 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-04-17T05:24:46.807 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-04-17T05:24:46.911 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-04-17T05:24:46.934 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-04-17T05:24:46.956 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-04-17T05:24:46.975 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-17T05:24:47.003 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-17T05:24:47.048 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-04-17T05:24:47.115 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-04-17T05:24:47.175 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librados-devel-2:19.0.0-3133.ga8c84f59.el9.x86_6 53/198 2024-04-17T05:24:47.192 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-04-17T05:24:47.216 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-04-17T05:24:47.228 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-04-17T05:24:47.322 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-04-17T05:24:47.610 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-04-17T05:24:47.799 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-04-17T05:24:47.895 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-04-17T05:24:47.966 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-04-17T05:24:48.126 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-04-17T05:24:48.162 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-04-17T05:24:48.216 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-04-17T05:24:48.259 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-04-17T05:24:48.282 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-04-17T05:24:48.378 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-04-17T05:24:48.425 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-04-17T05:24:48.486 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-04-17T05:24:48.554 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-04-17T05:24:48.598 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-04-17T05:24:48.661 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-04-17T05:24:48.719 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-04-17T05:24:48.905 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-04-17T05:24:48.960 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-04-17T05:24:48.998 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-04-17T05:24:49.048 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-04-17T05:24:49.176 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-04-17T05:24:49.214 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-04-17T05:24:49.258 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-04-17T05:24:49.288 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-04-17T05:24:49.321 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-04-17T05:24:49.478 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-04-17T05:24:49.650 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-04-17T05:24:49.781 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-04-17T05:24:49.815 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-04-17T05:24:49.830 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-04-17T05:24:49.891 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-04-17T05:24:49.925 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-04-17T05:24:49.960 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-04-17T05:24:49.961 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-04-17T05:24:49.993 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-04-17T05:24:50.035 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-04-17T05:24:50.190 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-04-17T05:24:50.249 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-04-17T05:24:50.410 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-04-17T05:24:50.415 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-04-17T05:24:50.449 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 124/198 2024-04-17T05:24:50.463 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-04-17T05:24:50.528 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-04-17T05:24:50.568 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-17T05:24:50.569 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 124/198 2024-04-17T05:24:50.605 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 125/198 2024-04-17T05:24:50.618 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-04-17T05:24:50.664 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-04-17T05:24:50.665 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-04-17T05:24:50.732 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-04-17T05:24:50.800 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-04-17T05:24:50.847 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-04-17T05:24:50.975 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-04-17T05:24:51.008 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-04-17T05:24:51.043 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-04-17T05:24:51.106 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-04-17T05:24:51.147 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-04-17T05:24:51.209 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-04-17T05:24:51.235 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 128/198 2024-04-17T05:24:51.285 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-04-17T05:24:51.360 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 128/198 2024-04-17T05:24:51.396 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 129/198 2024-04-17T05:24:51.408 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-04-17T05:24:51.469 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-04-17T05:24:51.504 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-04-17T05:24:51.594 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-04-17T05:24:51.735 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-04-17T05:24:51.803 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-04-17T05:24:52.776 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-04-17T05:24:52.819 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-04-17T05:24:52.853 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-04-17T05:24:52.907 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-04-17T05:24:53.020 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-04-17T05:24:53.069 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-04-17T05:24:53.308 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-04-17T05:24:53.333 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-04-17T05:24:53.429 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-04-17T05:24:54.040 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 130/198 2024-04-17T05:24:54.076 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 130/198 2024-04-17T05:24:54.227 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-04-17T05:24:54.361 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-04-17T05:24:54.695 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 130/198 2024-04-17T05:24:54.768 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 131/198 2024-04-17T05:24:54.944 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 131/198 2024-04-17T05:24:54.944 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-17T05:24:54.944 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-17T05:24:54.944 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:24:54.980 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 132/198 2024-04-17T05:24:55.943 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-04-17T05:24:56.036 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-04-17T05:24:56.074 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-04-17T05:24:56.104 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-04-17T05:24:56.144 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-04-17T05:24:56.527 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-04-17T05:24:56.560 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 124/198 2024-04-17T05:24:56.680 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 124/198 2024-04-17T05:24:56.708 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 125/198 2024-04-17T05:24:56.761 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-04-17T05:24:57.296 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-04-17T05:24:57.329 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 128/198 2024-04-17T05:24:57.416 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 128/198 2024-04-17T05:24:57.448 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 129/198 2024-04-17T05:25:00.120 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 130/198 2024-04-17T05:25:00.162 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 130/198 2024-04-17T05:25:00.786 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 130/198 2024-04-17T05:25:00.832 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 131/198 2024-04-17T05:25:00.996 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 131/198 2024-04-17T05:25:00.996 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-17T05:25:00.996 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-17T05:25:00.996 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:01.041 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 132/198 2024-04-17T05:25:07.889 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 132/198 2024-04-17T05:25:07.889 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /sys 2024-04-17T05:25:07.889 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /proc 2024-04-17T05:25:07.889 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /mnt 2024-04-17T05:25:07.890 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /var/tmp 2024-04-17T05:25:07.890 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /home 2024-04-17T05:25:07.890 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /root 2024-04-17T05:25:07.890 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /tmp 2024-04-17T05:25:07.890 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:08.119 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 133/198 2024-04-17T05:25:08.168 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 133/198 2024-04-17T05:25:08.168 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-17T05:25:08.168 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-17T05:25:08.168 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:09.815 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 134/198 2024-04-17T05:25:09.893 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 134/198 2024-04-17T05:25:09.894 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-17T05:25:09.894 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-17T05:25:09.894 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-17T05:25:09.894 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-17T05:25:09.894 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:10.140 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 135/198 2024-04-17T05:25:10.206 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 135/198 2024-04-17T05:25:10.207 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-17T05:25:10.207 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-17T05:25:10.207 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-17T05:25:10.207 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-17T05:25:10.207 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:10.707 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 136/198 2024-04-17T05:25:10.775 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 136/198 2024-04-17T05:25:10.775 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-17T05:25:10.775 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-17T05:25:10.776 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-17T05:25:10.776 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-17T05:25:10.776 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:10.893 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-04-17T05:25:11.524 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 138/198 2024-04-17T05:25:11.560 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 138/198 2024-04-17T05:25:11.611 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3133.ga8c84f59.e 139/198 2024-04-17T05:25:11.710 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3133.ga8c84f59. 140/198 2024-04-17T05:25:11.739 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noa 141/198 2024-04-17T05:25:13.044 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noa 141/198 2024-04-17T05:25:13.099 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.n 142/198 2024-04-17T05:25:14.146 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 132/198 2024-04-17T05:25:14.146 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /sys 2024-04-17T05:25:14.146 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /proc 2024-04-17T05:25:14.146 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /mnt 2024-04-17T05:25:14.146 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /var/tmp 2024-04-17T05:25:14.146 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /home 2024-04-17T05:25:14.146 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /root 2024-04-17T05:25:14.146 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /tmp 2024-04-17T05:25:14.146 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:14.192 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.n 142/198 2024-04-17T05:25:14.249 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c 143/198 2024-04-17T05:25:14.369 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 133/198 2024-04-17T05:25:14.398 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c 143/198 2024-04-17T05:25:14.418 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 133/198 2024-04-17T05:25:14.418 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-17T05:25:14.418 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-17T05:25:14.418 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:14.580 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3133.ga8c84f59.el 144/198 2024-04-17T05:25:14.610 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 145/198 2024-04-17T05:25:14.672 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 145/198 2024-04-17T05:25:14.672 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-17T05:25:14.672 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-17T05:25:14.672 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-17T05:25:14.672 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-17T05:25:14.672 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:14.735 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 146/198 2024-04-17T05:25:14.774 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 146/198 2024-04-17T05:25:14.887 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-2:19.0.0-3133.ga8c84f59.el9.x86_64 147/198 2024-04-17T05:25:15.921 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-04-17T05:25:15.980 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 149/198 2024-04-17T05:25:16.049 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 149/198 2024-04-17T05:25:16.049 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-17T05:25:16.049 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-17T05:25:16.049 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-17T05:25:16.049 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-17T05:25:16.049 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:16.063 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 134/198 2024-04-17T05:25:16.097 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3133.ga8c84 150/198 2024-04-17T05:25:16.139 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 134/198 2024-04-17T05:25:16.139 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-17T05:25:16.139 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-17T05:25:16.139 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-17T05:25:16.139 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-17T05:25:16.139 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:16.167 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3133.ga8c84 150/198 2024-04-17T05:25:16.167 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-17T05:25:16.167 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-17T05:25:16.167 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:16.239 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 151/198 2024-04-17T05:25:16.315 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 151/198 2024-04-17T05:25:16.315 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-17T05:25:16.315 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-17T05:25:16.316 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-17T05:25:16.316 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-17T05:25:16.316 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:16.380 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 135/198 2024-04-17T05:25:16.448 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 135/198 2024-04-17T05:25:16.448 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-17T05:25:16.448 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-17T05:25:16.448 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-17T05:25:16.448 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-17T05:25:16.448 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:16.707 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 152/198 2024-04-17T05:25:16.777 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 152/198 2024-04-17T05:25:16.777 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-17T05:25:16.777 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-17T05:25:16.777 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-17T05:25:16.777 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-17T05:25:16.777 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:16.931 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 136/198 2024-04-17T05:25:17.002 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 136/198 2024-04-17T05:25:17.002 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-17T05:25:17.003 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-17T05:25:17.003 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-17T05:25:17.003 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-17T05:25:17.003 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:17.116 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-04-17T05:25:17.790 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 138/198 2024-04-17T05:25:17.817 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 138/198 2024-04-17T05:25:17.868 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3133.ga8c84f59.e 139/198 2024-04-17T05:25:18.030 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3133.ga8c84f59. 140/198 2024-04-17T05:25:18.079 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noa 141/198 2024-04-17T05:25:19.384 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noa 141/198 2024-04-17T05:25:19.439 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.n 142/198 2024-04-17T05:25:20.541 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.n 142/198 2024-04-17T05:25:20.581 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c 143/198 2024-04-17T05:25:20.729 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c 143/198 2024-04-17T05:25:20.909 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3133.ga8c84f59.el 144/198 2024-04-17T05:25:20.942 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 145/198 2024-04-17T05:25:21.014 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 145/198 2024-04-17T05:25:21.015 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-17T05:25:21.015 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-17T05:25:21.015 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-17T05:25:21.015 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-17T05:25:21.015 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:21.067 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 146/198 2024-04-17T05:25:21.105 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 146/198 2024-04-17T05:25:21.194 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-2:19.0.0-3133.ga8c84f59.el9.x86_64 147/198 2024-04-17T05:25:21.803 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-test-2:19.0.0-3133.ga8c84f59.el9.x86_64 153/198 2024-04-17T05:25:21.863 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 154/198 2024-04-17T05:25:21.908 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-nbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 155/198 2024-04-17T05:25:21.946 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-04-17T05:25:22.193 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-04-17T05:25:22.227 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 149/198 2024-04-17T05:25:22.246 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephfs-shell-2:19.0.0-3133.ga8c84f59.el9.x86_64 157/198 2024-04-17T05:25:22.298 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 149/198 2024-04-17T05:25:22.298 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-17T05:25:22.299 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-17T05:25:22.299 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-17T05:25:22.299 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-17T05:25:22.299 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:22.353 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3133.ga8c84 150/198 2024-04-17T05:25:22.390 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-04-17T05:25:22.425 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3133.ga8c84 150/198 2024-04-17T05:25:22.425 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-17T05:25:22.425 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-17T05:25:22.425 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:22.441 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 159/198 2024-04-17T05:25:22.503 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-04-17T05:25:22.537 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 151/198 2024-04-17T05:25:22.565 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-04-17T05:25:22.609 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-04-17T05:25:22.613 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 151/198 2024-04-17T05:25:22.613 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-17T05:25:22.613 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-17T05:25:22.613 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-17T05:25:22.614 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-17T05:25:22.614 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:22.644 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs-devel-2:19.0.0-3133.ga8c84f59.el9.x86_ 163/198 2024-04-17T05:25:22.688 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-04-17T05:25:22.742 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : NetworkManager-team-1:1.47.4-1.el9.x86_64 165/198 2024-04-17T05:25:22.833 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : NetworkManager-tui-1:1.47.4-1.el9.x86_64 166/198 2024-04-17T05:25:22.954 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 152/198 2024-04-17T05:25:22.968 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-04-17T05:25:23.006 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-04-17T05:25:23.021 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 152/198 2024-04-17T05:25:23.021 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-17T05:25:23.021 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-17T05:25:23.021 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-17T05:25:23.021 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-17T05:25:23.021 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:24.309 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-17T05:25:24.354 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-17T05:25:24.411 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-17T05:25:25.733 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephfs-top-2:19.0.0-3133.ga8c84f59.el9.noarch 170/198 2024-04-17T05:25:25.826 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-04-17T05:25:25.912 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-04-17T05:25:26.056 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-04-17T05:25:26.095 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-04-17T05:25:26.128 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-04-17T05:25:26.163 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-04-17T05:25:26.204 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-04-17T05:25:26.204 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-17T05:25:26.359 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-17T05:25:26.400 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-04-17T05:25:26.400 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-17T05:25:26.546 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-17T05:25:26.592 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-04-17T05:25:26.637 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-04-17T05:25:26.670 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-04-17T05:25:26.703 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-04-17T05:25:26.779 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-04-17T05:25:26.859 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-04-17T05:25:26.908 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-04-17T05:25:26.941 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-04-17T05:25:26.978 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-04-17T05:25:27.036 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-04-17T05:25:27.074 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-04-17T05:25:27.111 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-17T05:25:27.111 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-17T05:25:27.450 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-17T05:25:27.451 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-17T05:25:27.609 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-17T05:25:27.674 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-04-17T05:25:27.711 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-04-17T05:25:27.748 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-04-17T05:25:27.787 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-04-17T05:25:27.904 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-17T05:25:28.027 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-test-2:19.0.0-3133.ga8c84f59.el9.x86_64 153/198 2024-04-17T05:25:28.074 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 154/198 2024-04-17T05:25:28.108 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-nbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 155/198 2024-04-17T05:25:28.145 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-04-17T05:25:28.152 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-17T05:25:28.153 INFO:teuthology.orchestra.run.smithi164.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-17T05:25:28.153 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:28.419 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephfs-shell-2:19.0.0-3133.ga8c84f59.el9.x86_64 157/198 2024-04-17T05:25:28.553 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-04-17T05:25:28.603 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 159/198 2024-04-17T05:25:28.657 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-04-17T05:25:28.744 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-04-17T05:25:28.788 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-04-17T05:25:28.824 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephfs-devel-2:19.0.0-3133.ga8c84f59.el9.x86_ 163/198 2024-04-17T05:25:28.868 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-04-17T05:25:28.915 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : NetworkManager-team-1:1.47.4-1.el9.x86_64 165/198 2024-04-17T05:25:29.005 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : NetworkManager-tui-1:1.47.4-1.el9.x86_64 166/198 2024-04-17T05:25:29.109 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-04-17T05:25:29.144 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-04-17T05:25:29.906 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-17T05:25:29.958 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-17T05:25:30.017 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-17T05:25:31.372 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephfs-top-2:19.0.0-3133.ga8c84f59.el9.noarch 170/198 2024-04-17T05:25:31.471 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-04-17T05:25:31.515 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-04-17T05:25:31.628 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-04-17T05:25:31.665 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-04-17T05:25:31.690 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-04-17T05:25:31.739 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-04-17T05:25:31.780 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-04-17T05:25:31.780 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-17T05:25:31.920 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-17T05:25:31.961 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-04-17T05:25:31.961 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-17T05:25:32.099 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-17T05:25:32.144 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-04-17T05:25:32.190 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-04-17T05:25:32.223 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-04-17T05:25:32.255 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-04-17T05:25:32.325 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-04-17T05:25:32.403 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-04-17T05:25:32.451 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-04-17T05:25:32.484 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-04-17T05:25:32.518 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-04-17T05:25:32.552 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-04-17T05:25:32.584 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-04-17T05:25:32.621 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-17T05:25:32.622 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-17T05:25:32.952 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-17T05:25:32.952 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-17T05:25:33.083 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-17T05:25:33.134 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-04-17T05:25:33.163 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-04-17T05:25:33.200 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-04-17T05:25:33.239 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-04-17T05:25:33.359 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-17T05:25:33.560 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-2:19.0.0-3133.ga8c84f59.el9.x86_64 1/198 2024-04-17T05:25:33.560 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 2/198 2024-04-17T05:25:33.560 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 3/198 2024-04-17T05:25:33.560 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 4/198 2024-04-17T05:25:33.560 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3133.ga8c84 5/198 2024-04-17T05:25:33.560 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 6/198 2024-04-17T05:25:33.560 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 7/198 2024-04-17T05:25:33.560 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 8/198 2024-04-17T05:25:33.560 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 9/198 2024-04-17T05:25:33.561 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 10/198 2024-04-17T05:25:33.561 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 11/198 2024-04-17T05:25:33.561 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-test-2:19.0.0-3133.ga8c84f59.el9.x86_64 12/198 2024-04-17T05:25:33.561 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 13/198 2024-04-17T05:25:33.561 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephfs-shell-2:19.0.0-3133.ga8c84f59.el9.x86_64 14/198 2024-04-17T05:25:33.561 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs-devel-2:19.0.0-3133.ga8c84f59.el9.x86_ 15/198 2024-04-17T05:25:33.561 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 16/198 2024-04-17T05:25:33.561 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 17/198 2024-04-17T05:25:33.561 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados-devel-2:19.0.0-3133.ga8c84f59.el9.x86_6 18/198 2024-04-17T05:25:33.561 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86 19/198 2024-04-17T05:25:33.561 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 20/198 2024-04-17T05:25:33.561 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3133.ga8c84f59.el 21/198 2024-04-17T05:25:33.561 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-common-2:19.0.0-3133.ga8c84f59.el9. 22/198 2024-04-17T05:25:33.562 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cephfs-2:19.0.0-3133.ga8c84f59.el9.x86_6 23/198 2024-04-17T05:25:33.562 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rados-2:19.0.0-3133.ga8c84f59.el9.x86_64 24/198 2024-04-17T05:25:33.562 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 25/198 2024-04-17T05:25:33.562 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 26/198 2024-04-17T05:25:33.562 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 27/198 2024-04-17T05:25:33.562 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 28/198 2024-04-17T05:25:33.562 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-nbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 29/198 2024-04-17T05:25:33.562 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3133.ga8c84f59. 30/198 2024-04-17T05:25:33.562 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noa 31/198 2024-04-17T05:25:33.562 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.n 32/198 2024-04-17T05:25:33.562 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c 33/198 2024-04-17T05:25:33.562 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3133.ga8c84f59.el 34/198 2024-04-17T05:25:33.563 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 35/198 2024-04-17T05:25:33.563 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3133.ga8c84f59.e 36/198 2024-04-17T05:25:33.563 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 37/198 2024-04-17T05:25:33.563 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 38/198 2024-04-17T05:25:33.563 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephfs-top-2:19.0.0-3133.ga8c84f59.el9.noarch 39/198 2024-04-17T05:25:33.563 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-04-17T05:25:33.563 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-04-17T05:25:33.563 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-04-17T05:25:33.563 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-04-17T05:25:33.563 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-04-17T05:25:33.564 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-04-17T05:25:33.564 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-04-17T05:25:33.564 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-04-17T05:25:33.564 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-04-17T05:25:33.564 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-04-17T05:25:33.564 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-04-17T05:25:33.564 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-04-17T05:25:33.564 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-04-17T05:25:33.564 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-04-17T05:25:33.564 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-04-17T05:25:33.564 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-04-17T05:25:33.565 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-04-17T05:25:33.565 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-04-17T05:25:33.565 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : postgresql-13.14-1.el9.x86_64 58/198 2024-04-17T05:25:33.565 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 59/198 2024-04-17T05:25:33.565 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 60/198 2024-04-17T05:25:33.565 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 61/198 2024-04-17T05:25:33.565 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-04-17T05:25:33.565 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-04-17T05:25:33.565 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-04-17T05:25:33.565 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-04-17T05:25:33.565 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-04-17T05:25:33.565 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-04-17T05:25:33.566 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-04-17T05:25:33.566 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-04-17T05:25:33.566 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-04-17T05:25:33.566 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-04-17T05:25:33.566 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-04-17T05:25:33.566 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-04-17T05:25:33.566 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-04-17T05:25:33.566 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-04-17T05:25:33.566 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-04-17T05:25:33.566 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-04-17T05:25:33.566 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-04-17T05:25:33.567 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-04-17T05:25:33.567 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-04-17T05:25:33.567 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-04-17T05:25:33.567 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 82/198 2024-04-17T05:25:33.567 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 83/198 2024-04-17T05:25:33.567 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 84/198 2024-04-17T05:25:33.567 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 85/198 2024-04-17T05:25:33.567 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 86/198 2024-04-17T05:25:33.567 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/198 2024-04-17T05:25:33.567 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 88/198 2024-04-17T05:25:33.568 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-17T05:25:33.568 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/198 2024-04-17T05:25:33.568 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/198 2024-04-17T05:25:33.568 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/198 2024-04-17T05:25:33.568 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/198 2024-04-17T05:25:33.568 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 94/198 2024-04-17T05:25:33.568 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : jq-1.6-16.el9.x86_64 95/198 2024-04-17T05:25:33.568 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 96/198 2024-04-17T05:25:33.568 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 97/198 2024-04-17T05:25:33.568 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 98/198 2024-04-17T05:25:33.568 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 99/198 2024-04-17T05:25:33.569 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 100/198 2024-04-17T05:25:33.569 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 101/198 2024-04-17T05:25:33.569 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 102/198 2024-04-17T05:25:33.569 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 103/198 2024-04-17T05:25:33.569 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-04-17T05:25:33.569 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-04-17T05:25:33.569 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-04-17T05:25:33.569 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-04-17T05:25:33.569 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-04-17T05:25:33.569 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-04-17T05:25:33.570 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-04-17T05:25:33.570 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-04-17T05:25:33.570 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-04-17T05:25:33.570 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-04-17T05:25:33.570 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-04-17T05:25:33.570 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-17T05:25:33.570 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-04-17T05:25:33.570 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-04-17T05:25:33.570 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-04-17T05:25:33.570 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-04-17T05:25:33.570 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-04-17T05:25:33.571 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-04-17T05:25:33.571 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-04-17T05:25:33.571 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-04-17T05:25:33.571 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-04-17T05:25:33.571 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-04-17T05:25:33.571 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-04-17T05:25:33.571 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-04-17T05:25:33.571 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-04-17T05:25:33.571 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-04-17T05:25:33.571 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-04-17T05:25:33.572 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-04-17T05:25:33.572 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-04-17T05:25:33.572 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-04-17T05:25:33.572 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-04-17T05:25:33.572 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-04-17T05:25:33.572 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-04-17T05:25:33.572 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-04-17T05:25:33.572 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-04-17T05:25:33.572 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-04-17T05:25:33.572 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-04-17T05:25:33.572 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-04-17T05:25:33.572 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-04-17T05:25:33.572 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-04-17T05:25:33.573 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-04-17T05:25:33.573 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-04-17T05:25:33.573 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-04-17T05:25:33.573 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-04-17T05:25:33.573 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-04-17T05:25:33.573 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-04-17T05:25:33.573 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-04-17T05:25:33.573 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 151/198 2024-04-17T05:25:33.573 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-04-17T05:25:33.573 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 153/198 2024-04-17T05:25:33.573 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-04-17T05:25:33.574 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 155/198 2024-04-17T05:25:33.574 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-04-17T05:25:33.574 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 157/198 2024-04-17T05:25:33.574 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-04-17T05:25:33.574 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 159/198 2024-04-17T05:25:33.574 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-04-17T05:25:33.574 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/198 2024-04-17T05:25:33.574 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-04-17T05:25:33.574 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 163/198 2024-04-17T05:25:33.574 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 164/198 2024-04-17T05:25:33.575 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-04-17T05:25:33.575 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-04-17T05:25:33.575 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-04-17T05:25:33.575 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-04-17T05:25:33.575 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-04-17T05:25:33.575 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-04-17T05:25:33.575 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-04-17T05:25:33.575 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-04-17T05:25:33.575 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-04-17T05:25:33.575 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-04-17T05:25:33.575 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-04-17T05:25:33.576 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-04-17T05:25:33.576 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-04-17T05:25:33.576 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-04-17T05:25:33.576 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-04-17T05:25:33.576 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-04-17T05:25:33.576 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-04-17T05:25:33.576 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-04-17T05:25:33.576 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-04-17T05:25:33.576 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-04-17T05:25:33.576 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-04-17T05:25:33.576 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-04-17T05:25:33.577 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-04-17T05:25:33.577 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-04-17T05:25:33.577 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-04-17T05:25:33.577 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-04-17T05:25:33.577 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-04-17T05:25:33.577 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-04-17T05:25:33.577 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-04-17T05:25:33.577 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-04-17T05:25:33.577 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-04-17T05:25:33.577 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-04-17T05:25:33.577 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-04-17T05:25:33.602 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-17T05:25:33.603 INFO:teuthology.orchestra.run.smithi123.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-17T05:25:33.603 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:36.177 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-04-17T05:25:36.177 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:36.177 INFO:teuthology.orchestra.run.smithi164.stdout:Upgraded: 2024-04-17T05:25:36.177 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-1:1.47.4-1.el9.x86_64 2024-04-17T05:25:36.177 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 2024-04-17T05:25:36.177 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-team-1:1.47.4-1.el9.x86_64 2024-04-17T05:25:36.178 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-tui-1:1.47.4-1.el9.x86_64 2024-04-17T05:25:36.178 INFO:teuthology.orchestra.run.smithi164.stdout: acl-2.3.1-4.el9.x86_64 2024-04-17T05:25:36.178 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-17T05:25:36.178 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-17T05:25:36.178 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-17T05:25:36.178 INFO:teuthology.orchestra.run.smithi164.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-17T05:25:36.178 INFO:teuthology.orchestra.run.smithi164.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-17T05:25:36.178 INFO:teuthology.orchestra.run.smithi164.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-17T05:25:36.178 INFO:teuthology.orchestra.run.smithi164.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-17T05:25:36.178 INFO:teuthology.orchestra.run.smithi164.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-17T05:25:36.178 INFO:teuthology.orchestra.run.smithi164.stdout: librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:36.178 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:36.178 INFO:teuthology.orchestra.run.smithi164.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-17T05:25:36.178 INFO:teuthology.orchestra.run.smithi164.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-17T05:25:36.179 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-17T05:25:36.179 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-17T05:25:36.179 INFO:teuthology.orchestra.run.smithi164.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-17T05:25:36.179 INFO:teuthology.orchestra.run.smithi164.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-17T05:25:36.179 INFO:teuthology.orchestra.run.smithi164.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-17T05:25:36.179 INFO:teuthology.orchestra.run.smithi164.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-17T05:25:36.179 INFO:teuthology.orchestra.run.smithi164.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-17T05:25:36.179 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-04-17T05:25:36.179 INFO:teuthology.orchestra.run.smithi164.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-17T05:25:36.179 INFO:teuthology.orchestra.run.smithi164.stdout: automake-1.16.2-8.el9.noarch 2024-04-17T05:25:36.179 INFO:teuthology.orchestra.run.smithi164.stdout: bison-3.7.4-5.el9.x86_64 2024-04-17T05:25:36.179 INFO:teuthology.orchestra.run.smithi164.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-17T05:25:36.179 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:36.179 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:36.180 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:36.180 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:36.180 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-grafana-dashboards-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-17T05:25:36.180 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:36.180 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:36.180 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:36.180 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-17T05:25:36.180 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-17T05:25:36.180 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-17T05:25:36.180 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-17T05:25:36.180 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-17T05:25:36.180 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:36.180 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:36.180 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-prometheus-alerts-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-17T05:25:36.181 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:36.181 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:36.181 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:36.181 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-17T05:25:36.181 INFO:teuthology.orchestra.run.smithi164.stdout: cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-17T05:25:36.181 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:36.181 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-shell-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:36.181 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-top-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-17T05:25:36.181 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-17T05:25:36.181 INFO:teuthology.orchestra.run.smithi164.stdout: flex-2.6.4-9.el9.x86_64 2024-04-17T05:25:36.181 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-17T05:25:36.181 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-17T05:25:36.181 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-17T05:25:36.181 INFO:teuthology.orchestra.run.smithi164.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-17T05:25:36.181 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-17T05:25:36.182 INFO:teuthology.orchestra.run.smithi164.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-17T05:25:36.182 INFO:teuthology.orchestra.run.smithi164.stdout: jq-1.6-16.el9.x86_64 2024-04-17T05:25:36.182 INFO:teuthology.orchestra.run.smithi164.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-17T05:25:36.182 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-17T05:25:36.182 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-17T05:25:36.182 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:36.182 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:36.182 INFO:teuthology.orchestra.run.smithi164.stdout: libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:36.182 INFO:teuthology.orchestra.run.smithi164.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-17T05:25:36.182 INFO:teuthology.orchestra.run.smithi164.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-17T05:25:36.182 INFO:teuthology.orchestra.run.smithi164.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-17T05:25:36.182 INFO:teuthology.orchestra.run.smithi164.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-17T05:25:36.182 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-17T05:25:36.183 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:36.183 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:36.183 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-17T05:25:36.183 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:36.183 INFO:teuthology.orchestra.run.smithi164.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-17T05:25:36.183 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-17T05:25:36.183 INFO:teuthology.orchestra.run.smithi164.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-17T05:25:36.183 INFO:teuthology.orchestra.run.smithi164.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-17T05:25:36.183 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-17T05:25:36.183 INFO:teuthology.orchestra.run.smithi164.stdout: lua-5.4.4-4.el9.x86_64 2024-04-17T05:25:36.183 INFO:teuthology.orchestra.run.smithi164.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-17T05:25:36.183 INFO:teuthology.orchestra.run.smithi164.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-17T05:25:36.183 INFO:teuthology.orchestra.run.smithi164.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-17T05:25:36.183 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-17T05:25:36.184 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-17T05:25:36.184 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-17T05:25:36.184 INFO:teuthology.orchestra.run.smithi164.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-17T05:25:36.184 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-13.14-1.el9.x86_64 2024-04-17T05:25:36.184 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-17T05:25:36.184 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-17T05:25:36.184 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-17T05:25:36.184 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-17T05:25:36.184 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-17T05:25:36.184 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-17T05:25:36.184 INFO:teuthology.orchestra.run.smithi164.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-17T05:25:36.184 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-17T05:25:36.184 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-17T05:25:36.184 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-17T05:25:36.185 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:36.185 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:36.185 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:36.185 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-17T05:25:36.185 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-17T05:25:36.185 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-17T05:25:36.185 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-17T05:25:36.185 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-17T05:25:36.185 INFO:teuthology.orchestra.run.smithi164.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-17T05:25:36.185 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-17T05:25:36.185 INFO:teuthology.orchestra.run.smithi164.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-17T05:25:36.185 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-17T05:25:36.185 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-17T05:25:36.185 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-17T05:25:36.186 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-17T05:25:36.186 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-17T05:25:36.186 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-17T05:25:36.186 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-17T05:25:36.186 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-17T05:25:36.186 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-17T05:25:36.186 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-17T05:25:36.186 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-17T05:25:36.186 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-17T05:25:36.186 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-17T05:25:36.186 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-17T05:25:36.186 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-17T05:25:36.186 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-17T05:25:36.186 INFO:teuthology.orchestra.run.smithi164.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-17T05:25:36.187 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-17T05:25:36.187 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-17T05:25:36.187 INFO:teuthology.orchestra.run.smithi164.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-17T05:25:36.187 INFO:teuthology.orchestra.run.smithi164.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-17T05:25:36.187 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-17T05:25:36.187 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ply-3.11-14.el9.noarch 2024-04-17T05:25:36.187 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-17T05:25:36.187 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-17T05:25:36.187 INFO:teuthology.orchestra.run.smithi164.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-17T05:25:36.187 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-17T05:25:36.188 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-17T05:25:36.188 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-17T05:25:36.188 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-17T05:25:36.188 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-17T05:25:36.188 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-17T05:25:36.188 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:36.188 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:36.188 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-17T05:25:36.188 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-17T05:25:36.188 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-17T05:25:36.188 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:36.188 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-17T05:25:36.188 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-17T05:25:36.188 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-17T05:25:36.189 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-17T05:25:36.189 INFO:teuthology.orchestra.run.smithi164.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-17T05:25:36.189 INFO:teuthology.orchestra.run.smithi164.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-17T05:25:36.189 INFO:teuthology.orchestra.run.smithi164.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-17T05:25:36.189 INFO:teuthology.orchestra.run.smithi164.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-17T05:25:36.189 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-17T05:25:36.189 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-17T05:25:36.189 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-17T05:25:36.189 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-17T05:25:36.189 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-17T05:25:36.189 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-17T05:25:36.189 INFO:teuthology.orchestra.run.smithi164.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-17T05:25:36.189 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:36.189 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:36.189 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:36.190 INFO:teuthology.orchestra.run.smithi164.stdout: re2-1:20211101-3.el9.x86_64 2024-04-17T05:25:36.190 INFO:teuthology.orchestra.run.smithi164.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-17T05:25:36.190 INFO:teuthology.orchestra.run.smithi164.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-17T05:25:36.190 INFO:teuthology.orchestra.run.smithi164.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-17T05:25:36.190 INFO:teuthology.orchestra.run.smithi164.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-17T05:25:36.190 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-17T05:25:36.190 INFO:teuthology.orchestra.run.smithi164.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-17T05:25:36.190 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:36.190 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-04-17T05:25:36.902 DEBUG:teuthology.parallel:result is None 2024-04-17T05:25:38.843 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-2:19.0.0-3133.ga8c84f59.el9.x86_64 1/198 2024-04-17T05:25:38.843 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 2/198 2024-04-17T05:25:38.843 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 3/198 2024-04-17T05:25:38.843 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 4/198 2024-04-17T05:25:38.843 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3133.ga8c84 5/198 2024-04-17T05:25:38.844 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 6/198 2024-04-17T05:25:38.844 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 7/198 2024-04-17T05:25:38.844 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 8/198 2024-04-17T05:25:38.844 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 9/198 2024-04-17T05:25:38.844 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 10/198 2024-04-17T05:25:38.844 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 11/198 2024-04-17T05:25:38.844 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-test-2:19.0.0-3133.ga8c84f59.el9.x86_64 12/198 2024-04-17T05:25:38.844 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 13/198 2024-04-17T05:25:38.844 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephfs-shell-2:19.0.0-3133.ga8c84f59.el9.x86_64 14/198 2024-04-17T05:25:38.844 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephfs-devel-2:19.0.0-3133.ga8c84f59.el9.x86_ 15/198 2024-04-17T05:25:38.844 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 16/198 2024-04-17T05:25:38.844 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 17/198 2024-04-17T05:25:38.844 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados-devel-2:19.0.0-3133.ga8c84f59.el9.x86_6 18/198 2024-04-17T05:25:38.844 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86 19/198 2024-04-17T05:25:38.845 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 20/198 2024-04-17T05:25:38.845 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3133.ga8c84f59.el 21/198 2024-04-17T05:25:38.845 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ceph-common-2:19.0.0-3133.ga8c84f59.el9. 22/198 2024-04-17T05:25:38.845 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cephfs-2:19.0.0-3133.ga8c84f59.el9.x86_6 23/198 2024-04-17T05:25:38.845 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rados-2:19.0.0-3133.ga8c84f59.el9.x86_64 24/198 2024-04-17T05:25:38.845 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 25/198 2024-04-17T05:25:38.845 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 26/198 2024-04-17T05:25:38.845 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 27/198 2024-04-17T05:25:38.862 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 28/198 2024-04-17T05:25:38.862 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-nbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 29/198 2024-04-17T05:25:38.862 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3133.ga8c84f59. 30/198 2024-04-17T05:25:38.862 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noa 31/198 2024-04-17T05:25:38.862 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.n 32/198 2024-04-17T05:25:38.862 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c 33/198 2024-04-17T05:25:38.862 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3133.ga8c84f59.el 34/198 2024-04-17T05:25:38.862 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 35/198 2024-04-17T05:25:38.862 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3133.ga8c84f59.e 36/198 2024-04-17T05:25:38.862 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 37/198 2024-04-17T05:25:38.862 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 38/198 2024-04-17T05:25:38.863 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephfs-top-2:19.0.0-3133.ga8c84f59.el9.noarch 39/198 2024-04-17T05:25:38.863 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-04-17T05:25:38.863 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-04-17T05:25:38.863 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-04-17T05:25:38.863 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-04-17T05:25:38.863 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-04-17T05:25:38.863 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-04-17T05:25:38.863 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-04-17T05:25:38.863 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-04-17T05:25:38.863 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-04-17T05:25:38.863 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-04-17T05:25:38.863 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-04-17T05:25:38.863 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-04-17T05:25:38.863 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-04-17T05:25:38.864 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-04-17T05:25:38.864 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-04-17T05:25:38.864 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-04-17T05:25:38.864 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-04-17T05:25:38.864 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-04-17T05:25:38.864 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-13.14-1.el9.x86_64 58/198 2024-04-17T05:25:38.864 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 59/198 2024-04-17T05:25:38.864 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 60/198 2024-04-17T05:25:38.864 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 61/198 2024-04-17T05:25:38.864 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-04-17T05:25:38.864 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-04-17T05:25:38.864 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-04-17T05:25:38.864 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-04-17T05:25:38.864 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-04-17T05:25:38.865 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-04-17T05:25:38.865 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-04-17T05:25:38.865 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-04-17T05:25:38.865 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-04-17T05:25:38.865 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-04-17T05:25:38.865 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-04-17T05:25:38.865 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-04-17T05:25:38.865 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-04-17T05:25:38.865 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-04-17T05:25:38.865 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-04-17T05:25:38.865 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-04-17T05:25:38.865 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-04-17T05:25:38.865 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-04-17T05:25:38.865 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-04-17T05:25:38.866 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-04-17T05:25:38.866 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 82/198 2024-04-17T05:25:38.866 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 83/198 2024-04-17T05:25:38.866 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 84/198 2024-04-17T05:25:38.866 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 85/198 2024-04-17T05:25:38.866 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 86/198 2024-04-17T05:25:38.866 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/198 2024-04-17T05:25:38.866 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 88/198 2024-04-17T05:25:38.866 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 89/198 2024-04-17T05:25:38.866 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/198 2024-04-17T05:25:38.866 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/198 2024-04-17T05:25:38.866 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/198 2024-04-17T05:25:38.866 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/198 2024-04-17T05:25:38.866 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 94/198 2024-04-17T05:25:38.867 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : jq-1.6-16.el9.x86_64 95/198 2024-04-17T05:25:38.867 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 96/198 2024-04-17T05:25:38.867 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 97/198 2024-04-17T05:25:38.867 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 98/198 2024-04-17T05:25:38.867 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 99/198 2024-04-17T05:25:38.867 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 100/198 2024-04-17T05:25:38.867 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 101/198 2024-04-17T05:25:38.867 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 102/198 2024-04-17T05:25:38.867 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 103/198 2024-04-17T05:25:38.867 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-04-17T05:25:38.867 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-04-17T05:25:38.867 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-04-17T05:25:38.867 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-04-17T05:25:38.867 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-04-17T05:25:38.867 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-04-17T05:25:38.868 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-04-17T05:25:38.868 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-04-17T05:25:38.868 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-04-17T05:25:38.868 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-04-17T05:25:38.868 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-04-17T05:25:38.868 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-17T05:25:38.868 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-04-17T05:25:38.868 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-04-17T05:25:38.868 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-04-17T05:25:38.868 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-04-17T05:25:38.868 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-04-17T05:25:38.868 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-04-17T05:25:38.868 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-04-17T05:25:38.868 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-04-17T05:25:38.868 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-04-17T05:25:38.869 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-04-17T05:25:38.869 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-04-17T05:25:38.869 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-04-17T05:25:38.869 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-04-17T05:25:38.869 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-04-17T05:25:38.869 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-04-17T05:25:38.869 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-04-17T05:25:38.869 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-04-17T05:25:38.869 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-04-17T05:25:38.869 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-04-17T05:25:38.869 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-04-17T05:25:38.869 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-04-17T05:25:38.869 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-04-17T05:25:38.869 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-04-17T05:25:38.870 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-04-17T05:25:38.870 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-04-17T05:25:38.870 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-04-17T05:25:38.870 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-04-17T05:25:38.870 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-04-17T05:25:38.870 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-04-17T05:25:38.870 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-04-17T05:25:38.870 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-04-17T05:25:38.870 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-04-17T05:25:38.870 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-04-17T05:25:38.870 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-04-17T05:25:38.870 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-04-17T05:25:38.870 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 151/198 2024-04-17T05:25:38.871 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-04-17T05:25:38.871 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 153/198 2024-04-17T05:25:38.871 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-04-17T05:25:38.871 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 155/198 2024-04-17T05:25:38.871 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-04-17T05:25:38.871 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 157/198 2024-04-17T05:25:38.871 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-04-17T05:25:38.871 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 159/198 2024-04-17T05:25:38.871 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-04-17T05:25:38.871 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/198 2024-04-17T05:25:38.871 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-04-17T05:25:38.871 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 163/198 2024-04-17T05:25:38.871 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 164/198 2024-04-17T05:25:38.872 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-04-17T05:25:38.872 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-04-17T05:25:38.872 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-04-17T05:25:38.872 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-04-17T05:25:38.872 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-04-17T05:25:38.872 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-04-17T05:25:38.872 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-04-17T05:25:38.872 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-04-17T05:25:38.872 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-04-17T05:25:38.872 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-04-17T05:25:38.872 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-04-17T05:25:38.872 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-04-17T05:25:38.872 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-04-17T05:25:38.873 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-04-17T05:25:38.873 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-04-17T05:25:38.873 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-04-17T05:25:38.873 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-04-17T05:25:38.873 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-04-17T05:25:38.873 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-04-17T05:25:38.873 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-04-17T05:25:38.873 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-04-17T05:25:38.873 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-04-17T05:25:38.873 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-04-17T05:25:38.873 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-04-17T05:25:38.873 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-04-17T05:25:38.873 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-04-17T05:25:38.874 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-04-17T05:25:38.874 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-04-17T05:25:38.874 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-04-17T05:25:38.874 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-04-17T05:25:38.874 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-04-17T05:25:38.874 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-04-17T05:25:38.874 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-04-17T05:25:41.374 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-04-17T05:25:41.374 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:41.374 INFO:teuthology.orchestra.run.smithi123.stdout:Upgraded: 2024-04-17T05:25:41.374 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-1:1.47.4-1.el9.x86_64 2024-04-17T05:25:41.374 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 2024-04-17T05:25:41.374 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-team-1:1.47.4-1.el9.x86_64 2024-04-17T05:25:41.374 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-tui-1:1.47.4-1.el9.x86_64 2024-04-17T05:25:41.374 INFO:teuthology.orchestra.run.smithi123.stdout: acl-2.3.1-4.el9.x86_64 2024-04-17T05:25:41.374 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-17T05:25:41.374 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-17T05:25:41.375 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-17T05:25:41.375 INFO:teuthology.orchestra.run.smithi123.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-17T05:25:41.375 INFO:teuthology.orchestra.run.smithi123.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-17T05:25:41.375 INFO:teuthology.orchestra.run.smithi123.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-17T05:25:41.375 INFO:teuthology.orchestra.run.smithi123.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-17T05:25:41.375 INFO:teuthology.orchestra.run.smithi123.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-17T05:25:41.375 INFO:teuthology.orchestra.run.smithi123.stdout: librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:41.375 INFO:teuthology.orchestra.run.smithi123.stdout: librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:41.375 INFO:teuthology.orchestra.run.smithi123.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-17T05:25:41.375 INFO:teuthology.orchestra.run.smithi123.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-17T05:25:41.375 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-17T05:25:41.375 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-17T05:25:41.375 INFO:teuthology.orchestra.run.smithi123.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-17T05:25:41.376 INFO:teuthology.orchestra.run.smithi123.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-17T05:25:41.376 INFO:teuthology.orchestra.run.smithi123.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-17T05:25:41.376 INFO:teuthology.orchestra.run.smithi123.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-17T05:25:41.376 INFO:teuthology.orchestra.run.smithi123.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-17T05:25:41.376 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-04-17T05:25:41.376 INFO:teuthology.orchestra.run.smithi123.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-17T05:25:41.376 INFO:teuthology.orchestra.run.smithi123.stdout: automake-1.16.2-8.el9.noarch 2024-04-17T05:25:41.376 INFO:teuthology.orchestra.run.smithi123.stdout: bison-3.7.4-5.el9.x86_64 2024-04-17T05:25:41.376 INFO:teuthology.orchestra.run.smithi123.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-17T05:25:41.376 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:41.376 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:41.376 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:41.376 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:41.376 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-grafana-dashboards-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-17T05:25:41.377 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-immutable-object-cache-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:41.377 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:41.377 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:41.377 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-17T05:25:41.377 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-17T05:25:41.377 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-17T05:25:41.377 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-17T05:25:41.377 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-17T05:25:41.377 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:41.377 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:41.377 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-prometheus-alerts-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-17T05:25:41.377 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:41.377 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:41.378 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-test-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:41.378 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-17T05:25:41.378 INFO:teuthology.orchestra.run.smithi123.stdout: cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-17T05:25:41.378 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:41.378 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-shell-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:41.378 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-top-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-17T05:25:41.378 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-17T05:25:41.378 INFO:teuthology.orchestra.run.smithi123.stdout: flex-2.6.4-9.el9.x86_64 2024-04-17T05:25:41.378 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-17T05:25:41.378 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-17T05:25:41.378 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-17T05:25:41.378 INFO:teuthology.orchestra.run.smithi123.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-17T05:25:41.378 INFO:teuthology.orchestra.run.smithi123.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-17T05:25:41.379 INFO:teuthology.orchestra.run.smithi123.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-17T05:25:41.379 INFO:teuthology.orchestra.run.smithi123.stdout: jq-1.6-16.el9.x86_64 2024-04-17T05:25:41.379 INFO:teuthology.orchestra.run.smithi123.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-17T05:25:41.379 INFO:teuthology.orchestra.run.smithi123.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-17T05:25:41.379 INFO:teuthology.orchestra.run.smithi123.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-17T05:25:41.379 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs-devel-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:41.379 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:41.379 INFO:teuthology.orchestra.run.smithi123.stdout: libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:41.379 INFO:teuthology.orchestra.run.smithi123.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-17T05:25:41.379 INFO:teuthology.orchestra.run.smithi123.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-17T05:25:41.379 INFO:teuthology.orchestra.run.smithi123.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-17T05:25:41.379 INFO:teuthology.orchestra.run.smithi123.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-17T05:25:41.379 INFO:teuthology.orchestra.run.smithi123.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-17T05:25:41.380 INFO:teuthology.orchestra.run.smithi123.stdout: librados-devel-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:41.380 INFO:teuthology.orchestra.run.smithi123.stdout: libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:41.380 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-17T05:25:41.380 INFO:teuthology.orchestra.run.smithi123.stdout: librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:41.380 INFO:teuthology.orchestra.run.smithi123.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-17T05:25:41.380 INFO:teuthology.orchestra.run.smithi123.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-17T05:25:41.380 INFO:teuthology.orchestra.run.smithi123.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-17T05:25:41.380 INFO:teuthology.orchestra.run.smithi123.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-17T05:25:41.380 INFO:teuthology.orchestra.run.smithi123.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-17T05:25:41.380 INFO:teuthology.orchestra.run.smithi123.stdout: lua-5.4.4-4.el9.x86_64 2024-04-17T05:25:41.380 INFO:teuthology.orchestra.run.smithi123.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-17T05:25:41.380 INFO:teuthology.orchestra.run.smithi123.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-17T05:25:41.380 INFO:teuthology.orchestra.run.smithi123.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-17T05:25:41.380 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-17T05:25:41.381 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-17T05:25:41.381 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-17T05:25:41.381 INFO:teuthology.orchestra.run.smithi123.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-17T05:25:41.381 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-13.14-1.el9.x86_64 2024-04-17T05:25:41.381 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-17T05:25:41.381 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-17T05:25:41.381 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-17T05:25:41.381 INFO:teuthology.orchestra.run.smithi123.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-17T05:25:41.381 INFO:teuthology.orchestra.run.smithi123.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-17T05:25:41.381 INFO:teuthology.orchestra.run.smithi123.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-17T05:25:41.381 INFO:teuthology.orchestra.run.smithi123.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-17T05:25:41.381 INFO:teuthology.orchestra.run.smithi123.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-17T05:25:41.381 INFO:teuthology.orchestra.run.smithi123.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-17T05:25:41.381 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-17T05:25:41.382 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-argparse-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:41.382 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:41.382 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cephfs-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:41.382 INFO:teuthology.orchestra.run.smithi123.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-17T05:25:41.382 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-17T05:25:41.382 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-17T05:25:41.382 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-17T05:25:41.382 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-17T05:25:41.382 INFO:teuthology.orchestra.run.smithi123.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-17T05:25:41.382 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-17T05:25:41.382 INFO:teuthology.orchestra.run.smithi123.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-17T05:25:41.382 INFO:teuthology.orchestra.run.smithi123.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-17T05:25:41.382 INFO:teuthology.orchestra.run.smithi123.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-17T05:25:41.383 INFO:teuthology.orchestra.run.smithi123.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-17T05:25:41.383 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-17T05:25:41.383 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-17T05:25:41.383 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-17T05:25:41.383 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-17T05:25:41.383 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-17T05:25:41.383 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-17T05:25:41.383 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-17T05:25:41.383 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-17T05:25:41.383 INFO:teuthology.orchestra.run.smithi123.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-17T05:25:41.383 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-17T05:25:41.383 INFO:teuthology.orchestra.run.smithi123.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-17T05:25:41.383 INFO:teuthology.orchestra.run.smithi123.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-17T05:25:41.383 INFO:teuthology.orchestra.run.smithi123.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-17T05:25:41.383 INFO:teuthology.orchestra.run.smithi123.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-17T05:25:41.384 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-17T05:25:41.384 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-17T05:25:41.384 INFO:teuthology.orchestra.run.smithi123.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-17T05:25:41.384 INFO:teuthology.orchestra.run.smithi123.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-17T05:25:41.384 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-17T05:25:41.384 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ply-3.11-14.el9.noarch 2024-04-17T05:25:41.384 INFO:teuthology.orchestra.run.smithi123.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-17T05:25:41.384 INFO:teuthology.orchestra.run.smithi123.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-17T05:25:41.384 INFO:teuthology.orchestra.run.smithi123.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-17T05:25:41.384 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-17T05:25:41.384 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-17T05:25:41.384 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-17T05:25:41.384 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-17T05:25:41.384 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-17T05:25:41.385 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-17T05:25:41.385 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rados-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:41.385 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:41.385 INFO:teuthology.orchestra.run.smithi123.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-17T05:25:41.385 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-17T05:25:41.385 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-17T05:25:41.385 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:41.385 INFO:teuthology.orchestra.run.smithi123.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-17T05:25:41.385 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-17T05:25:41.385 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-17T05:25:41.385 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-17T05:25:41.385 INFO:teuthology.orchestra.run.smithi123.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-17T05:25:41.385 INFO:teuthology.orchestra.run.smithi123.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-17T05:25:41.385 INFO:teuthology.orchestra.run.smithi123.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-17T05:25:41.386 INFO:teuthology.orchestra.run.smithi123.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-17T05:25:41.386 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-17T05:25:41.386 INFO:teuthology.orchestra.run.smithi123.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-17T05:25:41.386 INFO:teuthology.orchestra.run.smithi123.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-17T05:25:41.386 INFO:teuthology.orchestra.run.smithi123.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-17T05:25:41.386 INFO:teuthology.orchestra.run.smithi123.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-17T05:25:41.386 INFO:teuthology.orchestra.run.smithi123.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-17T05:25:41.386 INFO:teuthology.orchestra.run.smithi123.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-17T05:25:41.386 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:41.386 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:41.386 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-nbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-17T05:25:41.386 INFO:teuthology.orchestra.run.smithi123.stdout: re2-1:20211101-3.el9.x86_64 2024-04-17T05:25:41.386 INFO:teuthology.orchestra.run.smithi123.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-17T05:25:41.386 INFO:teuthology.orchestra.run.smithi123.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-17T05:25:41.387 INFO:teuthology.orchestra.run.smithi123.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-17T05:25:41.387 INFO:teuthology.orchestra.run.smithi123.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-17T05:25:41.387 INFO:teuthology.orchestra.run.smithi123.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-17T05:25:41.387 INFO:teuthology.orchestra.run.smithi123.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-17T05:25:41.387 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:41.387 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-04-17T05:25:42.022 DEBUG:teuthology.parallel:result is None 2024-04-17T05:25:42.022 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a8c84f5997950fd7d008204839253291d52e6eda 2024-04-17T05:25:42.167 DEBUG:teuthology.orchestra.run.smithi123:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-17T05:25:42.238 INFO:teuthology.orchestra.run.smithi123.stdout:19.0.0-3133.ga8c84f59.el9 2024-04-17T05:25:42.238 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3133.ga8c84f59.el9 2024-04-17T05:25:42.238 INFO:teuthology.task.install:The correct ceph version 19.0.0-3133.ga8c84f59 is installed. 2024-04-17T05:25:42.241 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a8c84f5997950fd7d008204839253291d52e6eda 2024-04-17T05:25:42.479 DEBUG:teuthology.orchestra.run.smithi164:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-17T05:25:42.554 INFO:teuthology.orchestra.run.smithi164.stdout:19.0.0-3133.ga8c84f59.el9 2024-04-17T05:25:42.554 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3133.ga8c84f59.el9 2024-04-17T05:25:42.555 INFO:teuthology.task.install:The correct ceph version 19.0.0-3133.ga8c84f59 is installed. 2024-04-17T05:25:42.556 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-17T05:25:42.557 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-17T05:25:42.557 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-17T05:25:42.642 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-17T05:25:42.642 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-17T05:25:42.740 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-17T05:25:42.740 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-17T05:25:42.740 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/daemon-helper 2024-04-17T05:25:42.817 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-17T05:25:42.927 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-17T05:25:42.927 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/daemon-helper 2024-04-17T05:25:43.024 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-17T05:25:43.159 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-17T05:25:43.160 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-17T05:25:43.160 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-17T05:25:43.238 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-17T05:25:43.349 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-17T05:25:43.349 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-17T05:25:43.448 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-17T05:25:43.587 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-17T05:25:43.587 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-17T05:25:43.587 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/stdin-killer 2024-04-17T05:25:43.665 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-17T05:25:43.777 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-17T05:25:43.777 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/stdin-killer 2024-04-17T05:25:43.871 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-17T05:25:43.963 INFO:teuthology.run_tasks:Running task ceph... 2024-04-17T05:25:44.054 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-17T05:25:44.054 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 777 /var/log/ceph 2024-04-17T05:25:44.060 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 777 /var/log/ceph 2024-04-17T05:25:44.159 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-17T05:25:44.159 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-17T05:25:44.163 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-17T05:25:44.260 INFO:tasks.ceph:Creating extra log directories... 2024-04-17T05:25:44.261 DEBUG:teuthology.orchestra.run.smithi123:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-17T05:25:44.265 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-17T05:25:44.369 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-17T05:25:44.369 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-17T05:25:44.370 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-17T05:25:44.370 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-17T05:25:44.370 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-17T05:25:44.409 DEBUG:teuthology.orchestra.run.smithi123:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-17T05:25:44.626 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-17T05:25:44.697 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-17T05:25:44.698 DEBUG:teuthology.orchestra.run.smithi164:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-17T05:25:44.755 DEBUG:teuthology.orchestra.run.smithi164:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-17T05:25:45.026 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-17T05:25:45.131 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-17T05:25:45.132 INFO:tasks.ceph:config {'conf': {'client': {'client acl type': 'posix_acl', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-17T05:25:45.132 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659843', 'branch': 'wip-rishabh-testing-20240416.193735', 'description': 'fs/permission/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_misc}', 'email': None, 'first_in_suite': False, 'job_id': '7659843', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240416.193735'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client acl type': 'posix_acl', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240416.193735', 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 3521, 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda', 'sleep_before_teardown': 0, 'subset': '410/512', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240416.193735', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'a8c84f5997950fd7d008204839253291d52e6eda', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi123.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAdL68eAy9CzJlDJu+etqkdgVqxUyiv/bgcWuamJu5qIvE11quFoyFEKbOGMC7EK96u5Fv/O2JQGq16ZzGoswik=', 'smithi164.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEOJMShfa2DFVnjO7ErSJ4KmA9IJsNhWcCGcgrOaRkhNNGBaeS7KXKuk01Ai9wz/XTU0l6wEmFd8jKWBUnf4j/Q='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client acl type': 'posix_acl', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['fs/misc/acl.sh', 'fs/misc/chmod.sh', 'fs/misc/dac_override.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '6c637841c215537a4502385240412f1966e0faab', 'timestamp': '2024-04-17_04:58:44', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-17T05:25:45.132 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-17T05:25:45.138 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-17T05:25:45.192 DEBUG:teuthology.orchestra.run.smithi123:> sudo install -d -m0777 -- /var/run/ceph 2024-04-17T05:25:45.224 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/run/ceph 2024-04-17T05:25:45.325 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-17T05:25:45.325 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/scratch_devs of=/dev/stdout 2024-04-17T05:25:45.367 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-17T05:25:45.367 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_1 2024-04-17T05:25:45.447 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-17T05:25:45.447 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T05:25:45.447 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-04-17T05:25:45.447 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T05:25:45.447 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-04-17T05:25:45.448 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-04-17 05:25:34.008642039 +0000 2024-04-17T05:25:45.448 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-04-17 05:22:44.801823517 +0000 2024-04-17T05:25:45.448 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-04-17 05:22:44.801823517 +0000 2024-04-17T05:25:45.448 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-04-17 05:22:44.801823517 +0000 2024-04-17T05:25:45.448 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-17T05:25:45.558 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-04-17T05:25:45.559 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-04-17T05:25:45.559 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.00038461 s, 1.3 MB/s 2024-04-17T05:25:45.561 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-17T05:25:45.604 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_2 2024-04-17T05:25:45.697 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-17T05:25:45.697 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T05:25:45.697 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-04-17T05:25:45.697 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T05:25:45.698 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-04-17T05:25:45.698 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-04-17 05:25:34.009642016 +0000 2024-04-17T05:25:45.698 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-04-17 05:22:45.439808319 +0000 2024-04-17T05:25:45.698 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-04-17 05:22:45.439808319 +0000 2024-04-17T05:25:45.698 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-04-17 05:22:45.439808319 +0000 2024-04-17T05:25:45.698 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-17T05:25:45.784 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-04-17T05:25:45.784 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-04-17T05:25:45.784 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000320879 s, 1.6 MB/s 2024-04-17T05:25:45.787 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-17T05:25:45.843 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_3 2024-04-17T05:25:45.890 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-17T05:25:45.890 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T05:25:45.891 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-04-17T05:25:45.891 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T05:25:45.891 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-04-17T05:25:45.891 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-04-17 05:25:34.010641992 +0000 2024-04-17T05:25:45.891 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-04-17 05:22:46.046793858 +0000 2024-04-17T05:25:45.891 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-04-17 05:22:46.046793858 +0000 2024-04-17T05:25:45.891 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-04-17 05:22:46.046793858 +0000 2024-04-17T05:25:45.891 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-17T05:25:46.021 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-04-17T05:25:46.022 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-04-17T05:25:46.022 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000337716 s, 1.5 MB/s 2024-04-17T05:25:46.025 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-17T05:25:46.080 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_4 2024-04-17T05:25:46.127 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-17T05:25:46.127 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T05:25:46.128 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-04-17T05:25:46.128 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T05:25:46.128 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-04-17T05:25:46.128 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-04-17 05:25:34.011641969 +0000 2024-04-17T05:25:46.128 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-04-17 05:22:46.646779565 +0000 2024-04-17T05:25:46.128 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-04-17 05:22:46.646779565 +0000 2024-04-17T05:25:46.128 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-04-17 05:22:46.646779565 +0000 2024-04-17T05:25:46.128 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-17T05:25:46.210 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-04-17T05:25:46.210 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-04-17T05:25:46.211 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000382168 s, 1.3 MB/s 2024-04-17T05:25:46.214 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-17T05:25:46.268 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-17T05:25:46.268 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-17T05:25:46.268 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/scratch_devs of=/dev/stdout 2024-04-17T05:25:46.326 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-17T05:25:46.326 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_1 2024-04-17T05:25:46.378 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-17T05:25:46.379 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T05:25:46.379 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-04-17T05:25:46.379 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T05:25:46.379 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-04-17T05:25:46.379 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-04-17 05:25:28.593487052 +0000 2024-04-17T05:25:46.379 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-04-17 05:22:56.242973282 +0000 2024-04-17T05:25:46.379 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-04-17 05:22:56.242973282 +0000 2024-04-17T05:25:46.379 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-04-17 05:22:56.242973282 +0000 2024-04-17T05:25:46.379 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-17T05:25:46.472 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-04-17T05:25:46.472 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-04-17T05:25:46.473 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000352314 s, 1.5 MB/s 2024-04-17T05:25:46.477 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-17T05:25:46.534 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_2 2024-04-17T05:25:46.585 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-17T05:25:46.585 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T05:25:46.585 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-04-17T05:25:46.585 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T05:25:46.585 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-04-17T05:25:46.585 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-04-17 05:25:28.594487035 +0000 2024-04-17T05:25:46.586 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-04-17 05:22:56.861962886 +0000 2024-04-17T05:25:46.586 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-04-17 05:22:56.861962886 +0000 2024-04-17T05:25:46.586 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-04-17 05:22:56.861962886 +0000 2024-04-17T05:25:46.586 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-17T05:25:46.680 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-04-17T05:25:46.680 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-04-17T05:25:46.680 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000337404 s, 1.5 MB/s 2024-04-17T05:25:46.684 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-17T05:25:46.741 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_3 2024-04-17T05:25:46.792 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-17T05:25:46.792 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T05:25:46.792 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-04-17T05:25:46.792 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T05:25:46.792 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-04-17T05:25:46.793 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-04-17 05:25:28.595487019 +0000 2024-04-17T05:25:46.793 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-04-17 05:22:57.505952070 +0000 2024-04-17T05:25:46.793 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-04-17 05:22:57.505952070 +0000 2024-04-17T05:25:46.793 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-04-17 05:22:57.505952070 +0000 2024-04-17T05:25:46.793 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-17T05:25:46.882 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-04-17T05:25:46.882 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-04-17T05:25:46.882 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000304876 s, 1.7 MB/s 2024-04-17T05:25:46.886 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-17T05:25:46.941 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_4 2024-04-17T05:25:46.991 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-17T05:25:46.991 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T05:25:46.991 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-04-17T05:25:46.991 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T05:25:46.991 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-04-17T05:25:46.992 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-04-17 05:25:28.595487019 +0000 2024-04-17T05:25:46.992 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-04-17 05:22:58.119941757 +0000 2024-04-17T05:25:46.992 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-04-17 05:22:58.119941757 +0000 2024-04-17T05:25:46.992 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-04-17 05:22:58.119941757 +0000 2024-04-17T05:25:46.992 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-17T05:25:47.079 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-04-17T05:25:47.079 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-04-17T05:25:47.079 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000328917 s, 1.6 MB/s 2024-04-17T05:25:47.083 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-17T05:25:47.138 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-17T05:25:47.139 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi123.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi164.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-17T05:25:47.139 INFO:tasks.ceph:Generating config... 2024-04-17T05:25:47.140 INFO:tasks.ceph:[client] client acl type = posix_acl 2024-04-17T05:25:47.140 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-17T05:25:47.140 INFO:tasks.ceph:[client] debug client = 20 2024-04-17T05:25:47.140 INFO:tasks.ceph:[client] debug ms = 1 2024-04-17T05:25:47.140 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-17T05:25:47.140 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-17T05:25:47.140 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-17T05:25:47.141 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-17T05:25:47.141 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-17T05:25:47.141 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-17T05:25:47.141 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-17T05:25:47.141 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-17T05:25:47.141 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-17T05:25:47.141 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-17T05:25:47.141 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-17T05:25:47.141 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-17T05:25:47.141 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-17T05:25:47.141 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-17T05:25:47.141 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-17T05:25:47.141 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-17T05:25:47.141 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-17T05:25:47.142 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-17T05:25:47.142 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-17T05:25:47.142 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-17T05:25:47.142 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-17T05:25:47.142 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-17T05:25:47.142 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-17T05:25:47.142 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-17T05:25:47.142 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-17T05:25:47.142 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-17T05:25:47.142 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-17T05:25:47.142 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-17T05:25:47.142 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-17T05:25:47.142 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-17T05:25:47.143 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-17T05:25:47.143 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-17T05:25:47.143 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-17T05:25:47.143 INFO:tasks.ceph:Setting up mon.a... 2024-04-17T05:25:47.143 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-17T05:25:47.295 INFO:teuthology.orchestra.run.smithi123.stdout:creating /etc/ceph/ceph.keyring 2024-04-17T05:25:47.304 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-17T05:25:47.437 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-17T05:25:47.528 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.123'), ('mon.b', '172.21.15.164'), ('mon.c', '[v2:172.21.15.164:3301,v1:172.21.15.164:6790]')] 2024-04-17T05:25:47.528 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.123,172.21.15.164,[v2:172.21.15.164:3301,v1:172.21.15.164:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client acl type': 'posix_acl', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-17T05:25:47.529 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-17T05:25:47.529 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-17T05:25:47.583 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.123 --add b 172.21.15.164 --addv c '[v2:172.21.15.164:3301,v1:172.21.15.164:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-17T05:25:47.735 INFO:teuthology.orchestra.run.smithi123.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-17T05:25:47.735 INFO:teuthology.orchestra.run.smithi123.stdout:monmaptool: generated fsid 0787c5c0-e77a-4102-a899-30db48b19c68 2024-04-17T05:25:47.735 INFO:teuthology.orchestra.run.smithi123.stdout:setting min_mon_release = quincy 2024-04-17T05:25:47.735 INFO:teuthology.orchestra.run.smithi123.stdout:epoch 0 2024-04-17T05:25:47.735 INFO:teuthology.orchestra.run.smithi123.stdout:fsid 0787c5c0-e77a-4102-a899-30db48b19c68 2024-04-17T05:25:47.735 INFO:teuthology.orchestra.run.smithi123.stdout:last_changed 2024-04-17T05:25:47.737844+0000 2024-04-17T05:25:47.735 INFO:teuthology.orchestra.run.smithi123.stdout:created 2024-04-17T05:25:47.737844+0000 2024-04-17T05:25:47.735 INFO:teuthology.orchestra.run.smithi123.stdout:min_mon_release 17 (quincy) 2024-04-17T05:25:47.736 INFO:teuthology.orchestra.run.smithi123.stdout:election_strategy: 1 2024-04-17T05:25:47.736 INFO:teuthology.orchestra.run.smithi123.stdout:0: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.a 2024-04-17T05:25:47.736 INFO:teuthology.orchestra.run.smithi123.stdout:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2024-04-17T05:25:47.736 INFO:teuthology.orchestra.run.smithi123.stdout:2: [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] mon.c 2024-04-17T05:25:47.736 INFO:teuthology.orchestra.run.smithi123.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-17T05:25:47.738 DEBUG:teuthology.orchestra.run.smithi123:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-17T05:25:47.788 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0787c5c0-e77a-4102-a899-30db48b19c68... 2024-04-17T05:25:47.788 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-17T05:25:47.793 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-17T05:25:47.952 INFO:teuthology.orchestra.run.smithi123.stdout:[global] 2024-04-17T05:25:47.952 INFO:teuthology.orchestra.run.smithi123.stdout: chdir = "" 2024-04-17T05:25:47.952 INFO:teuthology.orchestra.run.smithi123.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-17T05:25:47.952 INFO:teuthology.orchestra.run.smithi123.stdout: auth supported = cephx 2024-04-17T05:25:47.952 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:47.953 INFO:teuthology.orchestra.run.smithi123.stdout: filestore xattr use omap = true 2024-04-17T05:25:47.953 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:47.953 INFO:teuthology.orchestra.run.smithi123.stdout: mon clock drift allowed = 1.000 2024-04-17T05:25:47.953 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:47.953 INFO:teuthology.orchestra.run.smithi123.stdout: osd crush chooseleaf type = 0 2024-04-17T05:25:47.953 INFO:teuthology.orchestra.run.smithi123.stdout: auth debug = true 2024-04-17T05:25:47.953 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:47.953 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on old message = true 2024-04-17T05:25:47.953 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on bug = true 2024-04-17T05:25:47.953 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:47.953 INFO:teuthology.orchestra.run.smithi123.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-17T05:25:47.953 INFO:teuthology.orchestra.run.smithi123.stdout: mon pg warn max object skew = 0 2024-04-17T05:25:47.953 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:47.953 INFO:teuthology.orchestra.run.smithi123.stdout: # disable pg_autoscaler by default for new pools 2024-04-17T05:25:47.954 INFO:teuthology.orchestra.run.smithi123.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-17T05:25:47.954 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:47.954 INFO:teuthology.orchestra.run.smithi123.stdout: osd pool default size = 2 2024-04-17T05:25:47.954 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:47.954 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd allow primary affinity = true 2024-04-17T05:25:47.954 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd allow pg remap = true 2024-04-17T05:25:47.954 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on legacy crush tunables = false 2024-04-17T05:25:47.954 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on crush straw calc version zero = false 2024-04-17T05:25:47.954 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on no sortbitwise = false 2024-04-17T05:25:47.954 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on osd down out interval zero = false 2024-04-17T05:25:47.954 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on too few osds = false 2024-04-17T05:25:47.954 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-17T05:25:47.954 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-17T05:25:47.954 INFO:teuthology.orchestra.run.smithi123.stdout: mon_allow_pool_size_one = true 2024-04-17T05:25:47.955 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:47.955 INFO:teuthology.orchestra.run.smithi123.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-17T05:25:47.955 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:47.955 INFO:teuthology.orchestra.run.smithi123.stdout: osd default data pool replay window = 5 2024-04-17T05:25:47.955 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:47.955 INFO:teuthology.orchestra.run.smithi123.stdout: mon allow pool delete = true 2024-04-17T05:25:47.955 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:47.955 INFO:teuthology.orchestra.run.smithi123.stdout: mon cluster log file level = debug 2024-04-17T05:25:47.955 INFO:teuthology.orchestra.run.smithi123.stdout: debug asserts on shutdown = true 2024-04-17T05:25:47.955 INFO:teuthology.orchestra.run.smithi123.stdout: mon health detail to clog = false 2024-04-17T05:25:47.955 INFO:teuthology.orchestra.run.smithi123.stdout: mon host = "172.21.15.123,172.21.15.164,[v2:172.21.15.164:3301,v1:172.21.15.164:6790]" 2024-04-17T05:25:47.955 INFO:teuthology.orchestra.run.smithi123.stdout: fsid = 0787c5c0-e77a-4102-a899-30db48b19c68 2024-04-17T05:25:47.955 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:47.955 INFO:teuthology.orchestra.run.smithi123.stdout:[osd] 2024-04-17T05:25:47.955 INFO:teuthology.orchestra.run.smithi123.stdout: osd journal size = 100 2024-04-17T05:25:47.956 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:47.956 INFO:teuthology.orchestra.run.smithi123.stdout: osd scrub load threshold = 5.0 2024-04-17T05:25:47.956 INFO:teuthology.orchestra.run.smithi123.stdout: osd scrub max interval = 600 2024-04-17T05:25:47.956 INFO:teuthology.orchestra.run.smithi123.stdout: osd mclock profile = high_recovery_ops 2024-04-17T05:25:47.956 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:47.956 INFO:teuthology.orchestra.run.smithi123.stdout: osd recover clone overlap = true 2024-04-17T05:25:47.956 INFO:teuthology.orchestra.run.smithi123.stdout: osd recovery max chunk = 1048576 2024-04-17T05:25:47.956 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:47.956 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug shutdown = true 2024-04-17T05:25:47.956 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug op order = true 2024-04-17T05:25:47.956 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug verify stray on activate = true 2024-04-17T05:25:47.956 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug trim objects = true 2024-04-17T05:25:47.956 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:47.956 INFO:teuthology.orchestra.run.smithi123.stdout: osd open classes on start = true 2024-04-17T05:25:47.956 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug pg log writeout = true 2024-04-17T05:25:47.957 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:47.957 INFO:teuthology.orchestra.run.smithi123.stdout: osd deep scrub update digest min age = 30 2024-04-17T05:25:47.957 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:47.957 INFO:teuthology.orchestra.run.smithi123.stdout: osd map max advance = 10 2024-04-17T05:25:47.957 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:47.957 INFO:teuthology.orchestra.run.smithi123.stdout: journal zero on create = true 2024-04-17T05:25:47.957 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:47.957 INFO:teuthology.orchestra.run.smithi123.stdout: filestore ondisk finisher threads = 3 2024-04-17T05:25:47.957 INFO:teuthology.orchestra.run.smithi123.stdout: filestore apply finisher threads = 3 2024-04-17T05:25:47.957 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:47.957 INFO:teuthology.orchestra.run.smithi123.stdout: bdev debug aio = true 2024-04-17T05:25:47.957 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug misdirected ops = true 2024-04-17T05:25:47.957 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore block size = 96636764160 2024-04-17T05:25:47.957 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore fsck on mount = True 2024-04-17T05:25:47.957 INFO:teuthology.orchestra.run.smithi123.stdout: debug bluefs = 20 2024-04-17T05:25:47.958 INFO:teuthology.orchestra.run.smithi123.stdout: debug bluestore = 20 2024-04-17T05:25:47.958 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-04-17T05:25:47.958 INFO:teuthology.orchestra.run.smithi123.stdout: debug osd = 20 2024-04-17T05:25:47.958 INFO:teuthology.orchestra.run.smithi123.stdout: debug rocksdb = 10 2024-04-17T05:25:47.958 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd backfillfull_ratio = 0.85 2024-04-17T05:25:47.958 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd full ratio = 0.9 2024-04-17T05:25:47.958 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd nearfull ratio = 0.8 2024-04-17T05:25:47.958 INFO:teuthology.orchestra.run.smithi123.stdout: osd failsafe full ratio = 0.95 2024-04-17T05:25:47.958 INFO:teuthology.orchestra.run.smithi123.stdout: osd objectstore = bluestore 2024-04-17T05:25:47.958 INFO:teuthology.orchestra.run.smithi123.stdout: osd op complaint time = 180 2024-04-17T05:25:47.958 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:47.958 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr] 2024-04-17T05:25:47.958 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-04-17T05:25:47.958 INFO:teuthology.orchestra.run.smithi123.stdout: debug mgr = 20 2024-04-17T05:25:47.959 INFO:teuthology.orchestra.run.smithi123.stdout: debug mon = 20 2024-04-17T05:25:47.959 INFO:teuthology.orchestra.run.smithi123.stdout: debug auth = 20 2024-04-17T05:25:47.959 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min pgs per osd = 4 2024-04-17T05:25:47.959 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min bytes per osd = 10 2024-04-17T05:25:47.959 INFO:teuthology.orchestra.run.smithi123.stdout: mgr/telemetry/nag = false 2024-04-17T05:25:47.959 INFO:teuthology.orchestra.run.smithi123.stdout: debug client = 20 2024-04-17T05:25:47.959 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:47.959 INFO:teuthology.orchestra.run.smithi123.stdout:[mon] 2024-04-17T05:25:47.959 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-04-17T05:25:47.959 INFO:teuthology.orchestra.run.smithi123.stdout: debug mon = 20 2024-04-17T05:25:47.959 INFO:teuthology.orchestra.run.smithi123.stdout: debug paxos = 20 2024-04-17T05:25:47.959 INFO:teuthology.orchestra.run.smithi123.stdout: debug auth = 20 2024-04-17T05:25:47.959 INFO:teuthology.orchestra.run.smithi123.stdout: mon data avail warn = 5 2024-04-17T05:25:47.959 INFO:teuthology.orchestra.run.smithi123.stdout: mon mgr mkfs grace = 240 2024-04-17T05:25:47.960 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min pgs per osd = 4 2024-04-17T05:25:47.960 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd reporter subtree level = osd 2024-04-17T05:25:47.960 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd prime pg temp = true 2024-04-17T05:25:47.960 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min bytes per osd = 10 2024-04-17T05:25:47.960 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:47.960 INFO:teuthology.orchestra.run.smithi123.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-17T05:25:47.960 INFO:teuthology.orchestra.run.smithi123.stdout: auth mon ticket ttl = 660 # 11m 2024-04-17T05:25:47.960 INFO:teuthology.orchestra.run.smithi123.stdout: auth service ticket ttl = 240 # 4m 2024-04-17T05:25:47.960 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:47.960 INFO:teuthology.orchestra.run.smithi123.stdout: # don't complain about insecure global_id in the test suite 2024-04-17T05:25:47.960 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-17T05:25:47.960 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-17T05:25:47.960 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:47.960 INFO:teuthology.orchestra.run.smithi123.stdout: # 1m isn't quite enough 2024-04-17T05:25:47.960 INFO:teuthology.orchestra.run.smithi123.stdout: mon_down_mkfs_grace = 2m 2024-04-17T05:25:47.961 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:47.961 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_filestore_osds = false 2024-04-17T05:25:47.961 INFO:teuthology.orchestra.run.smithi123.stdout: mon down mkfs grace = 300 2024-04-17T05:25:47.961 INFO:teuthology.orchestra.run.smithi123.stdout: mon op complaint time = 120 2024-04-17T05:25:47.961 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:25:47.961 INFO:teuthology.orchestra.run.smithi123.stdout:[client] 2024-04-17T05:25:47.961 INFO:teuthology.orchestra.run.smithi123.stdout: rgw cache enabled = true 2024-04-17T05:25:47.961 INFO:teuthology.orchestra.run.smithi123.stdout: rgw enable ops log = true 2024-04-17T05:25:47.961 INFO:teuthology.orchestra.run.smithi123.stdout: rgw enable usage log = true 2024-04-17T05:25:47.961 INFO:teuthology.orchestra.run.smithi123.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-17T05:25:47.961 INFO:teuthology.orchestra.run.smithi123.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-17T05:25:47.961 INFO:teuthology.orchestra.run.smithi123.stdout: client acl type = posix_acl 2024-04-17T05:25:47.961 INFO:teuthology.orchestra.run.smithi123.stdout: client mount timeout = 600 2024-04-17T05:25:47.961 INFO:teuthology.orchestra.run.smithi123.stdout: debug client = 20 2024-04-17T05:25:47.961 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-04-17T05:25:47.962 INFO:teuthology.orchestra.run.smithi123.stdout: rados mon op timeout = 900 2024-04-17T05:25:47.962 INFO:teuthology.orchestra.run.smithi123.stdout: rados osd op timeout = 900 2024-04-17T05:25:47.962 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.a] 2024-04-17T05:25:47.962 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.b] 2024-04-17T05:25:47.962 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.c] 2024-04-17T05:25:47.962 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.a] 2024-04-17T05:25:47.962 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.b] 2024-04-17T05:25:47.962 INFO:teuthology.orchestra.run.smithi123.stdout:[mds] 2024-04-17T05:25:47.962 INFO:teuthology.orchestra.run.smithi123.stdout: debug mds = 20 2024-04-17T05:25:47.962 INFO:teuthology.orchestra.run.smithi123.stdout: debug mds balancer = 20 2024-04-17T05:25:47.962 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-04-17T05:25:47.962 INFO:teuthology.orchestra.run.smithi123.stdout: mds debug frag = True 2024-04-17T05:25:47.962 INFO:teuthology.orchestra.run.smithi123.stdout: mds debug scatterstat = True 2024-04-17T05:25:47.962 INFO:teuthology.orchestra.run.smithi123.stdout: mds op complaint time = 180 2024-04-17T05:25:47.963 INFO:teuthology.orchestra.run.smithi123.stdout: mds verify scatter = True 2024-04-17T05:25:47.963 INFO:teuthology.orchestra.run.smithi123.stdout: osd op complaint time = 180 2024-04-17T05:25:47.963 INFO:teuthology.orchestra.run.smithi123.stdout: rados mon op timeout = 900 2024-04-17T05:25:47.963 INFO:teuthology.orchestra.run.smithi123.stdout: rados osd op timeout = 900 2024-04-17T05:25:47.970 INFO:teuthology.orchestra.run.smithi164.stdout:[global] 2024-04-17T05:25:47.971 INFO:teuthology.orchestra.run.smithi164.stdout: chdir = "" 2024-04-17T05:25:47.971 INFO:teuthology.orchestra.run.smithi164.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-17T05:25:47.971 INFO:teuthology.orchestra.run.smithi164.stdout: auth supported = cephx 2024-04-17T05:25:47.971 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:47.971 INFO:teuthology.orchestra.run.smithi164.stdout: filestore xattr use omap = true 2024-04-17T05:25:47.971 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:47.971 INFO:teuthology.orchestra.run.smithi164.stdout: mon clock drift allowed = 1.000 2024-04-17T05:25:47.971 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:47.971 INFO:teuthology.orchestra.run.smithi164.stdout: osd crush chooseleaf type = 0 2024-04-17T05:25:47.971 INFO:teuthology.orchestra.run.smithi164.stdout: auth debug = true 2024-04-17T05:25:47.971 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:47.971 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on old message = true 2024-04-17T05:25:47.971 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on bug = true 2024-04-17T05:25:47.971 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:47.972 INFO:teuthology.orchestra.run.smithi164.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-17T05:25:47.972 INFO:teuthology.orchestra.run.smithi164.stdout: mon pg warn max object skew = 0 2024-04-17T05:25:47.972 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:47.972 INFO:teuthology.orchestra.run.smithi164.stdout: # disable pg_autoscaler by default for new pools 2024-04-17T05:25:47.972 INFO:teuthology.orchestra.run.smithi164.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-17T05:25:47.972 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:47.972 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default size = 2 2024-04-17T05:25:47.972 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:47.972 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow primary affinity = true 2024-04-17T05:25:47.972 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow pg remap = true 2024-04-17T05:25:47.972 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on legacy crush tunables = false 2024-04-17T05:25:47.972 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on crush straw calc version zero = false 2024-04-17T05:25:47.972 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on no sortbitwise = false 2024-04-17T05:25:47.972 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on osd down out interval zero = false 2024-04-17T05:25:47.972 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on too few osds = false 2024-04-17T05:25:47.973 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-17T05:25:47.973 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-17T05:25:47.973 INFO:teuthology.orchestra.run.smithi164.stdout: mon_allow_pool_size_one = true 2024-04-17T05:25:47.973 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:47.973 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-17T05:25:47.973 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:47.973 INFO:teuthology.orchestra.run.smithi164.stdout: osd default data pool replay window = 5 2024-04-17T05:25:47.973 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:47.973 INFO:teuthology.orchestra.run.smithi164.stdout: mon allow pool delete = true 2024-04-17T05:25:47.973 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:47.973 INFO:teuthology.orchestra.run.smithi164.stdout: mon cluster log file level = debug 2024-04-17T05:25:47.973 INFO:teuthology.orchestra.run.smithi164.stdout: debug asserts on shutdown = true 2024-04-17T05:25:47.973 INFO:teuthology.orchestra.run.smithi164.stdout: mon health detail to clog = false 2024-04-17T05:25:47.973 INFO:teuthology.orchestra.run.smithi164.stdout: mon host = "172.21.15.123,172.21.15.164,[v2:172.21.15.164:3301,v1:172.21.15.164:6790]" 2024-04-17T05:25:47.974 INFO:teuthology.orchestra.run.smithi164.stdout: fsid = 0787c5c0-e77a-4102-a899-30db48b19c68 2024-04-17T05:25:47.974 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:47.974 INFO:teuthology.orchestra.run.smithi164.stdout:[osd] 2024-04-17T05:25:47.974 INFO:teuthology.orchestra.run.smithi164.stdout: osd journal size = 100 2024-04-17T05:25:47.974 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:47.974 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub load threshold = 5.0 2024-04-17T05:25:47.974 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub max interval = 600 2024-04-17T05:25:47.974 INFO:teuthology.orchestra.run.smithi164.stdout: osd mclock profile = high_recovery_ops 2024-04-17T05:25:47.974 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:47.974 INFO:teuthology.orchestra.run.smithi164.stdout: osd recover clone overlap = true 2024-04-17T05:25:47.974 INFO:teuthology.orchestra.run.smithi164.stdout: osd recovery max chunk = 1048576 2024-04-17T05:25:47.974 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:47.974 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug shutdown = true 2024-04-17T05:25:47.974 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug op order = true 2024-04-17T05:25:47.975 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug verify stray on activate = true 2024-04-17T05:25:47.975 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug trim objects = true 2024-04-17T05:25:47.975 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:47.975 INFO:teuthology.orchestra.run.smithi164.stdout: osd open classes on start = true 2024-04-17T05:25:47.975 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug pg log writeout = true 2024-04-17T05:25:47.975 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:47.975 INFO:teuthology.orchestra.run.smithi164.stdout: osd deep scrub update digest min age = 30 2024-04-17T05:25:47.975 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:47.975 INFO:teuthology.orchestra.run.smithi164.stdout: osd map max advance = 10 2024-04-17T05:25:47.975 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:47.975 INFO:teuthology.orchestra.run.smithi164.stdout: journal zero on create = true 2024-04-17T05:25:47.975 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:47.975 INFO:teuthology.orchestra.run.smithi164.stdout: filestore ondisk finisher threads = 3 2024-04-17T05:25:47.975 INFO:teuthology.orchestra.run.smithi164.stdout: filestore apply finisher threads = 3 2024-04-17T05:25:47.976 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:47.976 INFO:teuthology.orchestra.run.smithi164.stdout: bdev debug aio = true 2024-04-17T05:25:47.976 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug misdirected ops = true 2024-04-17T05:25:47.976 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore block size = 96636764160 2024-04-17T05:25:47.976 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore fsck on mount = True 2024-04-17T05:25:47.976 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluefs = 20 2024-04-17T05:25:47.976 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluestore = 20 2024-04-17T05:25:47.976 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-04-17T05:25:47.976 INFO:teuthology.orchestra.run.smithi164.stdout: debug osd = 20 2024-04-17T05:25:47.976 INFO:teuthology.orchestra.run.smithi164.stdout: debug rocksdb = 10 2024-04-17T05:25:47.976 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd backfillfull_ratio = 0.85 2024-04-17T05:25:47.976 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd full ratio = 0.9 2024-04-17T05:25:47.976 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd nearfull ratio = 0.8 2024-04-17T05:25:47.976 INFO:teuthology.orchestra.run.smithi164.stdout: osd failsafe full ratio = 0.95 2024-04-17T05:25:47.976 INFO:teuthology.orchestra.run.smithi164.stdout: osd objectstore = bluestore 2024-04-17T05:25:47.977 INFO:teuthology.orchestra.run.smithi164.stdout: osd op complaint time = 180 2024-04-17T05:25:47.977 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:47.977 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr] 2024-04-17T05:25:47.977 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-04-17T05:25:47.977 INFO:teuthology.orchestra.run.smithi164.stdout: debug mgr = 20 2024-04-17T05:25:47.977 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-04-17T05:25:47.977 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-04-17T05:25:47.977 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-04-17T05:25:47.977 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-04-17T05:25:47.977 INFO:teuthology.orchestra.run.smithi164.stdout: mgr/telemetry/nag = false 2024-04-17T05:25:47.977 INFO:teuthology.orchestra.run.smithi164.stdout: debug client = 20 2024-04-17T05:25:47.977 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:47.977 INFO:teuthology.orchestra.run.smithi164.stdout:[mon] 2024-04-17T05:25:47.977 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-04-17T05:25:47.978 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-04-17T05:25:47.978 INFO:teuthology.orchestra.run.smithi164.stdout: debug paxos = 20 2024-04-17T05:25:47.978 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-04-17T05:25:47.978 INFO:teuthology.orchestra.run.smithi164.stdout: mon data avail warn = 5 2024-04-17T05:25:47.978 INFO:teuthology.orchestra.run.smithi164.stdout: mon mgr mkfs grace = 240 2024-04-17T05:25:47.978 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-04-17T05:25:47.978 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd reporter subtree level = osd 2024-04-17T05:25:47.978 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd prime pg temp = true 2024-04-17T05:25:47.978 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-04-17T05:25:47.978 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:47.978 INFO:teuthology.orchestra.run.smithi164.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-17T05:25:47.978 INFO:teuthology.orchestra.run.smithi164.stdout: auth mon ticket ttl = 660 # 11m 2024-04-17T05:25:47.978 INFO:teuthology.orchestra.run.smithi164.stdout: auth service ticket ttl = 240 # 4m 2024-04-17T05:25:47.978 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:47.979 INFO:teuthology.orchestra.run.smithi164.stdout: # don't complain about insecure global_id in the test suite 2024-04-17T05:25:47.979 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-17T05:25:47.979 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-17T05:25:47.979 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:47.979 INFO:teuthology.orchestra.run.smithi164.stdout: # 1m isn't quite enough 2024-04-17T05:25:47.979 INFO:teuthology.orchestra.run.smithi164.stdout: mon_down_mkfs_grace = 2m 2024-04-17T05:25:47.979 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:47.979 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_filestore_osds = false 2024-04-17T05:25:47.979 INFO:teuthology.orchestra.run.smithi164.stdout: mon down mkfs grace = 300 2024-04-17T05:25:47.979 INFO:teuthology.orchestra.run.smithi164.stdout: mon op complaint time = 120 2024-04-17T05:25:47.979 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-17T05:25:47.979 INFO:teuthology.orchestra.run.smithi164.stdout:[client] 2024-04-17T05:25:47.979 INFO:teuthology.orchestra.run.smithi164.stdout: rgw cache enabled = true 2024-04-17T05:25:47.979 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable ops log = true 2024-04-17T05:25:47.980 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable usage log = true 2024-04-17T05:25:47.980 INFO:teuthology.orchestra.run.smithi164.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-17T05:25:47.980 INFO:teuthology.orchestra.run.smithi164.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-17T05:25:47.980 INFO:teuthology.orchestra.run.smithi164.stdout: client acl type = posix_acl 2024-04-17T05:25:47.980 INFO:teuthology.orchestra.run.smithi164.stdout: client mount timeout = 600 2024-04-17T05:25:47.980 INFO:teuthology.orchestra.run.smithi164.stdout: debug client = 20 2024-04-17T05:25:47.980 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-04-17T05:25:47.980 INFO:teuthology.orchestra.run.smithi164.stdout: rados mon op timeout = 900 2024-04-17T05:25:47.980 INFO:teuthology.orchestra.run.smithi164.stdout: rados osd op timeout = 900 2024-04-17T05:25:47.980 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.a] 2024-04-17T05:25:47.980 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.b] 2024-04-17T05:25:47.980 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.c] 2024-04-17T05:25:47.980 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.a] 2024-04-17T05:25:47.980 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.b] 2024-04-17T05:25:47.980 INFO:teuthology.orchestra.run.smithi164.stdout:[mds] 2024-04-17T05:25:47.981 INFO:teuthology.orchestra.run.smithi164.stdout: debug mds = 20 2024-04-17T05:25:47.981 INFO:teuthology.orchestra.run.smithi164.stdout: debug mds balancer = 20 2024-04-17T05:25:47.981 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-04-17T05:25:47.981 INFO:teuthology.orchestra.run.smithi164.stdout: mds debug frag = True 2024-04-17T05:25:47.981 INFO:teuthology.orchestra.run.smithi164.stdout: mds debug scatterstat = True 2024-04-17T05:25:47.981 INFO:teuthology.orchestra.run.smithi164.stdout: mds op complaint time = 180 2024-04-17T05:25:47.981 INFO:teuthology.orchestra.run.smithi164.stdout: mds verify scatter = True 2024-04-17T05:25:47.981 INFO:teuthology.orchestra.run.smithi164.stdout: osd op complaint time = 180 2024-04-17T05:25:47.981 INFO:teuthology.orchestra.run.smithi164.stdout: rados mon op timeout = 900 2024-04-17T05:25:47.981 INFO:teuthology.orchestra.run.smithi164.stdout: rados osd op timeout = 900 2024-04-17T05:25:48.015 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-17T05:25:48.015 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-17T05:25:48.152 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-17T05:25:48.152 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-17T05:25:48.153 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-17T05:25:48.202 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-17T05:25:48.202 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-17T05:25:48.298 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi123.front.sepia.ceph.com 2024-04-17T05:25:48.298 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-17T05:25:48.298 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-17T05:25:48.298 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-17T05:25:48.440 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-17T05:25:48.441 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-17T05:25:48.539 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi164.front.sepia.ceph.com 2024-04-17T05:25:48.539 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-17T05:25:48.539 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-17T05:25:48.539 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-17T05:25:48.692 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-17T05:25:48.692 DEBUG:teuthology.orchestra.run.smithi164:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-17T05:25:48.786 INFO:tasks.ceph:Setting up mon nodes... 2024-04-17T05:25:48.786 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-17T05:25:48.786 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-17T05:25:48.970 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-17T05:25:48.980 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-17T05:25:49.184 INFO:teuthology.orchestra.run.smithi164.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-17T05:25:49.196 INFO:tasks.ceph:Setting up mds nodes... 2024-04-17T05:25:49.196 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-17T05:25:49.379 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-17T05:25:49.389 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-17T05:25:49.487 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-17T05:25:49.664 INFO:teuthology.orchestra.run.smithi164.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-17T05:25:49.674 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-17T05:25:49.768 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-17T05:25:49.768 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-17T05:25:49.897 INFO:teuthology.orchestra.run.smithi123.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-17T05:25:49.954 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-17T05:25:49.955 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi123.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi164.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-17T05:25:49.955 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-17T05:25:50.054 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-17T05:25:50.055 INFO:tasks.ceph:role: osd.0 2024-04-17T05:25:50.055 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi123.front.sepia.ceph.com 2024-04-17T05:25:50.055 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-17T05:25:50.153 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T05:25:50.153 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T05:25:50.153 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T05:25:50.153 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-17T05:25:50.153 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T05:25:50.153 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2024-04-17T05:25:50.153 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T05:25:50.154 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-17T05:25:50.154 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T05:25:50.154 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T05:25:50.568 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2024-04-17T05:25:50.575 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2024-04-17T05:25:50.575 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-17T05:25:50.744 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-17T05:25:50.847 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-17T05:25:50.933 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-17T05:25:50.933 INFO:tasks.ceph:role: osd.1 2024-04-17T05:25:50.933 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi123.front.sepia.ceph.com 2024-04-17T05:25:50.933 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-17T05:25:51.019 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T05:25:51.019 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T05:25:51.019 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T05:25:51.019 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-17T05:25:51.019 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T05:25:51.019 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2024-04-17T05:25:51.019 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T05:25:51.020 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-17T05:25:51.020 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T05:25:51.020 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T05:25:51.403 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2024-04-17T05:25:51.410 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2024-04-17T05:25:51.410 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-17T05:25:51.531 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-17T05:25:51.608 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-17T05:25:51.685 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-17T05:25:51.686 INFO:tasks.ceph:role: osd.2 2024-04-17T05:25:51.686 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi123.front.sepia.ceph.com 2024-04-17T05:25:51.686 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-17T05:25:51.768 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T05:25:51.769 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T05:25:51.769 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T05:25:51.769 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-17T05:25:51.769 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T05:25:51.769 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2024-04-17T05:25:51.769 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T05:25:51.769 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-17T05:25:51.769 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T05:25:51.769 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T05:25:52.192 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2024-04-17T05:25:52.198 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2024-04-17T05:25:52.198 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-17T05:25:52.371 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-17T05:25:52.453 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-17T05:25:52.537 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-17T05:25:52.537 INFO:tasks.ceph:role: osd.3 2024-04-17T05:25:52.537 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi123.front.sepia.ceph.com 2024-04-17T05:25:52.537 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-17T05:25:52.632 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T05:25:52.632 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T05:25:52.632 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T05:25:52.632 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-17T05:25:52.632 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T05:25:52.632 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2024-04-17T05:25:52.633 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T05:25:52.633 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-17T05:25:52.633 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T05:25:52.633 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T05:25:53.041 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2024-04-17T05:25:53.047 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2024-04-17T05:25:53.047 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-17T05:25:53.167 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-17T05:25:53.246 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T05:25:53.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:25:53.386+0000 7fdd5c40f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-17T05:25:53.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:25:53.386+0000 7fdd5c40f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-17T05:25:53.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:25:53.387+0000 7fdd5c40f640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-17T05:25:53.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:25:53.387+0000 7fdd5c40f640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-17T05:25:53.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:25:53.387+0000 7fdd5c40f640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-17T05:25:53.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:25:53.390+0000 7fdd5c40f640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-17T05:25:56.620 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-17T05:25:56.717 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T05:25:56.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:25:56.845+0000 7f4a046f9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-17T05:25:56.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:25:56.846+0000 7f4a046f9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-17T05:25:56.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:25:56.846+0000 7f4a046f9640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-17T05:25:56.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:25:56.846+0000 7f4a046f9640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-17T05:25:56.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:25:56.846+0000 7f4a046f9640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-17T05:25:56.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:25:56.848+0000 7f4a046f9640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-17T05:25:59.809 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-17T05:25:59.903 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T05:26:00.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:00.042+0000 7f903b2b5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-17T05:26:00.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:00.043+0000 7f903b2b5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-17T05:26:00.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:00.043+0000 7f903b2b5640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-17T05:26:00.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:00.043+0000 7f903b2b5640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-17T05:26:00.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:00.043+0000 7f903b2b5640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-17T05:26:00.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:00.045+0000 7f903b2b5640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-17T05:26:03.040 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-17T05:26:03.134 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T05:26:03.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:03.276+0000 7f412a61c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-17T05:26:03.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:03.277+0000 7f412a61c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-17T05:26:03.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:03.277+0000 7f412a61c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-17T05:26:03.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:03.277+0000 7f412a61c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-17T05:26:03.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:03.277+0000 7f412a61c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-17T05:26:03.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:03.280+0000 7f412a61c640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-17T05:26:06.238 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-17T05:26:06.336 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-17T05:26:06.435 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-17T05:26:06.436 INFO:tasks.ceph:role: osd.4 2024-04-17T05:26:06.436 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi164.front.sepia.ceph.com 2024-04-17T05:26:06.436 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-17T05:26:06.534 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T05:26:06.534 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T05:26:06.534 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T05:26:06.534 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-17T05:26:06.534 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T05:26:06.534 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-04-17T05:26:06.534 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T05:26:06.534 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-17T05:26:06.535 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T05:26:06.535 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T05:26:06.942 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2024-04-17T05:26:06.950 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-04-17T05:26:06.950 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-17T05:26:07.106 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-17T05:26:07.198 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-17T05:26:07.289 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-17T05:26:07.289 INFO:tasks.ceph:role: osd.5 2024-04-17T05:26:07.289 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi164.front.sepia.ceph.com 2024-04-17T05:26:07.290 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-17T05:26:07.387 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T05:26:07.387 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T05:26:07.387 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T05:26:07.388 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-17T05:26:07.388 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T05:26:07.388 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-04-17T05:26:07.388 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T05:26:07.388 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-17T05:26:07.388 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T05:26:07.388 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T05:26:07.747 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2024-04-17T05:26:07.755 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-04-17T05:26:07.755 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-17T05:26:07.893 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-17T05:26:07.985 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-17T05:26:08.080 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-17T05:26:08.080 INFO:tasks.ceph:role: osd.6 2024-04-17T05:26:08.080 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi164.front.sepia.ceph.com 2024-04-17T05:26:08.081 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-17T05:26:08.177 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T05:26:08.177 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T05:26:08.177 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T05:26:08.177 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-17T05:26:08.177 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T05:26:08.177 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-04-17T05:26:08.177 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T05:26:08.177 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-17T05:26:08.177 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T05:26:08.177 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T05:26:08.593 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2024-04-17T05:26:08.599 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-04-17T05:26:08.600 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-17T05:26:08.773 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-17T05:26:08.872 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-17T05:26:08.970 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-17T05:26:08.970 INFO:tasks.ceph:role: osd.7 2024-04-17T05:26:08.970 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi164.front.sepia.ceph.com 2024-04-17T05:26:08.970 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-17T05:26:09.067 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T05:26:09.067 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T05:26:09.068 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T05:26:09.068 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-17T05:26:09.068 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T05:26:09.068 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-04-17T05:26:09.068 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T05:26:09.068 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-17T05:26:09.068 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T05:26:09.068 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T05:26:09.451 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2024-04-17T05:26:09.458 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-04-17T05:26:09.458 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-17T05:26:09.581 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-17T05:26:09.677 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T05:26:09.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:09.831+0000 7f6bd6e89640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-17T05:26:09.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:09.832+0000 7f6bd6e89640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-17T05:26:09.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:09.832+0000 7f6bd6e89640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-17T05:26:09.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:09.832+0000 7f6bd6e89640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-17T05:26:09.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:09.832+0000 7f6bd6e89640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-17T05:26:09.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:09.836+0000 7f6bd6e89640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-17T05:26:13.059 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-17T05:26:13.155 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T05:26:13.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:13.292+0000 7f8773411640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-17T05:26:13.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:13.293+0000 7f8773411640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-17T05:26:13.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:13.293+0000 7f8773411640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-17T05:26:13.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:13.293+0000 7f8773411640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-17T05:26:13.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:13.293+0000 7f8773411640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-17T05:26:13.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:13.295+0000 7f8773411640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-17T05:26:15.133 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:26:15.141 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:26:16.263 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-17T05:26:16.359 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T05:26:16.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:16.498+0000 7f5d5e019640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-17T05:26:16.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:16.498+0000 7f5d5e019640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-17T05:26:16.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:16.499+0000 7f5d5e019640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-17T05:26:16.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:16.499+0000 7f5d5e019640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-17T05:26:16.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:16.499+0000 7f5d5e019640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-17T05:26:16.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:16.501+0000 7f5d5e019640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-17T05:26:19.702 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-17T05:26:19.803 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T05:26:19.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:19.941+0000 7ff44bc48640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-17T05:26:19.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:19.942+0000 7ff44bc48640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-17T05:26:19.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:19.942+0000 7ff44bc48640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-17T05:26:19.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:19.942+0000 7ff44bc48640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-17T05:26:19.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:19.942+0000 7ff44bc48640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-17T05:26:19.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:19.945+0000 7ff44bc48640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-17T05:26:23.157 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-17T05:26:23.257 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-17T05:26:23.257 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-17T05:26:23.257 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-17T05:26:23.356 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-17T05:26:23.356 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-17T05:26:23.448 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-17T05:26:23.449 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-17T05:26:23.543 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-17T05:26:23.543 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-17T05:26:23.638 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-17T05:26:23.638 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-17T05:26:23.732 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-17T05:26:23.732 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-17T05:26:23.825 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-17T05:26:23.825 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-17T05:26:23.924 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-17T05:26:23.924 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-17T05:26:24.017 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-17T05:26:24.017 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-17T05:26:24.102 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-17T05:26:24.102 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-17T05:26:24.240 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-17T05:26:24.240 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-17T05:26:24.332 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-17T05:26:24.332 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-17T05:26:24.427 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-17T05:26:24.427 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-17T05:26:24.484 INFO:tasks.ceph:Adding keys to all mons... 2024-04-17T05:26:24.484 DEBUG:teuthology.orchestra.run.smithi123:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-17T05:26:24.491 DEBUG:teuthology.orchestra.run.smithi164:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-17T05:26:24.571 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr.y] 2024-04-17T05:26:24.571 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBcXR9m5z38ORAAH7Lq8/AzamySGO14MvNlEA== 2024-04-17T05:26:24.571 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.a] 2024-04-17T05:26:24.571 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBdXR9mf/XCFhAAajDdOArLt0avbjp9/zyRCg== 2024-04-17T05:26:24.571 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.0] 2024-04-17T05:26:24.571 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBhXR9m0JgOFxAAh3p4+42xD/gqcfaP/6naQw== 2024-04-17T05:26:24.571 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.1] 2024-04-17T05:26:24.572 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBkXR9mEDF0MhAAJICaQ9PwXpNeBiAtzFmFEQ== 2024-04-17T05:26:24.572 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.2] 2024-04-17T05:26:24.572 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBoXR9mqzaVAhAAqvcS7ysRCgfeKrb2M2SlIg== 2024-04-17T05:26:24.572 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.3] 2024-04-17T05:26:24.572 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBrXR9mAv+aEBAAj5hyrZgf/R8OqmWkKTd/Mw== 2024-04-17T05:26:24.572 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr.x] 2024-04-17T05:26:24.572 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBdXR9mqQorCxAA/C7ZWh7xSC/NinhGMm3tnw== 2024-04-17T05:26:24.572 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.b] 2024-04-17T05:26:24.572 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBdXR9mwnjCJxAAxJwFbM0ltQ6olIw/5lQGww== 2024-04-17T05:26:24.572 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.4] 2024-04-17T05:26:24.572 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBxXR9ms2ulMRAAQKmEDZPGBXYOHCk1qWoZcw== 2024-04-17T05:26:24.572 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.5] 2024-04-17T05:26:24.572 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQB1XR9mAQmHERAAvRhf+APzRy11pzR+bBnu0Q== 2024-04-17T05:26:24.572 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.6] 2024-04-17T05:26:24.572 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQB4XR9m8QXIHRAAcfWhOrgb/v06aBJjgjEpQg== 2024-04-17T05:26:24.573 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.7] 2024-04-17T05:26:24.573 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQB7XR9mbMQ3OBAAdYL69GmIFE+2ErsmR4OYuQ== 2024-04-17T05:26:24.573 INFO:teuthology.orchestra.run.smithi123.stdout:[client.0] 2024-04-17T05:26:24.573 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBdXR9mtxqqNRAA4eVLSXqcH5ASHtf0zsx1Wg== 2024-04-17T05:26:24.577 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr.y] 2024-04-17T05:26:24.577 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBcXR9m5z38ORAAH7Lq8/AzamySGO14MvNlEA== 2024-04-17T05:26:24.577 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.a] 2024-04-17T05:26:24.577 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBdXR9mf/XCFhAAajDdOArLt0avbjp9/zyRCg== 2024-04-17T05:26:24.577 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.0] 2024-04-17T05:26:24.577 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBhXR9m0JgOFxAAh3p4+42xD/gqcfaP/6naQw== 2024-04-17T05:26:24.577 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.1] 2024-04-17T05:26:24.578 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBkXR9mEDF0MhAAJICaQ9PwXpNeBiAtzFmFEQ== 2024-04-17T05:26:24.578 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.2] 2024-04-17T05:26:24.578 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBoXR9mqzaVAhAAqvcS7ysRCgfeKrb2M2SlIg== 2024-04-17T05:26:24.578 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.3] 2024-04-17T05:26:24.578 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBrXR9mAv+aEBAAj5hyrZgf/R8OqmWkKTd/Mw== 2024-04-17T05:26:24.578 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr.x] 2024-04-17T05:26:24.578 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBdXR9mqQorCxAA/C7ZWh7xSC/NinhGMm3tnw== 2024-04-17T05:26:24.578 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.b] 2024-04-17T05:26:24.578 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBdXR9mwnjCJxAAxJwFbM0ltQ6olIw/5lQGww== 2024-04-17T05:26:24.578 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.4] 2024-04-17T05:26:24.578 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBxXR9ms2ulMRAAQKmEDZPGBXYOHCk1qWoZcw== 2024-04-17T05:26:24.578 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.5] 2024-04-17T05:26:24.578 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQB1XR9mAQmHERAAvRhf+APzRy11pzR+bBnu0Q== 2024-04-17T05:26:24.578 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.6] 2024-04-17T05:26:24.579 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQB4XR9m8QXIHRAAcfWhOrgb/v06aBJjgjEpQg== 2024-04-17T05:26:24.579 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.7] 2024-04-17T05:26:24.579 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQB7XR9mbMQ3OBAAdYL69GmIFE+2ErsmR4OYuQ== 2024-04-17T05:26:24.579 INFO:teuthology.orchestra.run.smithi164.stdout:[client.0] 2024-04-17T05:26:24.579 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQBdXR9mtxqqNRAA4eVLSXqcH5ASHtf0zsx1Wg== 2024-04-17T05:26:24.580 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-17T05:26:24.622 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-17T05:26:24.760 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T05:26:24.765 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T05:26:24.909 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T05:26:24.914 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T05:26:25.059 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T05:26:25.066 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T05:26:25.210 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T05:26:25.214 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T05:26:25.365 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T05:26:25.379 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T05:26:25.514 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-17T05:26:25.522 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-17T05:26:25.666 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T05:26:25.671 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T05:26:25.819 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T05:26:25.826 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T05:26:25.966 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T05:26:25.974 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T05:26:26.117 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T05:26:26.124 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T05:26:26.273 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T05:26:26.280 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T05:26:26.425 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-17T05:26:26.430 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-17T05:26:26.570 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-17T05:26:26.570 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-17T05:26:26.663 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-17T05:26:26.818 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-17T05:26:26.898 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-17T05:26:26.995 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-17T05:26:27.147 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-17T05:26:27.222 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-17T05:26:27.310 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-17T05:26:27.464 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-17T05:26:27.542 DEBUG:teuthology.orchestra.run.smithi123:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-17T05:26:27.549 DEBUG:teuthology.orchestra.run.smithi164:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-17T05:26:27.600 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-17T05:26:27.601 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-17T05:26:27.601 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-17T05:26:27.605 INFO:tasks.ceph.mon.a:Started 2024-04-17T05:26:27.606 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-17T05:26:27.606 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-17T05:26:27.612 INFO:tasks.ceph.mon.b:Started 2024-04-17T05:26:27.613 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-17T05:26:27.613 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-17T05:26:27.619 INFO:tasks.ceph.mon.c:Started 2024-04-17T05:26:27.620 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-17T05:26:27.620 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-17T05:26:27.620 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-17T05:26:27.624 INFO:tasks.ceph.mgr.y:Started 2024-04-17T05:26:27.625 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-17T05:26:27.625 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-17T05:26:27.631 INFO:tasks.ceph.mgr.x:Started 2024-04-17T05:26:27.631 INFO:tasks.ceph:Setting crush tunables to default 2024-04-17T05:26:27.631 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd crush tunables default 2024-04-17T05:26:27.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:27.814+0000 7fcca4e00640 1 Processor -- start 2024-04-17T05:26:27.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:27.814+0000 7fcca4e00640 1 -- start start 2024-04-17T05:26:27.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:27.815+0000 7fcca4e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcca00b58b0 0x7fcca00b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:27.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:27.815+0000 7fcca4e00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fcca00b7e90 0x7fcca01486a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:27.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:27.815+0000 7fcca4e00640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcca00b5c90 con 0x7fcca014b1d0 2024-04-17T05:26:27.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:27.815+0000 7fcca4e00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fcca0148210 con 0x7fcca00b58b0 2024-04-17T05:26:27.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:27.815+0000 7fcca4e00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7fcca00b67a0 con 0x7fcca00b7e90 2024-04-17T05:26:27.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:27.816+0000 7fcc9de00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcca00b58b0 0x7fcca00b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:27.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:27.816+0000 7fcc9de00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcca00b58b0 0x7fcca00b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60838/0 (socket says 172.21.15.123:60838) 2024-04-17T05:26:27.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:27.816+0000 7fcc9de00640 1 -- 172.21.15.123:0/3195805890 learned_addr learned my addr 172.21.15.123:0/3195805890 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:26:27.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:27.816+0000 7fcc95400640 1 --2- 172.21.15.123:0/3195805890 >> v2:172.21.15.164:3300/0 conn(0x7fcca00b7e90 0x7fcca01486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:27.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:27.816+0000 7fcc9de00640 1 -- 172.21.15.123:0/3195805890 >> v2:172.21.15.123:3300/0 conn(0x7fcca00b58b0 msgr2=0x7fcca00b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-17T05:26:27.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:27.816+0000 7fcc9de00640 1 -- 172.21.15.123:0/3195805890 >> v2:172.21.15.123:3300/0 conn(0x7fcca00b58b0 msgr2=0x7fcca00b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T05:26:27.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:27.816+0000 7fcc9de00640 1 --2- 172.21.15.123:0/3195805890 >> v2:172.21.15.123:3300/0 conn(0x7fcca00b58b0 0x7fcca00b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T05:26:27.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:27.816+0000 7fcc9de00640 1 --2- 172.21.15.123:0/3195805890 >> v2:172.21.15.123:3300/0 conn(0x7fcca00b58b0 0x7fcca00b6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T05:26:27.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:27.816+0000 7fcc95400640 1 -- 172.21.15.123:0/3195805890 >> v2:172.21.15.164:3300/0 conn(0x7fcca00b7e90 msgr2=0x7fcca01486a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T05:26:27.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:27.816+0000 7fcc95400640 1 -- 172.21.15.123:0/3195805890 >> v2:172.21.15.164:3300/0 conn(0x7fcca00b7e90 msgr2=0x7fcca01486a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T05:26:27.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:27.816+0000 7fcc95400640 1 --2- 172.21.15.123:0/3195805890 >> v2:172.21.15.164:3300/0 conn(0x7fcca00b7e90 0x7fcca01486a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T05:26:27.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:27.816+0000 7fcc95400640 1 --2- 172.21.15.123:0/3195805890 >> v2:172.21.15.164:3300/0 conn(0x7fcca00b7e90 0x7fcca01486a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T05:26:28.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:28.017+0000 7fcc9de00640 1 --2- 172.21.15.123:0/3195805890 >> v2:172.21.15.123:3300/0 conn(0x7fcca00b58b0 0x7fcca00b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:28.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:28.017+0000 7fcc95400640 1 --2- 172.21.15.123:0/3195805890 >> v2:172.21.15.164:3300/0 conn(0x7fcca00b7e90 0x7fcca01486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:28.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:28.018+0000 7fcc9de00640 1 -- 172.21.15.123:0/3195805890 >> v2:172.21.15.123:3300/0 conn(0x7fcca00b58b0 msgr2=0x7fcca00b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T05:26:28.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:28.018+0000 7fcc9de00640 1 -- 172.21.15.123:0/3195805890 >> v2:172.21.15.123:3300/0 conn(0x7fcca00b58b0 msgr2=0x7fcca00b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T05:26:28.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:28.018+0000 7fcc9de00640 1 --2- 172.21.15.123:0/3195805890 >> v2:172.21.15.123:3300/0 conn(0x7fcca00b58b0 0x7fcca00b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T05:26:28.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:28.018+0000 7fcc95400640 1 -- 172.21.15.123:0/3195805890 >> v2:172.21.15.164:3300/0 conn(0x7fcca00b7e90 msgr2=0x7fcca01486a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-17T05:26:28.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:28.018+0000 7fcc95400640 1 -- 172.21.15.123:0/3195805890 >> v2:172.21.15.164:3300/0 conn(0x7fcca00b7e90 msgr2=0x7fcca01486a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T05:26:28.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:28.018+0000 7fcc95400640 1 --2- 172.21.15.123:0/3195805890 >> v2:172.21.15.164:3300/0 conn(0x7fcca00b7e90 0x7fcca01486a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T05:26:28.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:28.018+0000 7fcc9de00640 1 --2- 172.21.15.123:0/3195805890 >> v2:172.21.15.123:3300/0 conn(0x7fcca00b58b0 0x7fcca00b6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T05:26:28.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:28.018+0000 7fcc95400640 1 --2- 172.21.15.123:0/3195805890 >> v2:172.21.15.164:3300/0 conn(0x7fcca00b7e90 0x7fcca01486a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T05:26:28.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:28.419+0000 7fcc9de00640 1 --2- 172.21.15.123:0/3195805890 >> v2:172.21.15.123:3300/0 conn(0x7fcca00b58b0 0x7fcca00b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:28.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:28.419+0000 7fcc95400640 1 --2- 172.21.15.123:0/3195805890 >> v2:172.21.15.164:3300/0 conn(0x7fcca00b7e90 0x7fcca01486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:28.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:28.420+0000 7fcc9de00640 1 -- 172.21.15.123:0/3195805890 >> v2:172.21.15.123:3300/0 conn(0x7fcca00b58b0 msgr2=0x7fcca00b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T05:26:28.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:28.420+0000 7fcc9de00640 1 -- 172.21.15.123:0/3195805890 >> v2:172.21.15.123:3300/0 conn(0x7fcca00b58b0 msgr2=0x7fcca00b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T05:26:28.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:28.420+0000 7fcc9de00640 1 --2- 172.21.15.123:0/3195805890 >> v2:172.21.15.123:3300/0 conn(0x7fcca00b58b0 0x7fcca00b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T05:26:28.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:28.420+0000 7fcc95400640 1 -- 172.21.15.123:0/3195805890 >> v2:172.21.15.164:3300/0 conn(0x7fcca00b7e90 msgr2=0x7fcca01486a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-17T05:26:28.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:28.420+0000 7fcc95400640 1 -- 172.21.15.123:0/3195805890 >> v2:172.21.15.164:3300/0 conn(0x7fcca00b7e90 msgr2=0x7fcca01486a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T05:26:28.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:28.420+0000 7fcc95400640 1 --2- 172.21.15.123:0/3195805890 >> v2:172.21.15.164:3300/0 conn(0x7fcca00b7e90 0x7fcca01486a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T05:26:28.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:28.420+0000 7fcc9de00640 1 --2- 172.21.15.123:0/3195805890 >> v2:172.21.15.123:3300/0 conn(0x7fcca00b58b0 0x7fcca00b6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T05:26:28.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:28.420+0000 7fcc95400640 1 --2- 172.21.15.123:0/3195805890 >> v2:172.21.15.164:3300/0 conn(0x7fcca00b7e90 0x7fcca01486a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T05:26:29.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:29.221+0000 7fcc9de00640 1 --2- 172.21.15.123:0/3195805890 >> v2:172.21.15.123:3300/0 conn(0x7fcca00b58b0 0x7fcca00b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:29.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:29.222+0000 7fcc95400640 1 --2- 172.21.15.123:0/3195805890 >> v2:172.21.15.164:3300/0 conn(0x7fcca00b7e90 0x7fcca01486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:29.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:29.222+0000 7fcc9de00640 1 -- 172.21.15.123:0/3195805890 >> v2:172.21.15.123:3300/0 conn(0x7fcca00b58b0 msgr2=0x7fcca00b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-17T05:26:29.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:29.222+0000 7fcc9de00640 1 -- 172.21.15.123:0/3195805890 >> v2:172.21.15.123:3300/0 conn(0x7fcca00b58b0 msgr2=0x7fcca00b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T05:26:29.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:29.222+0000 7fcc9de00640 1 --2- 172.21.15.123:0/3195805890 >> v2:172.21.15.123:3300/0 conn(0x7fcca00b58b0 0x7fcca00b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T05:26:29.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:29.222+0000 7fcc95400640 1 -- 172.21.15.123:0/3195805890 >> v2:172.21.15.164:3300/0 conn(0x7fcca00b7e90 msgr2=0x7fcca01486a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T05:26:29.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:29.222+0000 7fcc95400640 1 -- 172.21.15.123:0/3195805890 >> v2:172.21.15.164:3300/0 conn(0x7fcca00b7e90 msgr2=0x7fcca01486a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T05:26:29.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:29.222+0000 7fcc95400640 1 --2- 172.21.15.123:0/3195805890 >> v2:172.21.15.164:3300/0 conn(0x7fcca00b7e90 0x7fcca01486a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T05:26:29.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:29.222+0000 7fcc9de00640 1 --2- 172.21.15.123:0/3195805890 >> v2:172.21.15.123:3300/0 conn(0x7fcca00b58b0 0x7fcca00b6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-17T05:26:29.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:29.222+0000 7fcc95400640 1 --2- 172.21.15.123:0/3195805890 >> v2:172.21.15.164:3300/0 conn(0x7fcca00b7e90 0x7fcca01486a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-17T05:26:30.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:30.816+0000 7fcc97e00640 1 -- 172.21.15.123:0/3195805890 >> v2:172.21.15.164:3300/0 conn(0x7fcca00b7e90 msgr2=0x7fcca01486a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T05:26:30.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:30.816+0000 7fcc97e00640 1 --2- 172.21.15.123:0/3195805890 >> v2:172.21.15.164:3300/0 conn(0x7fcca00b7e90 0x7fcca01486a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:30.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:30.816+0000 7fcc97e00640 1 -- 172.21.15.123:0/3195805890 >> v2:172.21.15.123:3300/0 conn(0x7fcca00b58b0 msgr2=0x7fcca00b6260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T05:26:30.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:30.816+0000 7fcc97e00640 1 --2- 172.21.15.123:0/3195805890 >> v2:172.21.15.123:3300/0 conn(0x7fcca00b58b0 0x7fcca00b6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:30.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:30.816+0000 7fcc97e00640 1 -- 172.21.15.123:0/3195805890 >> v1:172.21.15.164:6789/0 conn(0x7fcca014b1d0 legacy=0x7fcca014b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:30.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:30.816+0000 7fcc97e00640 1 --2- 172.21.15.123:0/3195805890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7c0036b0 0x7fcc7c005ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:30.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:30.816+0000 7fcc97e00640 1 -- 172.21.15.123:0/3195805890 --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcca0147be0 con 0x7fcc7c006150 2024-04-17T05:26:30.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:30.816+0000 7fcc97e00640 1 -- 172.21.15.123:0/3195805890 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fcca0148210 con 0x7fcc7c0036b0 2024-04-17T05:26:30.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:30.817+0000 7fcc9de00640 1 --2- 172.21.15.123:0/3195805890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7c0036b0 0x7fcc7c005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:30.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:30.817+0000 7fcc9de00640 1 -- 172.21.15.123:0/3195805890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7c0036b0 msgr2=0x7fcc7c005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T05:26:30.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:30.817+0000 7fcc9de00640 1 -- 172.21.15.123:0/3195805890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7c0036b0 msgr2=0x7fcc7c005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T05:26:30.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:30.817+0000 7fcc9de00640 1 --2- 172.21.15.123:0/3195805890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7c0036b0 0x7fcc7c005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T05:26:30.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:30.817+0000 7fcc9de00640 1 --2- 172.21.15.123:0/3195805890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7c0036b0 0x7fcc7c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T05:26:31.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:31.018+0000 7fcc9de00640 1 --2- 172.21.15.123:0/3195805890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7c0036b0 0x7fcc7c005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:31.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:31.019+0000 7fcc9de00640 1 -- 172.21.15.123:0/3195805890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7c0036b0 msgr2=0x7fcc7c005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T05:26:31.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:31.019+0000 7fcc9de00640 1 -- 172.21.15.123:0/3195805890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7c0036b0 msgr2=0x7fcc7c005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T05:26:31.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:31.019+0000 7fcc9de00640 1 --2- 172.21.15.123:0/3195805890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7c0036b0 0x7fcc7c005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T05:26:31.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:31.019+0000 7fcc9de00640 1 --2- 172.21.15.123:0/3195805890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7c0036b0 0x7fcc7c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T05:26:31.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:31.420+0000 7fcc9de00640 1 --2- 172.21.15.123:0/3195805890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7c0036b0 0x7fcc7c005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:31.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:31.421+0000 7fcc9de00640 1 -- 172.21.15.123:0/3195805890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7c0036b0 msgr2=0x7fcc7c005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T05:26:31.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:31.421+0000 7fcc9de00640 1 -- 172.21.15.123:0/3195805890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7c0036b0 msgr2=0x7fcc7c005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T05:26:31.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:31.421+0000 7fcc9de00640 1 --2- 172.21.15.123:0/3195805890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7c0036b0 0x7fcc7c005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T05:26:31.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:31.421+0000 7fcc9de00640 1 --2- 172.21.15.123:0/3195805890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7c0036b0 0x7fcc7c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T05:26:32.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:32.223+0000 7fcc9de00640 1 --2- 172.21.15.123:0/3195805890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7c0036b0 0x7fcc7c005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:32.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:32.223+0000 7fcc9de00640 1 -- 172.21.15.123:0/3195805890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7c0036b0 msgr2=0x7fcc7c005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T05:26:32.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:32.223+0000 7fcc9de00640 1 -- 172.21.15.123:0/3195805890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7c0036b0 msgr2=0x7fcc7c005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T05:26:32.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:32.223+0000 7fcc9de00640 1 --2- 172.21.15.123:0/3195805890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7c0036b0 0x7fcc7c005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T05:26:32.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:32.223+0000 7fcc9de00640 1 --2- 172.21.15.123:0/3195805890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7c0036b0 0x7fcc7c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-17T05:26:33.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.061+0000 7fcc9d400640 1 -- 172.21.15.123:0/3195805890 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1530661585 0 0) 0x7fcca0147be0 con 0x7fcc7c006150 2024-04-17T05:26:33.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.061+0000 7fcc9d400640 1 -- 172.21.15.123:0/3195805890 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc84003520 con 0x7fcc7c006150 2024-04-17T05:26:33.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.062+0000 7fcc9d400640 1 -- 172.21.15.123:0/3195805890 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3397501878 0 0) 0x7fcc84003520 con 0x7fcc7c006150 2024-04-17T05:26:33.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.062+0000 7fcc9d400640 1 -- 172.21.15.123:0/3195805890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7c0036b0 msgr2=0x7fcc7c005ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T05:26:33.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.062+0000 7fcc9d400640 1 --2- 172.21.15.123:0/3195805890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc7c0036b0 0x7fcc7c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:33.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.062+0000 7fcc9d400640 1 -- 172.21.15.123:0/3195805890 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc7c00af50 con 0x7fcc7c006150 2024-04-17T05:26:33.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.062+0000 7fcc9d400640 1 -- 172.21.15.123:0/3195805890 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1042962670 0 0) 0x7fcc8800d580 con 0x7fcc7c006150 2024-04-17T05:26:33.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.062+0000 7fcc9d400640 1 -- 172.21.15.123:0/3195805890 >> v1:172.21.15.123:6789/0 conn(0x7fcc7c006150 legacy=0x7fcc7c008610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:33.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.062+0000 7fcc9e800640 1 -- 172.21.15.123:0/3195805890 reap_dead start 2024-04-17T05:26:33.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.062+0000 7fcc9d400640 1 --2- 172.21.15.123:0/3195805890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc840039b0 0x7fcc84003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:33.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.062+0000 7fcc9d400640 1 --2- 172.21.15.123:0/3195805890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc84004800 0x7fcc84004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:33.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.062+0000 7fcc9d400640 1 --2- 172.21.15.123:0/3195805890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc840052e0 0x7fcc8400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:33.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.062+0000 7fcc9d400640 1 -- 172.21.15.123:0/3195805890 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcca0148210 con 0x7fcc840039b0 2024-04-17T05:26:33.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.062+0000 7fcc9d400640 1 -- 172.21.15.123:0/3195805890 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fcc8400c230 con 0x7fcc840052e0 2024-04-17T05:26:33.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.062+0000 7fcc9d400640 1 -- 172.21.15.123:0/3195805890 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fcc8400c430 con 0x7fcc84004800 2024-04-17T05:26:33.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.063+0000 7fcc9de00640 1 --2- 172.21.15.123:0/3195805890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc840039b0 0x7fcc84003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:33.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.063+0000 7fcc95400640 1 --2- 172.21.15.123:0/3195805890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc84004800 0x7fcc84004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:33.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.063+0000 7fcc9e800640 1 --2- 172.21.15.123:0/3195805890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc840052e0 0x7fcc8400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:33.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.064+0000 7fcc9de00640 1 -- 172.21.15.123:0/3195805890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc84004800 msgr2=0x7fcc84004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:33.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.064+0000 7fcc9de00640 1 --2- 172.21.15.123:0/3195805890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc84004800 0x7fcc84004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:33.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.064+0000 7fcc9de00640 1 -- 172.21.15.123:0/3195805890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc840052e0 msgr2=0x7fcc8400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:33.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.064+0000 7fcc9de00640 1 --2- 172.21.15.123:0/3195805890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc840052e0 0x7fcc8400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:33.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.064+0000 7fcc9de00640 1 -- 172.21.15.123:0/3195805890 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc84003520 con 0x7fcc840039b0 2024-04-17T05:26:33.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.067+0000 7fcc9de00640 1 --2- 172.21.15.123:0/3195805890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc840039b0 0x7fcc84003db0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcc90009100 tx=0x7fcc84005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c90026672dd9144 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:33.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.067+0000 7fcc9d400640 1 -- 172.21.15.123:0/3195805890 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9000f040 con 0x7fcc840039b0 2024-04-17T05:26:33.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.068+0000 7fcc9d400640 1 -- 172.21.15.123:0/3195805890 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc90034620 con 0x7fcc840039b0 2024-04-17T05:26:33.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.068+0000 7fcc9d400640 1 -- 172.21.15.123:0/3195805890 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc90034a10 con 0x7fcc840039b0 2024-04-17T05:26:33.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.069+0000 7fcca4e00640 1 -- 172.21.15.123:0/3195805890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc840039b0 msgr2=0x7fcc84003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:33.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.069+0000 7fcca4e00640 1 --2- 172.21.15.123:0/3195805890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc840039b0 0x7fcc84003db0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcc90009100 tx=0x7fcc84005830 comp rx=0 tx=0).stop 2024-04-17T05:26:33.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.069+0000 7fcca4e00640 1 -- 172.21.15.123:0/3195805890 shutdown_connections 2024-04-17T05:26:33.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.069+0000 7fcca4e00640 1 --2- 172.21.15.123:0/3195805890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc840052e0 0x7fcc8400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:33.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.069+0000 7fcca4e00640 1 --2- 172.21.15.123:0/3195805890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc84004800 0x7fcc84004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:33.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.069+0000 7fcca4e00640 1 --2- 172.21.15.123:0/3195805890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc840039b0 0x7fcc84003db0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:33.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.069+0000 7fcca4e00640 1 -- 172.21.15.123:0/3195805890 >> 172.21.15.123:0/3195805890 conn(0x7fcca00bd6f0 msgr2=0x7fcca00bdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:33.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.070+0000 7fcca4e00640 1 -- 172.21.15.123:0/3195805890 shutdown_connections 2024-04-17T05:26:33.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.070+0000 7fcca4e00640 1 -- 172.21.15.123:0/3195805890 wait complete. 2024-04-17T05:26:33.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.073+0000 7fcca4e00640 1 Processor -- start 2024-04-17T05:26:33.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.073+0000 7fcca4e00640 1 -- start start 2024-04-17T05:26:33.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.075+0000 7fcca4e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc840039b0 0x7fcca0149b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:33.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.075+0000 7fcca4e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc84004800 0x7fcca01d2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:33.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.075+0000 7fcca4e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc840052e0 0x7fcca01d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:33.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.075+0000 7fcca4e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcca0147ea0 con 0x7fcc840052e0 2024-04-17T05:26:33.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.075+0000 7fcca4e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fcca00b76b0 con 0x7fcc840039b0 2024-04-17T05:26:33.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.075+0000 7fcca4e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fcca00b6260 con 0x7fcc84004800 2024-04-17T05:26:33.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.075+0000 7fcc9e800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc840052e0 0x7fcca01d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:33.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.075+0000 7fcc95400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc84004800 0x7fcca01d2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:33.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.075+0000 7fcc9de00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc840039b0 0x7fcca0149b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:33.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.075+0000 7fcc9e800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc840052e0 0x7fcca01d09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60908/0 (socket says 172.21.15.123:60908) 2024-04-17T05:26:33.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.075+0000 7fcc9e800640 1 -- 172.21.15.123:0/1926287823 learned_addr learned my addr 172.21.15.123:0/1926287823 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:26:33.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.075+0000 7fcc95400640 1 --2- 172.21.15.123:0/1926287823 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc84004800 0x7fcca01d2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.123:45088/0 (socket says 172.21.15.123:45088) 2024-04-17T05:26:33.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.076+0000 7fcc95400640 1 -- 172.21.15.123:0/1926287823 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc840039b0 msgr2=0x7fcca0149b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:33.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.076+0000 7fcc95400640 1 --2- 172.21.15.123:0/1926287823 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc840039b0 0x7fcca0149b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:33.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.076+0000 7fcc95400640 1 -- 172.21.15.123:0/1926287823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc840052e0 msgr2=0x7fcca01d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:33.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.076+0000 7fcc95400640 1 --2- 172.21.15.123:0/1926287823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc840052e0 0x7fcca01d09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:33.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.076+0000 7fcc95400640 1 -- 172.21.15.123:0/1926287823 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca01d1c40 con 0x7fcc84004800 2024-04-17T05:26:33.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.077+0000 7fcc9e800640 1 --2- 172.21.15.123:0/1926287823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc840052e0 0x7fcca01d09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T05:26:33.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.077+0000 7fcc95400640 1 --2- 172.21.15.123:0/1926287823 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc84004800 0x7fcca01d2bc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcc88006fd0 tx=0x7fcc88016dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:33.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.077+0000 7fcc96a00640 1 -- 172.21.15.123:0/1926287823 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc88004240 con 0x7fcc84004800 2024-04-17T05:26:33.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.078+0000 7fcc96a00640 1 -- 172.21.15.123:0/1926287823 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc8801b070 con 0x7fcc84004800 2024-04-17T05:26:33.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.078+0000 7fcc96a00640 1 -- 172.21.15.123:0/1926287823 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc880148d0 con 0x7fcc84004800 2024-04-17T05:26:33.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.078+0000 7fcca4e00640 1 -- 172.21.15.123:0/1926287823 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcca01d3250 con 0x7fcc84004800 2024-04-17T05:26:33.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.078+0000 7fcca4e00640 1 -- 172.21.15.123:0/1926287823 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcca014a820 con 0x7fcc84004800 2024-04-17T05:26:33.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.078+0000 7fcc96a00640 1 -- 172.21.15.123:0/1926287823 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcc88003610 con 0x7fcc84004800 2024-04-17T05:26:33.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.078+0000 7fcc96a00640 1 -- 172.21.15.123:0/1926287823 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcc88017c60 con 0x7fcc84004800 2024-04-17T05:26:33.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.080+0000 7fcca4e00640 1 -- 172.21.15.123:0/1926287823 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcca0068a40 con 0x7fcc84004800 2024-04-17T05:26:33.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.083+0000 7fcc96a00640 1 -- 172.21.15.123:0/1926287823 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7fcc8802e080 con 0x7fcc84004800 2024-04-17T05:26:33.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.157+0000 7fcca4e00640 1 -- 172.21.15.123:0/1926287823 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fcca00b70f0 con 0x7fcc84004800 2024-04-17T05:26:33.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.166+0000 7fcc96a00640 1 -- 172.21.15.123:0/1926287823 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fcc88014e00 con 0x7fcc84004800 2024-04-17T05:26:33.165 INFO:teuthology.orchestra.run.smithi123.stderr:adjusted tunables profile to default 2024-04-17T05:26:33.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.168+0000 7fcca4e00640 1 -- 172.21.15.123:0/1926287823 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc84004800 msgr2=0x7fcca01d2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:33.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.168+0000 7fcca4e00640 1 --2- 172.21.15.123:0/1926287823 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc84004800 0x7fcca01d2bc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcc88006fd0 tx=0x7fcc88016dc0 comp rx=0 tx=0).stop 2024-04-17T05:26:33.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.168+0000 7fcca4e00640 1 -- 172.21.15.123:0/1926287823 shutdown_connections 2024-04-17T05:26:33.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.168+0000 7fcca4e00640 1 --2- 172.21.15.123:0/1926287823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc840052e0 0x7fcca01d09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:33.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.168+0000 7fcca4e00640 1 --2- 172.21.15.123:0/1926287823 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcc84004800 0x7fcca01d2bc0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:33.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.168+0000 7fcca4e00640 1 --2- 172.21.15.123:0/1926287823 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcc840039b0 0x7fcca0149b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:33.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.168+0000 7fcca4e00640 1 -- 172.21.15.123:0/1926287823 >> 172.21.15.123:0/1926287823 conn(0x7fcca00bd6f0 msgr2=0x7fcca00676c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:33.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.168+0000 7fcca4e00640 1 -- 172.21.15.123:0/1926287823 shutdown_connections 2024-04-17T05:26:33.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:33.168+0000 7fcca4e00640 1 -- 172.21.15.123:0/1926287823 wait complete. 2024-04-17T05:26:33.184 INFO:tasks.ceph:check_enable_crimson: False 2024-04-17T05:26:33.184 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-17T05:26:33.184 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-17T05:26:33.184 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-17T05:26:33.273 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-17T05:26:33.273 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-17T05:26:33.410 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-17T05:26:33.410 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-17T05:26:33.501 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-17T05:26:33.501 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-17T05:26:33.594 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-17T05:26:33.594 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-17T05:26:33.685 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-17T05:26:33.687+0000 7ff2583db040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-17T05:26:33.689 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-17T05:26:33.689 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-17T05:26:33.756 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-17T05:26:33.758+0000 7ff2583db040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-17T05:26:33.773 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-17T05:26:33.773 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-17T05:26:33.900 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-17T05:26:33.900 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-17T05:26:34.028 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 15c87cdb-9415-45a6-a2a6-ea6bec9daece 0 2024-04-17T05:26:34.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.260+0000 7f0ce6800640 1 Processor -- start 2024-04-17T05:26:34.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.260+0000 7f0ce6800640 1 -- start start 2024-04-17T05:26:34.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.262+0000 7f0ce6800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0ce00b5560 0x7f0ce00b7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:34.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.262+0000 7f0ce6800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ce0141e70 0x7f0ce00b6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:34.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.262+0000 7f0ce6800640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ce00b5940 con 0x7f0ce01485b0 2024-04-17T05:26:34.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.262+0000 7f0ce6800640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f0ce0148120 con 0x7f0ce00b5560 2024-04-17T05:26:34.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.262+0000 7f0ce6800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f0ce0147ad0 con 0x7f0ce0141e70 2024-04-17T05:26:34.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.262+0000 7f0ce4a00640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f0ce01485b0 0x7f0ce0141760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:59414/0 (socket says 172.21.15.164:59414) 2024-04-17T05:26:34.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.262+0000 7f0ce4a00640 1 -- 172.21.15.164:0/1437279247 learned_addr learned my addr 172.21.15.164:0/1437279247 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-04-17T05:26:34.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.262+0000 7f0ce5e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ce0141e70 0x7f0ce00b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:34.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.262+0000 7f0ce5400640 1 --2- 172.21.15.164:0/1437279247 >> v2:172.21.15.123:3300/0 conn(0x7f0ce00b5560 0x7f0ce00b7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:34.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.263+0000 7f0cdfe00640 1 -- 172.21.15.164:0/1437279247 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3582476331 0 0) 0x7f0ce00b5940 con 0x7f0ce01485b0 2024-04-17T05:26:34.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.263+0000 7f0ce5e00640 1 -- 172.21.15.164:0/1437279247 >> v2:172.21.15.123:3300/0 conn(0x7f0ce00b5560 msgr2=0x7f0ce00b7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:34.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.263+0000 7f0ce5e00640 1 --2- 172.21.15.164:0/1437279247 >> v2:172.21.15.123:3300/0 conn(0x7f0ce00b5560 0x7f0ce00b7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:34.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.263+0000 7f0ce5e00640 1 -- 172.21.15.164:0/1437279247 >> v1:172.21.15.164:6789/0 conn(0x7f0ce01485b0 legacy=0x7f0ce0141760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:34.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.263+0000 7f0ce5e00640 1 -- 172.21.15.164:0/1437279247 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ce0147db0 con 0x7f0ce0141e70 2024-04-17T05:26:34.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.264+0000 7f0ce5e00640 1 --2- 172.21.15.164:0/1437279247 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ce0141e70 0x7f0ce00b6230 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8009d90 tx=0x7f0cd802bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5623f2becb9d472b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:34.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.264+0000 7f0cdfe00640 1 -- 172.21.15.164:0/1437279247 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8039070 con 0x7f0ce0141e70 2024-04-17T05:26:34.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.264+0000 7f0cdfe00640 1 -- 172.21.15.164:0/1437279247 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cd802cb30 con 0x7f0ce0141e70 2024-04-17T05:26:34.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.264+0000 7f0cdfe00640 1 -- 172.21.15.164:0/1437279247 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8034440 con 0x7f0ce0141e70 2024-04-17T05:26:34.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.265+0000 7f0ce6800640 1 -- 172.21.15.164:0/1437279247 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ce0141e70 msgr2=0x7f0ce00b6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:34.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.265+0000 7f0ce6800640 1 --2- 172.21.15.164:0/1437279247 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ce0141e70 0x7f0ce00b6230 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8009d90 tx=0x7f0cd802bd80 comp rx=0 tx=0).stop 2024-04-17T05:26:34.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.265+0000 7f0ce6800640 1 -- 172.21.15.164:0/1437279247 shutdown_connections 2024-04-17T05:26:34.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.265+0000 7f0ce6800640 1 --2- 172.21.15.164:0/1437279247 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ce0141e70 0x7f0ce00b6230 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:34.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.265+0000 7f0ce6800640 1 --2- 172.21.15.164:0/1437279247 >> v2:172.21.15.123:3300/0 conn(0x7f0ce00b5560 0x7f0ce00b7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:34.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.265+0000 7f0ce6800640 1 -- 172.21.15.164:0/1437279247 >> 172.21.15.164:0/1437279247 conn(0x7f0ce006c200 msgr2=0x7f0ce00bd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:34.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.265+0000 7f0ce6800640 1 -- 172.21.15.164:0/1437279247 shutdown_connections 2024-04-17T05:26:34.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.265+0000 7f0ce6800640 1 -- 172.21.15.164:0/1437279247 wait complete. 2024-04-17T05:26:34.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.267+0000 7f0ce6800640 1 Processor -- start 2024-04-17T05:26:34.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.267+0000 7f0ce6800640 1 -- start start 2024-04-17T05:26:34.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.267+0000 7f0ce6800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ce00b5560 0x7f0ce01442e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:34.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.267+0000 7f0ce6800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ce0141e70 0x7f0ce0137a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:34.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.267+0000 7f0ce6800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ce01485b0 0x7f0ce01495d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:34.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.268+0000 7f0ce6800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce00b4e90 con 0x7f0ce0141e70 2024-04-17T05:26:34.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.268+0000 7f0ce6800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce00b4d10 con 0x7f0ce00b5560 2024-04-17T05:26:34.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.268+0000 7f0ce6800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f0ce0152340 con 0x7f0ce01485b0 2024-04-17T05:26:34.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.268+0000 7f0ce5400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ce00b5560 0x7f0ce01442e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:34.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.268+0000 7f0ce5400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ce00b5560 0x7f0ce01442e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:42172/0 (socket says 172.21.15.164:42172) 2024-04-17T05:26:34.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.268+0000 7f0ce5400640 1 -- 172.21.15.164:0/481965108 learned_addr learned my addr 172.21.15.164:0/481965108 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-17T05:26:34.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.268+0000 7f0ce5e00640 1 --2- 172.21.15.164:0/481965108 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ce01485b0 0x7f0ce01495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:34.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.268+0000 7f0ce4a00640 1 --2- 172.21.15.164:0/481965108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ce0141e70 0x7f0ce0137a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:34.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.268+0000 7f0ce5e00640 1 -- 172.21.15.164:0/481965108 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ce00b5560 msgr2=0x7f0ce01442e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:34.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.268+0000 7f0ce5e00640 1 --2- 172.21.15.164:0/481965108 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ce00b5560 0x7f0ce01442e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:34.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.268+0000 7f0ce5e00640 1 -- 172.21.15.164:0/481965108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ce0141e70 msgr2=0x7f0ce0137a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:34.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.268+0000 7f0ce5e00640 1 --2- 172.21.15.164:0/481965108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ce0141e70 0x7f0ce0137a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:34.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.268+0000 7f0ce5e00640 1 -- 172.21.15.164:0/481965108 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ce0138290 con 0x7f0ce01485b0 2024-04-17T05:26:34.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.268+0000 7f0ce5400640 1 --2- 172.21.15.164:0/481965108 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ce00b5560 0x7f0ce01442e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T05:26:34.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.269+0000 7f0ce5e00640 1 --2- 172.21.15.164:0/481965108 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ce01485b0 0x7f0ce01495d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8033000 tx=0x7f0cd8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:34.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.269+0000 7f0cdd600640 1 -- 172.21.15.164:0/481965108 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8044020 con 0x7f0ce01485b0 2024-04-17T05:26:34.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.269+0000 7f0cdd600640 1 -- 172.21.15.164:0/481965108 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cd803a040 con 0x7f0ce01485b0 2024-04-17T05:26:34.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.269+0000 7f0ce6800640 1 -- 172.21.15.164:0/481965108 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ce0138570 con 0x7f0ce01485b0 2024-04-17T05:26:34.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.269+0000 7f0cdd600640 1 -- 172.21.15.164:0/481965108 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8039050 con 0x7f0ce01485b0 2024-04-17T05:26:34.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.269+0000 7f0ce6800640 1 -- 172.21.15.164:0/481965108 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ce01490b0 con 0x7f0ce01485b0 2024-04-17T05:26:34.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.270+0000 7f0cdd600640 1 -- 172.21.15.164:0/481965108 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0cd8003bd0 con 0x7f0ce01485b0 2024-04-17T05:26:34.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.270+0000 7f0cdd600640 1 -- 172.21.15.164:0/481965108 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f0cd803e660 con 0x7f0ce01485b0 2024-04-17T05:26:34.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.270+0000 7f0ce6800640 1 -- 172.21.15.164:0/481965108 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ce0138000 con 0x7f0ce01485b0 2024-04-17T05:26:34.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.273+0000 7f0cdd600640 1 -- 172.21.15.164:0/481965108 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7f0cd804e060 con 0x7f0ce01485b0 2024-04-17T05:26:34.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.353+0000 7f0ce6800640 1 -- 172.21.15.164:0/481965108 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd new", "uuid": "15c87cdb-9415-45a6-a2a6-ea6bec9daece", "id": 0} v 0) -- 0x7f0ce0075b30 con 0x7f0ce01485b0 2024-04-17T05:26:34.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.360+0000 7f0cdd600640 1 -- 172.21.15.164:0/481965108 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "15c87cdb-9415-45a6-a2a6-ea6bec9daece", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f0cd8004000 con 0x7f0ce01485b0 2024-04-17T05:26:34.359 INFO:teuthology.orchestra.run.smithi164.stdout:0 2024-04-17T05:26:34.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.361+0000 7f0ce6800640 1 -- 172.21.15.164:0/481965108 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ce01485b0 msgr2=0x7f0ce01495d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:34.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.361+0000 7f0ce6800640 1 --2- 172.21.15.164:0/481965108 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ce01485b0 0x7f0ce01495d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8033000 tx=0x7f0cd8004a40 comp rx=0 tx=0).stop 2024-04-17T05:26:34.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.362+0000 7f0ce6800640 1 -- 172.21.15.164:0/481965108 shutdown_connections 2024-04-17T05:26:34.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.362+0000 7f0ce6800640 1 --2- 172.21.15.164:0/481965108 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ce01485b0 0x7f0ce01495d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:34.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.362+0000 7f0ce6800640 1 --2- 172.21.15.164:0/481965108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ce0141e70 0x7f0ce0137a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:34.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.362+0000 7f0ce6800640 1 --2- 172.21.15.164:0/481965108 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ce00b5560 0x7f0ce01442e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:34.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.362+0000 7f0ce6800640 1 -- 172.21.15.164:0/481965108 >> 172.21.15.164:0/481965108 conn(0x7f0ce006c200 msgr2=0x7f0ce00b8230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:34.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.362+0000 7f0ce6800640 1 -- 172.21.15.164:0/481965108 shutdown_connections 2024-04-17T05:26:34.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.362+0000 7f0ce6800640 1 -- 172.21.15.164:0/481965108 wait complete. 2024-04-17T05:26:34.377 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 281751b5-486d-4845-b4aa-b308bf7cec62 1 2024-04-17T05:26:34.387 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-17T05:26:34.389+0000 7f8d53c52040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-17T05:26:34.414 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-17T05:26:34.416+0000 7ff2583db040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-17T05:26:34.454 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-17T05:26:34.456+0000 7f8d53c52040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-17T05:26:34.484 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-17T05:26:34.485+0000 7ff2583db040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-17T05:26:34.538 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-17T05:26:34.540+0000 7ff2583db040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-17T05:26:34.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.570+0000 7ff667200640 1 Processor -- start 2024-04-17T05:26:34.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.570+0000 7ff667200640 1 -- start start 2024-04-17T05:26:34.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.571+0000 7ff667200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6680b62f0 0x7ff6681483a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:34.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.571+0000 7ff667200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff668141620 0x7ff668141ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:34.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.571+0000 7ff667200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff668147920 con 0x7ff6680b7d00 2024-04-17T05:26:34.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.571+0000 7ff667200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ff6681488e0 con 0x7ff668141620 2024-04-17T05:26:34.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.571+0000 7ff667200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7ff6680b66d0 con 0x7ff6680b62f0 2024-04-17T05:26:34.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.572+0000 7ff665e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6680b62f0 0x7ff6681483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:34.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.572+0000 7ff665e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6680b62f0 0x7ff6681483a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:57246/0 (socket says 172.21.15.164:57246) 2024-04-17T05:26:34.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.572+0000 7ff665e00640 1 -- 172.21.15.164:0/2367363920 learned_addr learned my addr 172.21.15.164:0/2367363920 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-17T05:26:34.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.572+0000 7ff666800640 1 --2- 172.21.15.164:0/2367363920 >> v2:172.21.15.123:3300/0 conn(0x7ff668141620 0x7ff668141ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:34.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.572+0000 7ff665e00640 1 -- 172.21.15.164:0/2367363920 >> v2:172.21.15.123:3300/0 conn(0x7ff668141620 msgr2=0x7ff668141ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:34.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.572+0000 7ff665e00640 1 --2- 172.21.15.164:0/2367363920 >> v2:172.21.15.123:3300/0 conn(0x7ff668141620 0x7ff668141ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:34.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.572+0000 7ff665e00640 1 -- 172.21.15.164:0/2367363920 >> v1:172.21.15.123:6789/0 conn(0x7ff6680b7d00 legacy=0x7ff6680b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:34.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.572+0000 7ff665e00640 1 -- 172.21.15.164:0/2367363920 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff668147ba0 con 0x7ff6680b62f0 2024-04-17T05:26:34.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.572+0000 7ff666800640 1 --2- 172.21.15.164:0/2367363920 >> v2:172.21.15.123:3300/0 conn(0x7ff668141620 0x7ff668141ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T05:26:34.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.573+0000 7ff665e00640 1 --2- 172.21.15.164:0/2367363920 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6680b62f0 0x7ff6681483a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff658009870 tx=0x7ff65802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6f4bbbefed4c140 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:34.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.574+0000 7ff664a00640 1 -- 172.21.15.164:0/2367363920 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff658035020 con 0x7ff6680b62f0 2024-04-17T05:26:34.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.574+0000 7ff664a00640 1 -- 172.21.15.164:0/2367363920 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff658031640 con 0x7ff6680b62f0 2024-04-17T05:26:34.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.574+0000 7ff664a00640 1 -- 172.21.15.164:0/2367363920 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65802d040 con 0x7ff6680b62f0 2024-04-17T05:26:34.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.574+0000 7ff667200640 1 -- 172.21.15.164:0/2367363920 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6680b62f0 msgr2=0x7ff6681483a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:34.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.574+0000 7ff667200640 1 --2- 172.21.15.164:0/2367363920 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6680b62f0 0x7ff6681483a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff658009870 tx=0x7ff65802b8f0 comp rx=0 tx=0).stop 2024-04-17T05:26:34.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.575+0000 7ff667200640 1 -- 172.21.15.164:0/2367363920 shutdown_connections 2024-04-17T05:26:34.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.575+0000 7ff667200640 1 --2- 172.21.15.164:0/2367363920 >> v2:172.21.15.123:3300/0 conn(0x7ff668141620 0x7ff668141ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:34.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.575+0000 7ff667200640 1 --2- 172.21.15.164:0/2367363920 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6680b62f0 0x7ff6681483a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:34.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.575+0000 7ff667200640 1 -- 172.21.15.164:0/2367363920 >> 172.21.15.164:0/2367363920 conn(0x7ff66806b980 msgr2=0x7ff66806bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:34.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.575+0000 7ff667200640 1 -- 172.21.15.164:0/2367363920 shutdown_connections 2024-04-17T05:26:34.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.575+0000 7ff667200640 1 -- 172.21.15.164:0/2367363920 wait complete. 2024-04-17T05:26:34.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.577+0000 7ff667200640 1 Processor -- start 2024-04-17T05:26:34.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.577+0000 7ff667200640 1 -- start start 2024-04-17T05:26:34.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.578+0000 7ff667200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6680b62f0 0x7ff668139690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:34.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.578+0000 7ff667200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6680b7d00 0x7ff6681e0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:34.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.578+0000 7ff667200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff668141620 0x7ff6681e1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:34.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.578+0000 7ff667200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff668141ff0 con 0x7ff6680b62f0 2024-04-17T05:26:34.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.578+0000 7ff667200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff6680b7530 con 0x7ff6680b7d00 2024-04-17T05:26:34.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.578+0000 7ff667200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7ff6680b5a10 con 0x7ff668141620 2024-04-17T05:26:34.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.579+0000 7ff666800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff668141620 0x7ff6681e1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:34.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.579+0000 7ff665400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6680b7d00 0x7ff6681e0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:34.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.579+0000 7ff666800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff668141620 0x7ff6681e1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:57254/0 (socket says 172.21.15.164:57254) 2024-04-17T05:26:34.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.579+0000 7ff666800640 1 -- 172.21.15.164:0/553365518 learned_addr learned my addr 172.21.15.164:0/553365518 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-17T05:26:34.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.579+0000 7ff665e00640 1 --2- 172.21.15.164:0/553365518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6680b62f0 0x7ff668139690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:34.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.579+0000 7ff665400640 1 -- 172.21.15.164:0/553365518 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff668141620 msgr2=0x7ff6681e1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:34.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.579+0000 7ff665400640 1 --2- 172.21.15.164:0/553365518 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff668141620 0x7ff6681e1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:34.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.579+0000 7ff665400640 1 -- 172.21.15.164:0/553365518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6680b62f0 msgr2=0x7ff668139690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:34.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.579+0000 7ff665400640 1 --2- 172.21.15.164:0/553365518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6680b62f0 0x7ff668139690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:34.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.579+0000 7ff665400640 1 -- 172.21.15.164:0/553365518 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff66813a310 con 0x7ff6680b7d00 2024-04-17T05:26:34.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.579+0000 7ff666800640 1 --2- 172.21.15.164:0/553365518 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff668141620 0x7ff6681e1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T05:26:34.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.579+0000 7ff665e00640 1 --2- 172.21.15.164:0/553365518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6680b62f0 0x7ff668139690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T05:26:34.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.579+0000 7ff665400640 1 --2- 172.21.15.164:0/553365518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6680b7d00 0x7ff6681e0be0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff65400c340 tx=0x7ff65400c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:34.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.580+0000 7ff65e000640 1 -- 172.21.15.164:0/553365518 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6540052d0 con 0x7ff6680b7d00 2024-04-17T05:26:34.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.580+0000 7ff65e000640 1 -- 172.21.15.164:0/553365518 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff654005490 con 0x7ff6680b7d00 2024-04-17T05:26:34.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.580+0000 7ff65e000640 1 -- 172.21.15.164:0/553365518 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff654007260 con 0x7ff6680b7d00 2024-04-17T05:26:34.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.580+0000 7ff667200640 1 -- 172.21.15.164:0/553365518 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff668142a40 con 0x7ff6680b7d00 2024-04-17T05:26:34.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.580+0000 7ff667200640 1 -- 172.21.15.164:0/553365518 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff668145000 con 0x7ff6680b7d00 2024-04-17T05:26:34.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.580+0000 7ff65e000640 1 -- 172.21.15.164:0/553365518 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff654007400 con 0x7ff6680b7d00 2024-04-17T05:26:34.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.580+0000 7ff65e000640 1 -- 172.21.15.164:0/553365518 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7ff654003aa0 con 0x7ff6680b7d00 2024-04-17T05:26:34.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.581+0000 7ff667200640 1 -- 172.21.15.164:0/553365518 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff66813a100 con 0x7ff6680b7d00 2024-04-17T05:26:34.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.584+0000 7ff65e000640 1 -- 172.21.15.164:0/553365518 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7ff668147920 con 0x7ff6680b7d00 2024-04-17T05:26:34.608 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-17T05:26:34.609+0000 7ff2583db040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-17T05:26:34.660 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-17T05:26:34.661+0000 7ff2583db040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-17T05:26:34.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.663+0000 7ff667200640 1 -- 172.21.15.164:0/553365518 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd new", "uuid": "281751b5-486d-4845-b4aa-b308bf7cec62", "id": 1} v 0) -- 0x7ff668075b30 con 0x7ff6680b7d00 2024-04-17T05:26:34.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.671+0000 7ff65e000640 1 -- 172.21.15.164:0/553365518 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "281751b5-486d-4845-b4aa-b308bf7cec62", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7ff6540035f0 con 0x7ff6680b7d00 2024-04-17T05:26:34.669 INFO:teuthology.orchestra.run.smithi164.stdout:1 2024-04-17T05:26:34.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.672+0000 7ff667200640 1 -- 172.21.15.164:0/553365518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6680b7d00 msgr2=0x7ff6681e0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:34.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.672+0000 7ff667200640 1 --2- 172.21.15.164:0/553365518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6680b7d00 0x7ff6681e0be0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff65400c340 tx=0x7ff65400c800 comp rx=0 tx=0).stop 2024-04-17T05:26:34.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.672+0000 7ff667200640 1 -- 172.21.15.164:0/553365518 shutdown_connections 2024-04-17T05:26:34.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.672+0000 7ff667200640 1 --2- 172.21.15.164:0/553365518 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff668141620 0x7ff6681e1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:34.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.672+0000 7ff667200640 1 --2- 172.21.15.164:0/553365518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6680b7d00 0x7ff6681e0be0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:34.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.672+0000 7ff667200640 1 --2- 172.21.15.164:0/553365518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6680b62f0 0x7ff668139690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:34.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.672+0000 7ff667200640 1 -- 172.21.15.164:0/553365518 >> 172.21.15.164:0/553365518 conn(0x7ff66806b980 msgr2=0x7ff668140910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:34.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.672+0000 7ff667200640 1 -- 172.21.15.164:0/553365518 shutdown_connections 2024-04-17T05:26:34.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.672+0000 7ff667200640 1 -- 172.21.15.164:0/553365518 wait complete. 2024-04-17T05:26:34.686 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new b42257d3-bd20-4db5-aa37-1bf5c512d0f5 2 2024-04-17T05:26:34.799 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-17T05:26:34.801+0000 7ff2583db040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-17T05:26:34.885 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-17T05:26:34.886+0000 7ff2583db040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-17T05:26:34.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.918+0000 7f6fd8a00640 1 Processor -- start 2024-04-17T05:26:34.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.918+0000 7f6fd8a00640 1 -- start start 2024-04-17T05:26:34.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.920+0000 7f6fd8a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6fd40b7d00 0x7f6fd41483a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:34.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.920+0000 7f6fd8a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6fd4141620 0x7f6fd4141ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:34.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.920+0000 7f6fd8a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fd4147920 con 0x7f6fd40b62f0 2024-04-17T05:26:34.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.920+0000 7f6fd8a00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f6fd41488e0 con 0x7f6fd4141620 2024-04-17T05:26:34.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.920+0000 7f6fd8a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f6fd40b66d0 con 0x7f6fd40b7d00 2024-04-17T05:26:34.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.920+0000 7f6fcbe00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6fd40b7d00 0x7f6fd41483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:34.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.920+0000 7f6fcbe00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6fd40b7d00 0x7f6fd41483a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:57256/0 (socket says 172.21.15.164:57256) 2024-04-17T05:26:34.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.920+0000 7f6fcbe00640 1 -- 172.21.15.164:0/3981890442 learned_addr learned my addr 172.21.15.164:0/3981890442 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-17T05:26:34.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.920+0000 7f6fd3e00640 1 --2- 172.21.15.164:0/3981890442 >> v2:172.21.15.123:3300/0 conn(0x7f6fd4141620 0x7f6fd4141ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:34.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.921+0000 7f6fcbe00640 1 -- 172.21.15.164:0/3981890442 >> v2:172.21.15.123:3300/0 conn(0x7f6fd4141620 msgr2=0x7f6fd4141ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:34.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.921+0000 7f6fcbe00640 1 --2- 172.21.15.164:0/3981890442 >> v2:172.21.15.123:3300/0 conn(0x7f6fd4141620 0x7f6fd4141ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:34.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.921+0000 7f6fcbe00640 1 -- 172.21.15.164:0/3981890442 >> v1:172.21.15.123:6789/0 conn(0x7f6fd40b62f0 legacy=0x7f6fd40b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:34.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.921+0000 7f6fcbe00640 1 -- 172.21.15.164:0/3981890442 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fd4147ba0 con 0x7f6fd40b7d00 2024-04-17T05:26:34.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.922+0000 7f6fcbe00640 1 --2- 172.21.15.164:0/3981890442 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6fd40b7d00 0x7f6fd41483a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc009870 tx=0x7f6fbc02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb1ce3ed3effeccf server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:34.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.922+0000 7f6fd2a00640 1 -- 172.21.15.164:0/3981890442 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc035020 con 0x7f6fd40b7d00 2024-04-17T05:26:34.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.922+0000 7f6fd2a00640 1 -- 172.21.15.164:0/3981890442 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fbc031640 con 0x7f6fd40b7d00 2024-04-17T05:26:34.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.922+0000 7f6fd2a00640 1 -- 172.21.15.164:0/3981890442 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc02d040 con 0x7f6fd40b7d00 2024-04-17T05:26:34.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.922+0000 7f6fd8a00640 1 -- 172.21.15.164:0/3981890442 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6fd40b7d00 msgr2=0x7f6fd41483a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:34.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.922+0000 7f6fd8a00640 1 --2- 172.21.15.164:0/3981890442 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6fd40b7d00 0x7f6fd41483a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc009870 tx=0x7f6fbc02b8f0 comp rx=0 tx=0).stop 2024-04-17T05:26:34.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.923+0000 7f6fd8a00640 1 -- 172.21.15.164:0/3981890442 shutdown_connections 2024-04-17T05:26:34.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.923+0000 7f6fd8a00640 1 --2- 172.21.15.164:0/3981890442 >> v2:172.21.15.123:3300/0 conn(0x7f6fd4141620 0x7f6fd4141ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:34.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.923+0000 7f6fd8a00640 1 --2- 172.21.15.164:0/3981890442 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6fd40b7d00 0x7f6fd41483a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:34.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.923+0000 7f6fd8a00640 1 -- 172.21.15.164:0/3981890442 >> 172.21.15.164:0/3981890442 conn(0x7f6fd406b980 msgr2=0x7f6fd406bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:34.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.923+0000 7f6fd8a00640 1 -- 172.21.15.164:0/3981890442 shutdown_connections 2024-04-17T05:26:34.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.923+0000 7f6fd8a00640 1 -- 172.21.15.164:0/3981890442 wait complete. 2024-04-17T05:26:34.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.924+0000 7f6fd8a00640 1 Processor -- start 2024-04-17T05:26:34.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.924+0000 7f6fd8a00640 1 -- start start 2024-04-17T05:26:34.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.925+0000 7f6fd8a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fd40b62f0 0x7f6fd4142d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:34.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.925+0000 7f6fd8a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6fd40b7d00 0x7f6fd41d72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:34.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.925+0000 7f6fd8a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6fd4141620 0x7f6fd41d77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:34.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.925+0000 7f6fd8a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd4141ff0 con 0x7f6fd40b62f0 2024-04-17T05:26:34.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.925+0000 7f6fd8a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd40b7530 con 0x7f6fd4141620 2024-04-17T05:26:34.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.925+0000 7f6fd8a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f6fd40b5a10 con 0x7f6fd40b7d00 2024-04-17T05:26:34.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.925+0000 7f6fcbe00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6fd40b7d00 0x7f6fd41d72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:34.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.925+0000 7f6fcbe00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6fd40b7d00 0x7f6fd41d72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:57270/0 (socket says 172.21.15.164:57270) 2024-04-17T05:26:34.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.926+0000 7f6fcbe00640 1 -- 172.21.15.164:0/1850105758 learned_addr learned my addr 172.21.15.164:0/1850105758 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-17T05:26:34.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.926+0000 7f6fd3e00640 1 --2- 172.21.15.164:0/1850105758 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6fd4141620 0x7f6fd41d77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:34.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.926+0000 7f6fd3400640 1 --2- 172.21.15.164:0/1850105758 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fd40b62f0 0x7f6fd4142d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:34.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.926+0000 7f6fd3e00640 1 -- 172.21.15.164:0/1850105758 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6fd40b7d00 msgr2=0x7f6fd41d72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:34.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.926+0000 7f6fd3e00640 1 --2- 172.21.15.164:0/1850105758 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6fd40b7d00 0x7f6fd41d72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:34.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.926+0000 7f6fd3e00640 1 -- 172.21.15.164:0/1850105758 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fd40b62f0 msgr2=0x7f6fd4142d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:34.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.926+0000 7f6fd3e00640 1 --2- 172.21.15.164:0/1850105758 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fd40b62f0 0x7f6fd4142d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:34.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.926+0000 7f6fd3e00640 1 -- 172.21.15.164:0/1850105758 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fd4138a90 con 0x7f6fd4141620 2024-04-17T05:26:34.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.926+0000 7f6fcbe00640 1 --2- 172.21.15.164:0/1850105758 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6fd40b7d00 0x7f6fd41d72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T05:26:34.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.926+0000 7f6fd3e00640 1 --2- 172.21.15.164:0/1850105758 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6fd4141620 0x7f6fd41d77f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc007dc0 tx=0x7f6fcc00e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:34.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.926+0000 7f6fcb400640 1 -- 172.21.15.164:0/1850105758 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc00edd0 con 0x7f6fd4141620 2024-04-17T05:26:34.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.927+0000 7f6fcb400640 1 -- 172.21.15.164:0/1850105758 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fcc003990 con 0x7f6fd4141620 2024-04-17T05:26:34.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.927+0000 7f6fcb400640 1 -- 172.21.15.164:0/1850105758 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc003d80 con 0x7f6fd4141620 2024-04-17T05:26:34.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.927+0000 7f6fd8a00640 1 -- 172.21.15.164:0/1850105758 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fd4143c10 con 0x7f6fd4141620 2024-04-17T05:26:34.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.927+0000 7f6fd8a00640 1 -- 172.21.15.164:0/1850105758 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fd40bdfd0 con 0x7f6fd4141620 2024-04-17T05:26:34.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.927+0000 7f6fcb400640 1 -- 172.21.15.164:0/1850105758 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6fcc01b020 con 0x7f6fd4141620 2024-04-17T05:26:34.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.927+0000 7f6fcb400640 1 -- 172.21.15.164:0/1850105758 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f6fcc014ab0 con 0x7f6fd4141620 2024-04-17T05:26:34.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.928+0000 7f6fd8a00640 1 -- 172.21.15.164:0/1850105758 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fd40bd8d0 con 0x7f6fd4141620 2024-04-17T05:26:34.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:34.931+0000 7f6fcb400640 1 -- 172.21.15.164:0/1850105758 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7f6fcc014d40 con 0x7f6fd4141620 2024-04-17T05:26:34.943 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-17T05:26:34.944+0000 7ff2583db040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-17T05:26:35.006 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-17T05:26:35.008+0000 7ff2583db040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-17T05:26:35.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.011+0000 7f6fd8a00640 1 -- 172.21.15.164:0/1850105758 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b42257d3-bd20-4db5-aa37-1bf5c512d0f5", "id": 2} v 0) -- 0x7f6fd4146470 con 0x7f6fd4141620 2024-04-17T05:26:35.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.018+0000 7f6fcb400640 1 -- 172.21.15.164:0/1850105758 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b42257d3-bd20-4db5-aa37-1bf5c512d0f5", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f6fcc014420 con 0x7f6fd4141620 2024-04-17T05:26:35.017 INFO:teuthology.orchestra.run.smithi164.stdout:2 2024-04-17T05:26:35.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.020+0000 7f6fd8a00640 1 -- 172.21.15.164:0/1850105758 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6fd4141620 msgr2=0x7f6fd41d77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:35.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.020+0000 7f6fd8a00640 1 --2- 172.21.15.164:0/1850105758 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6fd4141620 0x7f6fd41d77f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc007dc0 tx=0x7f6fcc00e4b0 comp rx=0 tx=0).stop 2024-04-17T05:26:35.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.020+0000 7f6fd8a00640 1 -- 172.21.15.164:0/1850105758 shutdown_connections 2024-04-17T05:26:35.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.020+0000 7f6fd8a00640 1 --2- 172.21.15.164:0/1850105758 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6fd4141620 0x7f6fd41d77f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:35.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.020+0000 7f6fd8a00640 1 --2- 172.21.15.164:0/1850105758 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6fd40b7d00 0x7f6fd41d72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:35.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.020+0000 7f6fd8a00640 1 --2- 172.21.15.164:0/1850105758 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fd40b62f0 0x7f6fd4142d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:35.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.020+0000 7f6fd8a00640 1 -- 172.21.15.164:0/1850105758 >> 172.21.15.164:0/1850105758 conn(0x7f6fd406b980 msgr2=0x7f6fd41373b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:35.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.020+0000 7f6fd8a00640 1 -- 172.21.15.164:0/1850105758 shutdown_connections 2024-04-17T05:26:35.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.020+0000 7f6fd8a00640 1 -- 172.21.15.164:0/1850105758 wait complete. 2024-04-17T05:26:35.035 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 0f26b891-bbe6-478e-8dee-78e69bb48cf0 3 2024-04-17T05:26:35.067 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-17T05:26:35.069+0000 7ff2583db040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-17T05:26:35.085 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-17T05:26:35.087+0000 7f8d53c52040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-17T05:26:35.148 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-17T05:26:35.149+0000 7f8d53c52040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-17T05:26:35.198 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-17T05:26:35.200+0000 7f8d53c52040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-17T05:26:35.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.223+0000 7f6f0f200640 1 Processor -- start 2024-04-17T05:26:35.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.223+0000 7f6f0f200640 1 -- start start 2024-04-17T05:26:35.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.225+0000 7f6f0f200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f100b62f0 0x7f6f101483a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:35.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.225+0000 7f6f0f200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6f10141620 0x7f6f10141ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:35.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.225+0000 7f6f0f200640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f10147920 con 0x7f6f100b7d00 2024-04-17T05:26:35.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.225+0000 7f6f0f200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f6f101488e0 con 0x7f6f10141620 2024-04-17T05:26:35.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.225+0000 7f6f0f200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f6f100b66d0 con 0x7f6f100b62f0 2024-04-17T05:26:35.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.225+0000 7f6f07e00640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f6f100b7d00 0x7f6f100b5300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:59420/0 (socket says 172.21.15.164:59420) 2024-04-17T05:26:35.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.225+0000 7f6f07e00640 1 -- 172.21.15.164:0/4263947887 learned_addr learned my addr 172.21.15.164:0/4263947887 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-04-17T05:26:35.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.225+0000 7f6f0de00640 1 --2- 172.21.15.164:0/4263947887 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f100b62f0 0x7f6f101483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:35.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.225+0000 7f6f0e800640 1 --2- 172.21.15.164:0/4263947887 >> v2:172.21.15.123:3300/0 conn(0x7f6f10141620 0x7f6f10141ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:35.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.225+0000 7f6f0d400640 1 -- 172.21.15.164:0/4263947887 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2245289776 0 0) 0x7f6ef8001110 con 0x7f6f100b7d00 2024-04-17T05:26:35.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.226+0000 7f6f0d400640 1 -- 172.21.15.164:0/4263947887 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ef4003520 con 0x7f6f100b7d00 2024-04-17T05:26:35.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.226+0000 7f6f0de00640 1 -- 172.21.15.164:0/4263947887 >> v2:172.21.15.123:3300/0 conn(0x7f6f10141620 msgr2=0x7f6f10141ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:35.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.226+0000 7f6f0de00640 1 --2- 172.21.15.164:0/4263947887 >> v2:172.21.15.123:3300/0 conn(0x7f6f10141620 0x7f6f10141ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:35.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.226+0000 7f6f0de00640 1 -- 172.21.15.164:0/4263947887 >> v1:172.21.15.164:6789/0 conn(0x7f6f100b7d00 legacy=0x7f6f100b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:35.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.226+0000 7f6f0de00640 1 -- 172.21.15.164:0/4263947887 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f10147ba0 con 0x7f6f100b62f0 2024-04-17T05:26:35.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.226+0000 7f6f0e800640 1 --2- 172.21.15.164:0/4263947887 >> v2:172.21.15.123:3300/0 conn(0x7f6f10141620 0x7f6f10141ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T05:26:35.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.227+0000 7f6f0de00640 1 --2- 172.21.15.164:0/4263947887 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f100b62f0 0x7f6f101483a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6f000097a0 tx=0x7f6f0002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e13cd7c73e0ce0d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:35.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.227+0000 7f6f0d400640 1 -- 172.21.15.164:0/4263947887 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f000315a0 con 0x7f6f100b62f0 2024-04-17T05:26:35.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.227+0000 7f6f0d400640 1 -- 172.21.15.164:0/4263947887 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f00037070 con 0x7f6f100b62f0 2024-04-17T05:26:35.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.227+0000 7f6f0d400640 1 -- 172.21.15.164:0/4263947887 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f00031960 con 0x7f6f100b62f0 2024-04-17T05:26:35.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.228+0000 7f6f0f200640 1 -- 172.21.15.164:0/4263947887 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f100b62f0 msgr2=0x7f6f101483a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:35.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.228+0000 7f6f0f200640 1 --2- 172.21.15.164:0/4263947887 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f100b62f0 0x7f6f101483a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6f000097a0 tx=0x7f6f0002b840 comp rx=0 tx=0).stop 2024-04-17T05:26:35.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.228+0000 7f6f0f200640 1 -- 172.21.15.164:0/4263947887 shutdown_connections 2024-04-17T05:26:35.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.228+0000 7f6f0f200640 1 --2- 172.21.15.164:0/4263947887 >> v2:172.21.15.123:3300/0 conn(0x7f6f10141620 0x7f6f10141ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:35.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.228+0000 7f6f0f200640 1 --2- 172.21.15.164:0/4263947887 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f100b62f0 0x7f6f101483a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:35.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.228+0000 7f6f0f200640 1 -- 172.21.15.164:0/4263947887 >> 172.21.15.164:0/4263947887 conn(0x7f6f1006b980 msgr2=0x7f6f1006bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:35.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.228+0000 7f6f0f200640 1 -- 172.21.15.164:0/4263947887 shutdown_connections 2024-04-17T05:26:35.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.228+0000 7f6f0f200640 1 -- 172.21.15.164:0/4263947887 wait complete. 2024-04-17T05:26:35.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.229+0000 7f6f0f200640 1 Processor -- start 2024-04-17T05:26:35.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.230+0000 7f6f0f200640 1 -- start start 2024-04-17T05:26:35.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.230+0000 7f6f0f200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f100b62f0 0x7f6f100bcf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:35.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.230+0000 7f6f0f200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f100b7d00 0x7f6f1014b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:35.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.230+0000 7f6f0f200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f10141620 0x7f6f100bbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:35.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.230+0000 7f6f0f200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6f10141ff0 con 0x7f6f10141620 2024-04-17T05:26:35.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.230+0000 7f6f0f200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f6f100b7530 con 0x7f6f100b62f0 2024-04-17T05:26:35.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.230+0000 7f6f0f200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f6f100b5a10 con 0x7f6f100b7d00 2024-04-17T05:26:35.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.231+0000 7f6f07e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f100b7d00 0x7f6f1014b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:35.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.231+0000 7f6f0de00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f100b62f0 0x7f6f100bcf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:35.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.231+0000 7f6f07e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f100b7d00 0x7f6f1014b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:57292/0 (socket says 172.21.15.164:57292) 2024-04-17T05:26:35.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.231+0000 7f6f07e00640 1 -- 172.21.15.164:0/3277333054 learned_addr learned my addr 172.21.15.164:0/3277333054 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-17T05:26:35.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.231+0000 7f6f0e800640 1 --2- 172.21.15.164:0/3277333054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f10141620 0x7f6f100bbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:35.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.231+0000 7f6f07e00640 1 -- 172.21.15.164:0/3277333054 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f100b62f0 msgr2=0x7f6f100bcf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:35.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.231+0000 7f6f07e00640 1 --2- 172.21.15.164:0/3277333054 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f100b62f0 0x7f6f100bcf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:35.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.231+0000 7f6f07e00640 1 -- 172.21.15.164:0/3277333054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f10141620 msgr2=0x7f6f100bbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:35.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.231+0000 7f6f07e00640 1 --2- 172.21.15.164:0/3277333054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f10141620 0x7f6f100bbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:35.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.231+0000 7f6f07e00640 1 -- 172.21.15.164:0/3277333054 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f10148d90 con 0x7f6f100b7d00 2024-04-17T05:26:35.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.231+0000 7f6f07e00640 1 --2- 172.21.15.164:0/3277333054 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f100b7d00 0x7f6f1014b5b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6ef800c730 tx=0x7f6ef800cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:35.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.232+0000 7f6f06000640 1 -- 172.21.15.164:0/3277333054 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef8017070 con 0x7f6f100b7d00 2024-04-17T05:26:35.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.232+0000 7f6f06000640 1 -- 172.21.15.164:0/3277333054 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ef8005ad0 con 0x7f6f100b7d00 2024-04-17T05:26:35.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.232+0000 7f6f0f200640 1 -- 172.21.15.164:0/3277333054 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f10144f00 con 0x7f6f100b7d00 2024-04-17T05:26:35.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.232+0000 7f6f06000640 1 -- 172.21.15.164:0/3277333054 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef8007e20 con 0x7f6f100b7d00 2024-04-17T05:26:35.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.232+0000 7f6f0f200640 1 -- 172.21.15.164:0/3277333054 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f101de1f0 con 0x7f6f100b7d00 2024-04-17T05:26:35.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.232+0000 7f6f06000640 1 -- 172.21.15.164:0/3277333054 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6ef801a070 con 0x7f6f100b7d00 2024-04-17T05:26:35.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.232+0000 7f6f06000640 1 -- 172.21.15.164:0/3277333054 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f6ef800a5e0 con 0x7f6f100b7d00 2024-04-17T05:26:35.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.233+0000 7f6f0f200640 1 -- 172.21.15.164:0/3277333054 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f10075b30 con 0x7f6f100b7d00 2024-04-17T05:26:35.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.235+0000 7f6f06000640 1 -- 172.21.15.164:0/3277333054 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7f6ef8021070 con 0x7f6f100b7d00 2024-04-17T05:26:35.262 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-17T05:26:35.264+0000 7f8d53c52040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-17T05:26:35.311 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-17T05:26:35.313+0000 7f8d53c52040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-17T05:26:35.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.314+0000 7f6f0f200640 1 -- 172.21.15.164:0/3277333054 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0f26b891-bbe6-478e-8dee-78e69bb48cf0", "id": 3} v 0) -- 0x7f6f10148640 con 0x7f6f100b7d00 2024-04-17T05:26:35.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.324+0000 7f6f06000640 1 -- 172.21.15.164:0/3277333054 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0f26b891-bbe6-478e-8dee-78e69bb48cf0", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f6f10147920 con 0x7f6f100b7d00 2024-04-17T05:26:35.322 INFO:teuthology.orchestra.run.smithi164.stdout:3 2024-04-17T05:26:35.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.325+0000 7f6f0f200640 1 -- 172.21.15.164:0/3277333054 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f100b7d00 msgr2=0x7f6f1014b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:35.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.325+0000 7f6f0f200640 1 --2- 172.21.15.164:0/3277333054 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f100b7d00 0x7f6f1014b5b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6ef800c730 tx=0x7f6ef800cbf0 comp rx=0 tx=0).stop 2024-04-17T05:26:35.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.325+0000 7f6f0f200640 1 -- 172.21.15.164:0/3277333054 shutdown_connections 2024-04-17T05:26:35.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.325+0000 7f6f0f200640 1 --2- 172.21.15.164:0/3277333054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f10141620 0x7f6f100bbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:35.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.325+0000 7f6f0f200640 1 --2- 172.21.15.164:0/3277333054 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f100b7d00 0x7f6f1014b5b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:35.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.325+0000 7f6f0f200640 1 --2- 172.21.15.164:0/3277333054 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f100b62f0 0x7f6f100bcf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:35.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.325+0000 7f6f0f200640 1 -- 172.21.15.164:0/3277333054 >> 172.21.15.164:0/3277333054 conn(0x7f6f1006b980 msgr2=0x7f6f1013a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:35.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.325+0000 7f6f0f200640 1 -- 172.21.15.164:0/3277333054 shutdown_connections 2024-04-17T05:26:35.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.325+0000 7f6f0f200640 1 -- 172.21.15.164:0/3277333054 wait complete. 2024-04-17T05:26:35.340 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 43e59318-2740-4625-9d64-eec1fd43c322 4 2024-04-17T05:26:35.443 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-17T05:26:35.445+0000 7f8d53c52040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-17T05:26:35.523 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-17T05:26:35.525+0000 7f8d53c52040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-17T05:26:35.548 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-17T05:26:35.549+0000 7ff2583db040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-17T05:26:35.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.576+0000 7f03d6c00640 1 Processor -- start 2024-04-17T05:26:35.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.576+0000 7f03d6c00640 1 -- start start 2024-04-17T05:26:35.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.577+0000 7f03d6c00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f03d00b6d80 0x7f03d00b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:35.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.577+0000 7f03d6c00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03d00b3f10 con 0x7f03d013ffb0 2024-04-17T05:26:35.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.577+0000 7f03d6c00640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03d00b7160 con 0x7f03d00b5f30 2024-04-17T05:26:35.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.577+0000 7f03d6c00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f03d00b4240 con 0x7f03d00b6d80 2024-04-17T05:26:35.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.577+0000 7f03d5800640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f03d00b6d80 0x7f03d00b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:35.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.578+0000 7f03d5800640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f03d00b6d80 0x7f03d00b4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:42190/0 (socket says 172.21.15.164:42190) 2024-04-17T05:26:35.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.578+0000 7f03d5800640 1 -- 172.21.15.164:0/3045583383 learned_addr learned my addr 172.21.15.164:0/3045583383 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-17T05:26:35.577 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-17T05:26:35.578+0000 7f8d53c52040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-17T05:26:35.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.578+0000 7f03d5800640 1 -- 172.21.15.164:0/3045583383 >> v1:172.21.15.164:6789/0 conn(0x7f03d00b5f30 legacy=0x7f03d013f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:35.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.578+0000 7f03d5800640 1 -- 172.21.15.164:0/3045583383 >> v1:172.21.15.123:6789/0 conn(0x7f03d013ffb0 legacy=0x7f03d01502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:35.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.578+0000 7f03d5800640 1 -- 172.21.15.164:0/3045583383 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03d00b5440 con 0x7f03d00b6d80 2024-04-17T05:26:35.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.579+0000 7f03d5800640 1 --2- 172.21.15.164:0/3045583383 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03d00b6d80 0x7f03d00b4f00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f03c4009870 tx=0x7f03c402b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5d728f42a2dd65 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:35.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.579+0000 7f03cfe00640 1 -- 172.21.15.164:0/3045583383 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c4034070 con 0x7f03d00b6d80 2024-04-17T05:26:35.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.579+0000 7f03cfe00640 1 -- 172.21.15.164:0/3045583383 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03c4030860 con 0x7f03d00b6d80 2024-04-17T05:26:35.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.579+0000 7f03cfe00640 1 -- 172.21.15.164:0/3045583383 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c4030c30 con 0x7f03d00b6d80 2024-04-17T05:26:35.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.580+0000 7f03d6c00640 1 -- 172.21.15.164:0/3045583383 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03d00b6d80 msgr2=0x7f03d00b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:35.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.580+0000 7f03d6c00640 1 --2- 172.21.15.164:0/3045583383 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03d00b6d80 0x7f03d00b4f00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f03c4009870 tx=0x7f03c402b9a0 comp rx=0 tx=0).stop 2024-04-17T05:26:35.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.580+0000 7f03d6c00640 1 -- 172.21.15.164:0/3045583383 shutdown_connections 2024-04-17T05:26:35.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.580+0000 7f03d6c00640 1 --2- 172.21.15.164:0/3045583383 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03d00b6d80 0x7f03d00b4f00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:35.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.580+0000 7f03d6c00640 1 -- 172.21.15.164:0/3045583383 >> 172.21.15.164:0/3045583383 conn(0x7f03d006c140 msgr2=0x7f03d00bb280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:35.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.580+0000 7f03d6c00640 1 -- 172.21.15.164:0/3045583383 shutdown_connections 2024-04-17T05:26:35.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.580+0000 7f03d6c00640 1 -- 172.21.15.164:0/3045583383 wait complete. 2024-04-17T05:26:35.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.582+0000 7f03d6c00640 1 Processor -- start 2024-04-17T05:26:35.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.582+0000 7f03d6c00640 1 -- start start 2024-04-17T05:26:35.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.583+0000 7f03d6c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03d00b5f30 0x7f03d0140d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:35.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.583+0000 7f03d6c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03d00b6d80 0x7f03d01db3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:35.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.583+0000 7f03d6c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03d013ffb0 0x7f03d01db8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:35.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.583+0000 7f03d6c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f03d00b56f0 con 0x7f03d00b6d80 2024-04-17T05:26:35.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.583+0000 7f03d6c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f03d00b2780 con 0x7f03d00b5f30 2024-04-17T05:26:35.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.583+0000 7f03d6c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f03d00b46d0 con 0x7f03d013ffb0 2024-04-17T05:26:35.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.583+0000 7f03d5800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03d00b5f30 0x7f03d0140d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:35.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.583+0000 7f03d5800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03d00b5f30 0x7f03d0140d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:42202/0 (socket says 172.21.15.164:42202) 2024-04-17T05:26:35.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.583+0000 7f03d5800640 1 -- 172.21.15.164:0/1159529167 learned_addr learned my addr 172.21.15.164:0/1159529167 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-17T05:26:35.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.583+0000 7f03d6200640 1 --2- 172.21.15.164:0/1159529167 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03d013ffb0 0x7f03d01db8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:35.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.583+0000 7f03d4e00640 1 --2- 172.21.15.164:0/1159529167 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03d00b6d80 0x7f03d01db3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:35.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.583+0000 7f03d5800640 1 -- 172.21.15.164:0/1159529167 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03d013ffb0 msgr2=0x7f03d01db8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:35.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.583+0000 7f03d5800640 1 --2- 172.21.15.164:0/1159529167 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03d013ffb0 0x7f03d01db8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:35.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.583+0000 7f03d5800640 1 -- 172.21.15.164:0/1159529167 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03d00b6d80 msgr2=0x7f03d01db3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:35.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.583+0000 7f03d5800640 1 --2- 172.21.15.164:0/1159529167 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03d00b6d80 0x7f03d01db3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:35.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.583+0000 7f03d5800640 1 -- 172.21.15.164:0/1159529167 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03d0142330 con 0x7f03d00b5f30 2024-04-17T05:26:35.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.584+0000 7f03d5800640 1 --2- 172.21.15.164:0/1159529167 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03d00b5f30 0x7f03d0140d20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f03c4009870 tx=0x7f03c4004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:35.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.584+0000 7f03cd600640 1 -- 172.21.15.164:0/1159529167 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c4048070 con 0x7f03d00b5f30 2024-04-17T05:26:35.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.584+0000 7f03cd600640 1 -- 172.21.15.164:0/1159529167 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03c4039d90 con 0x7f03d00b5f30 2024-04-17T05:26:35.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.584+0000 7f03cd600640 1 -- 172.21.15.164:0/1159529167 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c4034040 con 0x7f03d00b5f30 2024-04-17T05:26:35.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.584+0000 7f03d6c00640 1 -- 172.21.15.164:0/1159529167 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03d0142610 con 0x7f03d00b5f30 2024-04-17T05:26:35.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.584+0000 7f03d6c00640 1 -- 172.21.15.164:0/1159529167 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03d0141d40 con 0x7f03d00b5f30 2024-04-17T05:26:35.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.585+0000 7f03cd600640 1 -- 172.21.15.164:0/1159529167 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f03c4037070 con 0x7f03d00b5f30 2024-04-17T05:26:35.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.585+0000 7f03cd600640 1 -- 172.21.15.164:0/1159529167 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f03c4043de0 con 0x7f03d00b5f30 2024-04-17T05:26:35.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.585+0000 7f03d6c00640 1 -- 172.21.15.164:0/1159529167 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03d0075b30 con 0x7f03d00b5f30 2024-04-17T05:26:35.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.588+0000 7f03cd600640 1 -- 172.21.15.164:0/1159529167 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7f03c4051080 con 0x7f03d00b5f30 2024-04-17T05:26:35.637 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-17T05:26:35.639+0000 7f8d53c52040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-17T05:26:35.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.667+0000 7f03d6c00640 1 -- 172.21.15.164:0/1159529167 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd new", "uuid": "43e59318-2740-4625-9d64-eec1fd43c322", "id": 4} v 0) -- 0x7f03d013d4e0 con 0x7f03d00b5f30 2024-04-17T05:26:35.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.674+0000 7f03cd600640 1 -- 172.21.15.164:0/1159529167 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "43e59318-2740-4625-9d64-eec1fd43c322", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f03c40307f0 con 0x7f03d00b5f30 2024-04-17T05:26:35.673 INFO:teuthology.orchestra.run.smithi164.stdout:4 2024-04-17T05:26:35.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.676+0000 7f03d6c00640 1 -- 172.21.15.164:0/1159529167 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03d00b5f30 msgr2=0x7f03d0140d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:35.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.676+0000 7f03d6c00640 1 --2- 172.21.15.164:0/1159529167 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03d00b5f30 0x7f03d0140d20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f03c4009870 tx=0x7f03c4004730 comp rx=0 tx=0).stop 2024-04-17T05:26:35.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.676+0000 7f03d6c00640 1 -- 172.21.15.164:0/1159529167 shutdown_connections 2024-04-17T05:26:35.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.676+0000 7f03d6c00640 1 --2- 172.21.15.164:0/1159529167 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03d013ffb0 0x7f03d01db8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:35.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.676+0000 7f03d6c00640 1 --2- 172.21.15.164:0/1159529167 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03d00b6d80 0x7f03d01db3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:35.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.676+0000 7f03d6c00640 1 --2- 172.21.15.164:0/1159529167 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03d00b5f30 0x7f03d0140d20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:35.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.676+0000 7f03d6c00640 1 -- 172.21.15.164:0/1159529167 >> 172.21.15.164:0/1159529167 conn(0x7f03d006c140 msgr2=0x7f03d00bb260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:35.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.676+0000 7f03d6c00640 1 -- 172.21.15.164:0/1159529167 shutdown_connections 2024-04-17T05:26:35.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.676+0000 7f03d6c00640 1 -- 172.21.15.164:0/1159529167 wait complete. 2024-04-17T05:26:35.691 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new aaa3acf4-4adc-4337-aba3-363851d35310 5 2024-04-17T05:26:35.692 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-17T05:26:35.694+0000 7f8d53c52040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-17T05:26:35.719 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-17T05:26:35.721+0000 7ff2583db040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-17T05:26:35.869 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-17T05:26:35.870+0000 7ff2583db040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-17T05:26:35.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.871+0000 7fc5c4c00640 1 Processor -- start 2024-04-17T05:26:35.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.871+0000 7fc5c4c00640 1 -- start start 2024-04-17T05:26:35.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.873+0000 7fc5c4c00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc5c00b7c60 0x7fc5c01485b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:35.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.873+0000 7fc5c4c00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5c00b5940 con 0x7fc5c00b5560 2024-04-17T05:26:35.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.873+0000 7fc5c4c00640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5c0147ad0 con 0x7fc5c0141e70 2024-04-17T05:26:35.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.873+0000 7fc5c4c00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7fc5c00b8090 con 0x7fc5c00b7c60 2024-04-17T05:26:35.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.873+0000 7fc5bfe00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc5c00b7c60 0x7fc5c01485b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:35.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.873+0000 7fc5bfe00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc5c00b7c60 0x7fc5c01485b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:42214/0 (socket says 172.21.15.164:42214) 2024-04-17T05:26:35.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.873+0000 7fc5bfe00640 1 -- 172.21.15.164:0/535926699 learned_addr learned my addr 172.21.15.164:0/535926699 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-17T05:26:35.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.873+0000 7fc5bfe00640 1 -- 172.21.15.164:0/535926699 >> v1:172.21.15.164:6789/0 conn(0x7fc5c0141e70 legacy=0x7fc5c0150330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:35.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.873+0000 7fc5bfe00640 1 -- 172.21.15.164:0/535926699 >> v1:172.21.15.123:6789/0 conn(0x7fc5c00b5560 legacy=0x7fc5c0141760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:35.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.873+0000 7fc5bfe00640 1 -- 172.21.15.164:0/535926699 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c0147db0 con 0x7fc5c00b7c60 2024-04-17T05:26:35.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.874+0000 7fc5bfe00640 1 --2- 172.21.15.164:0/535926699 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5c00b7c60 0x7fc5c01485b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8009e50 tx=0x7fc5b802be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be5a409d352a1679 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:35.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.875+0000 7fc5bea00640 1 -- 172.21.15.164:0/535926699 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b802c9f0 con 0x7fc5c00b7c60 2024-04-17T05:26:35.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.875+0000 7fc5bea00640 1 -- 172.21.15.164:0/535926699 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5b802cb90 con 0x7fc5c00b7c60 2024-04-17T05:26:35.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.875+0000 7fc5bea00640 1 -- 172.21.15.164:0/535926699 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b80343f0 con 0x7fc5c00b7c60 2024-04-17T05:26:35.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.875+0000 7fc5c4c00640 1 -- 172.21.15.164:0/535926699 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5c00b7c60 msgr2=0x7fc5c01485b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:35.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.875+0000 7fc5c4c00640 1 --2- 172.21.15.164:0/535926699 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5c00b7c60 0x7fc5c01485b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8009e50 tx=0x7fc5b802be50 comp rx=0 tx=0).stop 2024-04-17T05:26:35.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.876+0000 7fc5c4c00640 1 -- 172.21.15.164:0/535926699 shutdown_connections 2024-04-17T05:26:35.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.876+0000 7fc5c4c00640 1 --2- 172.21.15.164:0/535926699 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5c00b7c60 0x7fc5c01485b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:35.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.876+0000 7fc5c4c00640 1 -- 172.21.15.164:0/535926699 >> 172.21.15.164:0/535926699 conn(0x7fc5c006c200 msgr2=0x7fc5c00bd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:35.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.876+0000 7fc5c4c00640 1 -- 172.21.15.164:0/535926699 shutdown_connections 2024-04-17T05:26:35.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.876+0000 7fc5c4c00640 1 -- 172.21.15.164:0/535926699 wait complete. 2024-04-17T05:26:35.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.877+0000 7fc5c4c00640 1 Processor -- start 2024-04-17T05:26:35.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.877+0000 7fc5c4c00640 1 -- start start 2024-04-17T05:26:35.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.878+0000 7fc5c4c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5c00b5560 0x7fc5c013d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:35.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.878+0000 7fc5c4c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5c00b7c60 0x7fc5c013ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:35.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.878+0000 7fc5c4c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5c0141e70 0x7fc5c013bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:35.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.878+0000 7fc5c4c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c00b4d10 con 0x7fc5c00b5560 2024-04-17T05:26:35.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.878+0000 7fc5c4c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c0148120 con 0x7fc5c00b7c60 2024-04-17T05:26:35.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.878+0000 7fc5c4c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fc5c00b4e90 con 0x7fc5c0141e70 2024-04-17T05:26:35.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.878+0000 7fc5bfe00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5c0141e70 0x7fc5c013bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:35.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.878+0000 7fc5b7e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5c00b7c60 0x7fc5c013ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:35.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.878+0000 7fc5bfe00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5c0141e70 0x7fc5c013bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:57302/0 (socket says 172.21.15.164:57302) 2024-04-17T05:26:35.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.878+0000 7fc5bfe00640 1 -- 172.21.15.164:0/865661974 learned_addr learned my addr 172.21.15.164:0/865661974 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-17T05:26:35.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.878+0000 7fc5bf400640 1 --2- 172.21.15.164:0/865661974 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5c00b5560 0x7fc5c013d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:35.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.879+0000 7fc5bfe00640 1 -- 172.21.15.164:0/865661974 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5c00b7c60 msgr2=0x7fc5c013ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:35.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.879+0000 7fc5bfe00640 1 --2- 172.21.15.164:0/865661974 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5c00b7c60 0x7fc5c013ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:35.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.879+0000 7fc5bfe00640 1 -- 172.21.15.164:0/865661974 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5c00b5560 msgr2=0x7fc5c013d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:35.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.879+0000 7fc5bfe00640 1 --2- 172.21.15.164:0/865661974 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5c00b5560 0x7fc5c013d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:35.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.879+0000 7fc5bfe00640 1 -- 172.21.15.164:0/865661974 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c013b3c0 con 0x7fc5c0141e70 2024-04-17T05:26:35.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.879+0000 7fc5b7e00640 1 --2- 172.21.15.164:0/865661974 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5c00b7c60 0x7fc5c013ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T05:26:35.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.879+0000 7fc5bfe00640 1 --2- 172.21.15.164:0/865661974 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5c0141e70 0x7fc5c013bf70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8009e50 tx=0x7fc5b8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:35.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.879+0000 7fc5b7400640 1 -- 172.21.15.164:0/865661974 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b8044020 con 0x7fc5c0141e70 2024-04-17T05:26:35.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.879+0000 7fc5b7400640 1 -- 172.21.15.164:0/865661974 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5b8040470 con 0x7fc5c0141e70 2024-04-17T05:26:35.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.879+0000 7fc5c4c00640 1 -- 172.21.15.164:0/865661974 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5c013a940 con 0x7fc5c0141e70 2024-04-17T05:26:35.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.879+0000 7fc5b7400640 1 -- 172.21.15.164:0/865661974 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b8040860 con 0x7fc5c0141e70 2024-04-17T05:26:35.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.880+0000 7fc5c4c00640 1 -- 172.21.15.164:0/865661974 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5c00b8fc0 con 0x7fc5c0141e70 2024-04-17T05:26:35.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.880+0000 7fc5b7400640 1 -- 172.21.15.164:0/865661974 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc5b8047020 con 0x7fc5c0141e70 2024-04-17T05:26:35.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.880+0000 7fc5b7400640 1 -- 172.21.15.164:0/865661974 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fc5b802ca10 con 0x7fc5c0141e70 2024-04-17T05:26:35.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.881+0000 7fc5c4c00640 1 -- 172.21.15.164:0/865661974 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5c0075b30 con 0x7fc5c0141e70 2024-04-17T05:26:35.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.883+0000 7fc5b7400640 1 -- 172.21.15.164:0/865661974 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7fc5b804e030 con 0x7fc5c0141e70 2024-04-17T05:26:35.925 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-17T05:26:35.927+0000 7ff2583db040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-17T05:26:35.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.962+0000 7fc5c4c00640 1 -- 172.21.15.164:0/865661974 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd new", "uuid": "aaa3acf4-4adc-4337-aba3-363851d35310", "id": 5} v 0) -- 0x7fc5c01453e0 con 0x7fc5c0141e70 2024-04-17T05:26:35.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.969+0000 7fc5b7400640 1 -- 172.21.15.164:0/865661974 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aaa3acf4-4adc-4337-aba3-363851d35310", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fc5c013a940 con 0x7fc5c0141e70 2024-04-17T05:26:35.968 INFO:teuthology.orchestra.run.smithi164.stdout:5 2024-04-17T05:26:35.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.971+0000 7fc5c4c00640 1 -- 172.21.15.164:0/865661974 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5c0141e70 msgr2=0x7fc5c013bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:35.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.971+0000 7fc5c4c00640 1 --2- 172.21.15.164:0/865661974 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5c0141e70 0x7fc5c013bf70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8009e50 tx=0x7fc5b8004a40 comp rx=0 tx=0).stop 2024-04-17T05:26:35.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.972+0000 7fc5c4c00640 1 -- 172.21.15.164:0/865661974 shutdown_connections 2024-04-17T05:26:35.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.972+0000 7fc5c4c00640 1 --2- 172.21.15.164:0/865661974 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5c0141e70 0x7fc5c013bf70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:35.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.972+0000 7fc5c4c00640 1 --2- 172.21.15.164:0/865661974 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5c00b7c60 0x7fc5c013ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:35.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.972+0000 7fc5c4c00640 1 --2- 172.21.15.164:0/865661974 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5c00b5560 0x7fc5c013d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:35.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.972+0000 7fc5c4c00640 1 -- 172.21.15.164:0/865661974 >> 172.21.15.164:0/865661974 conn(0x7fc5c006c200 msgr2=0x7fc5c0141530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:35.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.972+0000 7fc5c4c00640 1 -- 172.21.15.164:0/865661974 shutdown_connections 2024-04-17T05:26:35.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:35.972+0000 7fc5c4c00640 1 -- 172.21.15.164:0/865661974 wait complete. 2024-04-17T05:26:35.991 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 6f765b27-7377-4d81-9192-23a965651145 6 2024-04-17T05:26:36.068 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-17T05:26:36.070+0000 7ff2583db040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-17T05:26:36.143 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-17T05:26:36.145+0000 7f8d53c52040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-17T05:26:36.201 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-17T05:26:36.202+0000 7ff2583db040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-17T05:26:36.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.236+0000 7f0a05200640 1 Processor -- start 2024-04-17T05:26:36.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.236+0000 7f0a05200640 1 -- start start 2024-04-17T05:26:36.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.238+0000 7f0a05200640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0a000b7d00 0x7f0a001483a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:36.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.238+0000 7f0a05200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a00147920 con 0x7f0a000b62f0 2024-04-17T05:26:36.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.238+0000 7f0a05200640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a00147ba0 con 0x7f0a00141620 2024-04-17T05:26:36.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.238+0000 7f0a05200640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f0a001488e0 con 0x7f0a000b7d00 2024-04-17T05:26:36.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.238+0000 7f09f7e00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0a000b7d00 0x7f0a001483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:36.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.238+0000 7f09f7e00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0a000b7d00 0x7f0a001483a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:42232/0 (socket says 172.21.15.164:42232) 2024-04-17T05:26:36.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.238+0000 7f09f7e00640 1 -- 172.21.15.164:0/1846802468 learned_addr learned my addr 172.21.15.164:0/1846802468 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-17T05:26:36.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.238+0000 7f09f7e00640 1 -- 172.21.15.164:0/1846802468 >> v1:172.21.15.164:6789/0 conn(0x7f0a00141620 legacy=0x7f0a00141a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:36.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.238+0000 7f09f7e00640 1 -- 172.21.15.164:0/1846802468 >> v1:172.21.15.123:6789/0 conn(0x7f0a000b62f0 legacy=0x7f0a000b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:36.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.238+0000 7f09f7e00640 1 -- 172.21.15.164:0/1846802468 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a00147e80 con 0x7f0a000b7d00 2024-04-17T05:26:36.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.240+0000 7f09f7e00640 1 --2- 172.21.15.164:0/1846802468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a000b7d00 0x7f0a001483a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f09e8009870 tx=0x7f09e802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a85aa6830d82f92 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:36.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.240+0000 7f09fea00640 1 -- 172.21.15.164:0/1846802468 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e8034070 con 0x7f0a000b7d00 2024-04-17T05:26:36.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.240+0000 7f09fea00640 1 -- 172.21.15.164:0/1846802468 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e8030860 con 0x7f0a000b7d00 2024-04-17T05:26:36.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.240+0000 7f09fea00640 1 -- 172.21.15.164:0/1846802468 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e8030c30 con 0x7f0a000b7d00 2024-04-17T05:26:36.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.241+0000 7f0a05200640 1 -- 172.21.15.164:0/1846802468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a000b7d00 msgr2=0x7f0a001483a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:36.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.241+0000 7f0a05200640 1 --2- 172.21.15.164:0/1846802468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a000b7d00 0x7f0a001483a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f09e8009870 tx=0x7f09e802b9a0 comp rx=0 tx=0).stop 2024-04-17T05:26:36.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.241+0000 7f0a05200640 1 -- 172.21.15.164:0/1846802468 shutdown_connections 2024-04-17T05:26:36.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.241+0000 7f0a05200640 1 --2- 172.21.15.164:0/1846802468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a000b7d00 0x7f0a001483a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:36.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.241+0000 7f0a05200640 1 -- 172.21.15.164:0/1846802468 >> 172.21.15.164:0/1846802468 conn(0x7f0a0006b980 msgr2=0x7f0a0006bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:36.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.241+0000 7f0a05200640 1 -- 172.21.15.164:0/1846802468 shutdown_connections 2024-04-17T05:26:36.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.241+0000 7f0a05200640 1 -- 172.21.15.164:0/1846802468 wait complete. 2024-04-17T05:26:36.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.242+0000 7f0a05200640 1 Processor -- start 2024-04-17T05:26:36.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.242+0000 7f0a05200640 1 -- start start 2024-04-17T05:26:36.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.243+0000 7f0a05200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0a000b62f0 0x7f0a00149010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:36.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.243+0000 7f0a05200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a000b7d00 0x7f0a000bc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:36.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.243+0000 7f0a05200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a00141620 0x7f0a000bc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:36.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.243+0000 7f0a05200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0a000b7530 con 0x7f0a00141620 2024-04-17T05:26:36.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.243+0000 7f0a05200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f0a000b66d0 con 0x7f0a000b7d00 2024-04-17T05:26:36.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.243+0000 7f0a05200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f0a001532b0 con 0x7f0a000b62f0 2024-04-17T05:26:36.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.244+0000 7f09ff400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0a000b62f0 0x7f0a00149010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:36.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.244+0000 7f09f7e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a000b7d00 0x7f0a000bc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:36.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.244+0000 7f09ff400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0a000b62f0 0x7f0a00149010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:57318/0 (socket says 172.21.15.164:57318) 2024-04-17T05:26:36.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.244+0000 7f09ff400640 1 -- 172.21.15.164:0/1558498959 learned_addr learned my addr 172.21.15.164:0/1558498959 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-17T05:26:36.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.244+0000 7f09ffe00640 1 --2- 172.21.15.164:0/1558498959 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a00141620 0x7f0a000bc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:36.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.244+0000 7f09f7e00640 1 -- 172.21.15.164:0/1558498959 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0a000b62f0 msgr2=0x7f0a00149010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:36.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.244+0000 7f09f7e00640 1 --2- 172.21.15.164:0/1558498959 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0a000b62f0 0x7f0a00149010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:36.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.244+0000 7f09f7e00640 1 -- 172.21.15.164:0/1558498959 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a00141620 msgr2=0x7f0a000bc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:36.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.244+0000 7f09f7e00640 1 --2- 172.21.15.164:0/1558498959 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a00141620 0x7f0a000bc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:36.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.244+0000 7f09f7e00640 1 -- 172.21.15.164:0/1558498959 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a0014b930 con 0x7f0a000b7d00 2024-04-17T05:26:36.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.244+0000 7f09f7e00640 1 --2- 172.21.15.164:0/1558498959 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a000b7d00 0x7f0a000bc290 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0a000be440 tx=0x7f09e8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:36.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.245+0000 7f09f7400640 1 -- 172.21.15.164:0/1558498959 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e8048070 con 0x7f0a000b7d00 2024-04-17T05:26:36.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.245+0000 7f09f7400640 1 -- 172.21.15.164:0/1558498959 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e8039d90 con 0x7f0a000b7d00 2024-04-17T05:26:36.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.245+0000 7f09f7400640 1 -- 172.21.15.164:0/1558498959 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e8034040 con 0x7f0a000b7d00 2024-04-17T05:26:36.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.245+0000 7f0a05200640 1 -- 172.21.15.164:0/1558498959 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a001496a0 con 0x7f0a000b7d00 2024-04-17T05:26:36.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.245+0000 7f0a05200640 1 -- 172.21.15.164:0/1558498959 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a00148ae0 con 0x7f0a000b7d00 2024-04-17T05:26:36.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.245+0000 7f09f7400640 1 -- 172.21.15.164:0/1558498959 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f09e8037070 con 0x7f0a000b7d00 2024-04-17T05:26:36.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.245+0000 7f09f7400640 1 -- 172.21.15.164:0/1558498959 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f09e8043d80 con 0x7f0a000b7d00 2024-04-17T05:26:36.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.246+0000 7f0a05200640 1 -- 172.21.15.164:0/1558498959 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a00146100 con 0x7f0a000b7d00 2024-04-17T05:26:36.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.248+0000 7f09f7400640 1 -- 172.21.15.164:0/1558498959 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7f0a00146100 con 0x7f0a000b7d00 2024-04-17T05:26:36.303 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-17T05:26:36.305+0000 7f8d53c52040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-17T05:26:36.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.327+0000 7f0a05200640 1 -- 172.21.15.164:0/1558498959 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6f765b27-7377-4d81-9192-23a965651145", "id": 6} v 0) -- 0x7f0a000b8da0 con 0x7f0a000b7d00 2024-04-17T05:26:36.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.337+0000 7f09f7400640 1 -- 172.21.15.164:0/1558498959 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6f765b27-7377-4d81-9192-23a965651145", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f0a000b8da0 con 0x7f0a000b7d00 2024-04-17T05:26:36.336 INFO:teuthology.orchestra.run.smithi164.stdout:6 2024-04-17T05:26:36.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.339+0000 7f0a05200640 1 -- 172.21.15.164:0/1558498959 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a000b7d00 msgr2=0x7f0a000bc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:36.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.339+0000 7f0a05200640 1 --2- 172.21.15.164:0/1558498959 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a000b7d00 0x7f0a000bc290 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0a000be440 tx=0x7f09e8004730 comp rx=0 tx=0).stop 2024-04-17T05:26:36.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.339+0000 7f0a05200640 1 -- 172.21.15.164:0/1558498959 shutdown_connections 2024-04-17T05:26:36.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.339+0000 7f0a05200640 1 --2- 172.21.15.164:0/1558498959 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a00141620 0x7f0a000bc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:36.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.339+0000 7f0a05200640 1 --2- 172.21.15.164:0/1558498959 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0a000b7d00 0x7f0a000bc290 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:36.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.339+0000 7f0a05200640 1 --2- 172.21.15.164:0/1558498959 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0a000b62f0 0x7f0a00149010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:36.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.339+0000 7f0a05200640 1 -- 172.21.15.164:0/1558498959 >> 172.21.15.164:0/1558498959 conn(0x7f0a0006b980 msgr2=0x7f0a000b8100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:36.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.339+0000 7f0a05200640 1 -- 172.21.15.164:0/1558498959 shutdown_connections 2024-04-17T05:26:36.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.339+0000 7f0a05200640 1 -- 172.21.15.164:0/1558498959 wait complete. 2024-04-17T05:26:36.354 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 5547394b-ec2f-4311-846d-369af4b1acf1 7 2024-04-17T05:26:36.390 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-17T05:26:36.391+0000 7ff2583db040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-17T05:26:36.428 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-17T05:26:36.430+0000 7f8d53c52040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-17T05:26:36.442 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-17T05:26:36.444+0000 7ff2583db040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-17T05:26:36.481 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-17T05:26:36.483+0000 7f8d53c52040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-17T05:26:36.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.587+0000 7fd943200640 1 Processor -- start 2024-04-17T05:26:36.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.587+0000 7fd943200640 1 -- start start 2024-04-17T05:26:36.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.588+0000 7fd943200640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd9440b5560 0x7fd9440b7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:36.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.589+0000 7fd943200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9440b5940 con 0x7fd944141e70 2024-04-17T05:26:36.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.589+0000 7fd943200640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd944147ad0 con 0x7fd9441485b0 2024-04-17T05:26:36.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.589+0000 7fd943200640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7fd944148120 con 0x7fd9440b5560 2024-04-17T05:26:36.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.589+0000 7fd941e00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd9440b5560 0x7fd9440b7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:36.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.589+0000 7fd941e00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd9440b5560 0x7fd9440b7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:42250/0 (socket says 172.21.15.164:42250) 2024-04-17T05:26:36.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.589+0000 7fd941e00640 1 -- 172.21.15.164:0/4069275334 learned_addr learned my addr 172.21.15.164:0/4069275334 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-17T05:26:36.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.589+0000 7fd941e00640 1 -- 172.21.15.164:0/4069275334 >> v1:172.21.15.164:6789/0 conn(0x7fd9441485b0 legacy=0x7fd944141760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:36.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.589+0000 7fd941e00640 1 -- 172.21.15.164:0/4069275334 >> v1:172.21.15.123:6789/0 conn(0x7fd944141e70 legacy=0x7fd944152340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:36.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.589+0000 7fd941e00640 1 -- 172.21.15.164:0/4069275334 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd944147db0 con 0x7fd9440b5560 2024-04-17T05:26:36.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.590+0000 7fd941e00640 1 --2- 172.21.15.164:0/4069275334 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9440b5560 0x7fd9440b7c60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd934009870 tx=0x7fd93402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b56e273fcff8149 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:36.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.591+0000 7fd941400640 1 -- 172.21.15.164:0/4069275334 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd934035020 con 0x7fd9440b5560 2024-04-17T05:26:36.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.591+0000 7fd941400640 1 -- 172.21.15.164:0/4069275334 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd934031870 con 0x7fd9440b5560 2024-04-17T05:26:36.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.591+0000 7fd941400640 1 -- 172.21.15.164:0/4069275334 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd934031c40 con 0x7fd9440b5560 2024-04-17T05:26:36.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.591+0000 7fd943200640 1 -- 172.21.15.164:0/4069275334 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9440b5560 msgr2=0x7fd9440b7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:36.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.591+0000 7fd943200640 1 --2- 172.21.15.164:0/4069275334 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9440b5560 0x7fd9440b7c60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd934009870 tx=0x7fd93402b910 comp rx=0 tx=0).stop 2024-04-17T05:26:36.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.591+0000 7fd943200640 1 -- 172.21.15.164:0/4069275334 shutdown_connections 2024-04-17T05:26:36.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.591+0000 7fd943200640 1 --2- 172.21.15.164:0/4069275334 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9440b5560 0x7fd9440b7c60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:36.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.591+0000 7fd943200640 1 -- 172.21.15.164:0/4069275334 >> 172.21.15.164:0/4069275334 conn(0x7fd94406c200 msgr2=0x7fd9440bd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:36.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.592+0000 7fd943200640 1 -- 172.21.15.164:0/4069275334 shutdown_connections 2024-04-17T05:26:36.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.592+0000 7fd943200640 1 -- 172.21.15.164:0/4069275334 wait complete. 2024-04-17T05:26:36.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.593+0000 7fd943200640 1 Processor -- start 2024-04-17T05:26:36.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.593+0000 7fd943200640 1 -- start start 2024-04-17T05:26:36.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.594+0000 7fd943200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9440b5560 0x7fd9441e0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:36.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.594+0000 7fd943200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd944141e70 0x7fd94413edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:36.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.594+0000 7fd943200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9441485b0 0x7fd944146ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:36.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.594+0000 7fd943200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd9440b4e90 con 0x7fd9440b5560 2024-04-17T05:26:36.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.594+0000 7fd943200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd9440b4d10 con 0x7fd9441485b0 2024-04-17T05:26:36.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.594+0000 7fd943200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fd9440b6230 con 0x7fd944141e70 2024-04-17T05:26:36.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.594+0000 7fd93be00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd944141e70 0x7fd94413edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:36.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.594+0000 7fd942800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9441485b0 0x7fd944146ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:36.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.594+0000 7fd93be00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd944141e70 0x7fd94413edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:57332/0 (socket says 172.21.15.164:57332) 2024-04-17T05:26:36.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.594+0000 7fd93be00640 1 -- 172.21.15.164:0/3774602576 learned_addr learned my addr 172.21.15.164:0/3774602576 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-04-17T05:26:36.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.594+0000 7fd942800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9441485b0 0x7fd944146ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:42258/0 (socket says 172.21.15.164:42258) 2024-04-17T05:26:36.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.594+0000 7fd941e00640 1 --2- 172.21.15.164:0/3774602576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9440b5560 0x7fd9441e0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:36.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.595+0000 7fd942800640 1 -- 172.21.15.164:0/3774602576 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd944141e70 msgr2=0x7fd94413edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:36.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.595+0000 7fd942800640 1 --2- 172.21.15.164:0/3774602576 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd944141e70 0x7fd94413edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:36.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.595+0000 7fd942800640 1 -- 172.21.15.164:0/3774602576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9440b5560 msgr2=0x7fd9441e0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:36.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.595+0000 7fd942800640 1 --2- 172.21.15.164:0/3774602576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9440b5560 0x7fd9441e0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:36.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.595+0000 7fd942800640 1 -- 172.21.15.164:0/3774602576 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd944142a80 con 0x7fd9441485b0 2024-04-17T05:26:36.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.595+0000 7fd93be00640 1 --2- 172.21.15.164:0/3774602576 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd944141e70 0x7fd94413edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T05:26:36.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.595+0000 7fd942800640 1 --2- 172.21.15.164:0/3774602576 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9441485b0 0x7fd944146ff0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd93c00c690 tx=0x7fd93c00cb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:36.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.595+0000 7fd93a000640 1 -- 172.21.15.164:0/3774602576 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c003b70 con 0x7fd9441485b0 2024-04-17T05:26:36.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.595+0000 7fd93a000640 1 -- 172.21.15.164:0/3774602576 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd93c003d10 con 0x7fd9441485b0 2024-04-17T05:26:36.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.595+0000 7fd943200640 1 -- 172.21.15.164:0/3774602576 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9441467f0 con 0x7fd9441485b0 2024-04-17T05:26:36.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.595+0000 7fd93a000640 1 -- 172.21.15.164:0/3774602576 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c005310 con 0x7fd9441485b0 2024-04-17T05:26:36.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.595+0000 7fd943200640 1 -- 172.21.15.164:0/3774602576 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd94413cb20 con 0x7fd9441485b0 2024-04-17T05:26:36.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.596+0000 7fd93a000640 1 -- 172.21.15.164:0/3774602576 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd93c0054b0 con 0x7fd9441485b0 2024-04-17T05:26:36.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.596+0000 7fd93a000640 1 -- 172.21.15.164:0/3774602576 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fd93c0057a0 con 0x7fd9441485b0 2024-04-17T05:26:36.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.597+0000 7fd943200640 1 -- 172.21.15.164:0/3774602576 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd944075b30 con 0x7fd9441485b0 2024-04-17T05:26:36.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.599+0000 7fd93a000640 1 -- 172.21.15.164:0/3774602576 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7fd93c00a640 con 0x7fd9441485b0 2024-04-17T05:26:36.607 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-17T05:26:36.610+0000 7f8d53c52040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-17T05:26:36.628 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-17T05:26:36.630+0000 7ff2583db040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-17T05:26:36.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.679+0000 7fd943200640 1 -- 172.21.15.164:0/3774602576 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5547394b-ec2f-4311-846d-369af4b1acf1", "id": 7} v 0) -- 0x7fd94413d080 con 0x7fd9441485b0 2024-04-17T05:26:36.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.690+0000 7fd93a000640 1 -- 172.21.15.164:0/3774602576 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5547394b-ec2f-4311-846d-369af4b1acf1", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fd93c00a820 con 0x7fd9441485b0 2024-04-17T05:26:36.689 INFO:teuthology.orchestra.run.smithi164.stdout:7 2024-04-17T05:26:36.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.692+0000 7fd943200640 1 -- 172.21.15.164:0/3774602576 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9441485b0 msgr2=0x7fd944146ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:36.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.692+0000 7fd943200640 1 --2- 172.21.15.164:0/3774602576 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9441485b0 0x7fd944146ff0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd93c00c690 tx=0x7fd93c00cb50 comp rx=0 tx=0).stop 2024-04-17T05:26:36.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.692+0000 7fd943200640 1 -- 172.21.15.164:0/3774602576 shutdown_connections 2024-04-17T05:26:36.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.692+0000 7fd943200640 1 --2- 172.21.15.164:0/3774602576 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9441485b0 0x7fd944146ff0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:36.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.692+0000 7fd943200640 1 --2- 172.21.15.164:0/3774602576 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd944141e70 0x7fd94413edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:36.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.692+0000 7fd943200640 1 --2- 172.21.15.164:0/3774602576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9440b5560 0x7fd9441e0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:36.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.692+0000 7fd943200640 1 -- 172.21.15.164:0/3774602576 >> 172.21.15.164:0/3774602576 conn(0x7fd94406c200 msgr2=0x7fd9440bc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:36.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.692+0000 7fd943200640 1 -- 172.21.15.164:0/3774602576 shutdown_connections 2024-04-17T05:26:36.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-17T05:26:36.692+0000 7fd943200640 1 -- 172.21.15.164:0/3774602576 wait complete. 2024-04-17T05:26:36.707 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-17T05:26:36.708 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-17T05:26:36.715 INFO:tasks.ceph.osd.0:Started 2024-04-17T05:26:36.715 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-17T05:26:36.715 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-17T05:26:36.722 INFO:tasks.ceph.osd.1:Started 2024-04-17T05:26:36.722 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-17T05:26:36.722 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-17T05:26:36.723 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-17T05:26:36.722+0000 7f8d53c52040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-17T05:26:36.728 INFO:tasks.ceph.osd.2:Started 2024-04-17T05:26:36.728 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-17T05:26:36.729 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-17T05:26:36.735 INFO:tasks.ceph.osd.3:Started 2024-04-17T05:26:36.735 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-17T05:26:36.735 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-17T05:26:36.740 INFO:tasks.ceph.osd.4:Started 2024-04-17T05:26:36.741 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-17T05:26:36.741 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-17T05:26:36.746 INFO:tasks.ceph.osd.5:Started 2024-04-17T05:26:36.746 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-17T05:26:36.747 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-17T05:26:36.752 INFO:tasks.ceph.osd.6:Started 2024-04-17T05:26:36.752 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-17T05:26:36.752 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-17T05:26:36.760 INFO:tasks.ceph.osd.7:Started 2024-04-17T05:26:36.761 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T05:26:36.963 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-17T05:26:36.965+0000 7f8d53c52040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-17T05:26:36.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.990+0000 7fed48400640 1 Processor -- start 2024-04-17T05:26:36.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.990+0000 7fed48400640 1 -- start start 2024-04-17T05:26:36.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.991+0000 7fed48400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed400b58b0 0x7fed400b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:36.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.991+0000 7fed48400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fed401486a0 0x7fed4014b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:36.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.991+0000 7fed48400640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed400b5c90 con 0x7fed400b7e90 2024-04-17T05:26:36.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.991+0000 7fed48400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fed40148210 con 0x7fed401486a0 2024-04-17T05:26:36.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.991+0000 7fed48400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fed400b67a0 con 0x7fed400b58b0 2024-04-17T05:26:36.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.992+0000 7fed46400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fed401486a0 0x7fed4014b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:36.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.992+0000 7fed46400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fed401486a0 0x7fed4014b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39172/0 (socket says 172.21.15.123:39172) 2024-04-17T05:26:36.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.992+0000 7fed46400640 1 -- 172.21.15.123:0/3872324954 learned_addr learned my addr 172.21.15.123:0/3872324954 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:26:36.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.992+0000 7fed45000640 1 --1- 172.21.15.123:0/3872324954 >> v1:172.21.15.164:6789/0 conn(0x7fed400b7e90 0x7fed4014b1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.123:60302/0 (socket says 172.21.15.123:60302) 2024-04-17T05:26:36.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.992+0000 7fed45a00640 1 --2- 172.21.15.123:0/3872324954 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed400b58b0 0x7fed400b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:36.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.992+0000 7fed46400640 1 -- 172.21.15.123:0/3872324954 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed400b58b0 msgr2=0x7fed400b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:36.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.992+0000 7fed46400640 1 --2- 172.21.15.123:0/3872324954 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed400b58b0 0x7fed400b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:36.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.992+0000 7fed46400640 1 -- 172.21.15.123:0/3872324954 >> v1:172.21.15.164:6789/0 conn(0x7fed400b7e90 legacy=0x7fed4014b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:36.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.992+0000 7fed46400640 1 -- 172.21.15.123:0/3872324954 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed40147be0 con 0x7fed401486a0 2024-04-17T05:26:36.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.993+0000 7fed46400640 1 --2- 172.21.15.123:0/3872324954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed401486a0 0x7fed4014b8e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fed38009e80 tx=0x7fed3802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c7cfcf0b190cf8a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:36.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.993+0000 7fed3fe00640 1 -- 172.21.15.123:0/3872324954 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3802ca50 con 0x7fed401486a0 2024-04-17T05:26:36.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.993+0000 7fed3fe00640 1 -- 172.21.15.123:0/3872324954 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed3802cbf0 con 0x7fed401486a0 2024-04-17T05:26:36.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.993+0000 7fed3fe00640 1 -- 172.21.15.123:0/3872324954 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed380343f0 con 0x7fed401486a0 2024-04-17T05:26:36.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.994+0000 7fed48400640 1 -- 172.21.15.123:0/3872324954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed401486a0 msgr2=0x7fed4014b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:36.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.994+0000 7fed48400640 1 --2- 172.21.15.123:0/3872324954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed401486a0 0x7fed4014b8e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fed38009e80 tx=0x7fed3802beb0 comp rx=0 tx=0).stop 2024-04-17T05:26:36.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.994+0000 7fed48400640 1 -- 172.21.15.123:0/3872324954 shutdown_connections 2024-04-17T05:26:36.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.994+0000 7fed48400640 1 --2- 172.21.15.123:0/3872324954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed401486a0 0x7fed4014b8e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:36.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.994+0000 7fed48400640 1 --2- 172.21.15.123:0/3872324954 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed400b58b0 0x7fed400b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:36.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.994+0000 7fed48400640 1 -- 172.21.15.123:0/3872324954 >> 172.21.15.123:0/3872324954 conn(0x7fed400bd6f0 msgr2=0x7fed400bdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:36.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.994+0000 7fed48400640 1 -- 172.21.15.123:0/3872324954 shutdown_connections 2024-04-17T05:26:36.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.994+0000 7fed48400640 1 -- 172.21.15.123:0/3872324954 wait complete. 2024-04-17T05:26:36.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.996+0000 7fed48400640 1 Processor -- start 2024-04-17T05:26:36.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.996+0000 7fed48400640 1 -- start start 2024-04-17T05:26:36.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.997+0000 7fed48400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed400b58b0 0x7fed4013fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:36.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.997+0000 7fed48400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed400b7e90 0x7fed401de020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:36.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.997+0000 7fed48400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed401486a0 0x7fed401de560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:36.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.997+0000 7fed48400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fed40147ea0 con 0x7fed401486a0 2024-04-17T05:26:36.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.997+0000 7fed48400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fed400b76b0 con 0x7fed400b7e90 2024-04-17T05:26:36.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.997+0000 7fed48400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fed40148b30 con 0x7fed400b58b0 2024-04-17T05:26:36.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.997+0000 7fed46400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed401486a0 0x7fed401de560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:36.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.997+0000 7fed46400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed401486a0 0x7fed401de560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39178/0 (socket says 172.21.15.123:39178) 2024-04-17T05:26:36.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.997+0000 7fed45a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed400b58b0 0x7fed4013fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:36.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.997+0000 7fed46400640 1 -- 172.21.15.123:0/3196778381 learned_addr learned my addr 172.21.15.123:0/3196778381 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:26:36.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.997+0000 7fed45000640 1 --2- 172.21.15.123:0/3196778381 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed400b7e90 0x7fed401de020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:36.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.997+0000 7fed46400640 1 -- 172.21.15.123:0/3196778381 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed400b58b0 msgr2=0x7fed4013fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:36.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.997+0000 7fed46400640 1 --2- 172.21.15.123:0/3196778381 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed400b58b0 0x7fed4013fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:36.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.997+0000 7fed46400640 1 -- 172.21.15.123:0/3196778381 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed400b7e90 msgr2=0x7fed401de020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:36.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.997+0000 7fed46400640 1 --2- 172.21.15.123:0/3196778381 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed400b7e90 0x7fed401de020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:36.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.997+0000 7fed46400640 1 -- 172.21.15.123:0/3196778381 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed4013eae0 con 0x7fed401486a0 2024-04-17T05:26:36.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.998+0000 7fed46400640 1 --2- 172.21.15.123:0/3196778381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed401486a0 0x7fed401de560 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fed38036040 tx=0x7fed38004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:36.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.998+0000 7fed3d600640 1 -- 172.21.15.123:0/3196778381 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed38043020 con 0x7fed401486a0 2024-04-17T05:26:36.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.998+0000 7fed3d600640 1 -- 172.21.15.123:0/3196778381 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed3803e450 con 0x7fed401486a0 2024-04-17T05:26:36.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.998+0000 7fed3d600640 1 -- 172.21.15.123:0/3196778381 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed38009510 con 0x7fed401486a0 2024-04-17T05:26:36.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.998+0000 7fed48400640 1 -- 172.21.15.123:0/3196778381 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed4013ed60 con 0x7fed401486a0 2024-04-17T05:26:36.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.998+0000 7fed48400640 1 -- 172.21.15.123:0/3196778381 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed4013d580 con 0x7fed401486a0 2024-04-17T05:26:36.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.998+0000 7fed3d600640 1 -- 172.21.15.123:0/3196778381 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fed38046020 con 0x7fed401486a0 2024-04-17T05:26:36.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.998+0000 7fed3d600640 1 -- 172.21.15.123:0/3196778381 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fed38048ad0 con 0x7fed401486a0 2024-04-17T05:26:36.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:36.999+0000 7fed48400640 1 -- 172.21.15.123:0/3196778381 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed40068a40 con 0x7fed401486a0 2024-04-17T05:26:37.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:37.002+0000 7fed3d600640 1 -- 172.21.15.123:0/3196778381 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7fed3804d030 con 0x7fed401486a0 2024-04-17T05:26:37.017 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-17T05:26:37.019+0000 7f8d53c52040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-17T05:26:37.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:37.068+0000 7fed48400640 1 -- 172.21.15.123:0/3196778381 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fed400bdad0 con 0x7fed401486a0 2024-04-17T05:26:37.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:37.069+0000 7fed3d600640 1 -- 172.21.15.123:0/3196778381 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fed4013eae0 con 0x7fed401486a0 2024-04-17T05:26:37.068 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:26:37.068 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":10,"fsid":"0787c5c0-e77a-4102-a899-30db48b19c68","created":"2024-04-17T05:26:33.031507+0000","modified":"2024-04-17T05:26:36.682131+0000","last_up_change":"0.000000","last_in_change":"2024-04-17T05:26:36.682131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"15c87cdb-9415-45a6-a2a6-ea6bec9daece","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"281751b5-486d-4845-b4aa-b308bf7cec62","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b42257d3-bd20-4db5-aa37-1bf5c512d0f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0f26b891-bbe6-478e-8dee-78e69bb48cf0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"43e59318-2740-4625-9d64-eec1fd43c322","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"aaa3acf4-4adc-4337-aba3-363851d35310","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6f765b27-7377-4d81-9192-23a965651145","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5547394b-ec2f-4311-846d-369af4b1acf1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T05:26:37.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:37.070+0000 7fed48400640 1 -- 172.21.15.123:0/3196778381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed401486a0 msgr2=0x7fed401de560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:37.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:37.070+0000 7fed48400640 1 --2- 172.21.15.123:0/3196778381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed401486a0 0x7fed401de560 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fed38036040 tx=0x7fed38004a40 comp rx=0 tx=0).stop 2024-04-17T05:26:37.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:37.071+0000 7fed48400640 1 -- 172.21.15.123:0/3196778381 shutdown_connections 2024-04-17T05:26:37.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:37.071+0000 7fed48400640 1 --2- 172.21.15.123:0/3196778381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed401486a0 0x7fed401de560 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:37.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:37.071+0000 7fed48400640 1 --2- 172.21.15.123:0/3196778381 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed400b7e90 0x7fed401de020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:37.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:37.071+0000 7fed48400640 1 --2- 172.21.15.123:0/3196778381 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed400b58b0 0x7fed4013fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:37.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:37.071+0000 7fed48400640 1 -- 172.21.15.123:0/3196778381 >> 172.21.15.123:0/3196778381 conn(0x7fed400bd6f0 msgr2=0x7fed40146a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:37.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:37.071+0000 7fed48400640 1 -- 172.21.15.123:0/3196778381 shutdown_connections 2024-04-17T05:26:37.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:37.071+0000 7fed48400640 1 -- 172.21.15.123:0/3196778381 wait complete. 2024-04-17T05:26:37.084 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-17T05:26:37.084 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-17T05:26:37.200 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-17T05:26:37.202+0000 7f8d53c52040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-17T05:26:37.416 INFO:tasks.ceph.osd.0.smithi123.stderr:2024-04-17T05:26:37.418+0000 7f686e38a640 -1 Falling back to public interface 2024-04-17T05:26:37.445 INFO:tasks.ceph.osd.3.smithi123.stderr:2024-04-17T05:26:37.447+0000 7efdee1bb640 -1 Falling back to public interface 2024-04-17T05:26:37.448 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-04-17T05:26:37.449+0000 7fb23b413640 -1 Falling back to public interface 2024-04-17T05:26:37.448 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-17T05:26:37.449+0000 7f796ac37640 -1 Falling back to public interface 2024-04-17T05:26:37.449 INFO:tasks.ceph.osd.2.smithi123.stderr:2024-04-17T05:26:37.451+0000 7f73e3511640 -1 Falling back to public interface 2024-04-17T05:26:37.452 INFO:tasks.ceph.osd.1.smithi123.stderr:2024-04-17T05:26:37.455+0000 7ffa53a0d640 -1 Falling back to public interface 2024-04-17T05:26:37.481 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-04-17T05:26:37.483+0000 7f970d993640 -1 Falling back to public interface 2024-04-17T05:26:37.482 INFO:tasks.ceph.osd.7.smithi164.stderr:2024-04-17T05:26:37.483+0000 7f5e1560d640 -1 Falling back to public interface 2024-04-17T05:26:37.756 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-17T05:26:37.757+0000 7ff2583db040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-17T05:26:37.891 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-17T05:26:38.047 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.049+0000 7f19e5000640 1 Processor -- start 2024-04-17T05:26:38.048 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.050+0000 7f19e5000640 1 -- start start 2024-04-17T05:26:38.049 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.051+0000 7f19e5000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19e0141d50 0x7f19e01487a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:38.049 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.051+0000 7f19e5000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19e00b43c0 con 0x7f19e00b7110 2024-04-17T05:26:38.049 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.051+0000 7f19e5000640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19e00b7770 con 0x7f19e00b3fe0 2024-04-17T05:26:38.049 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.051+0000 7f19e5000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f19e0147cc0 con 0x7f19e0141d50 2024-04-17T05:26:38.049 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.051+0000 7f19de800640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f19e00b7110 0x7f19e0152530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:50128/0 (socket says 172.21.15.123:50128) 2024-04-17T05:26:38.049 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.051+0000 7f19de800640 1 -- 172.21.15.123:0/1386055176 learned_addr learned my addr 172.21.15.123:0/1386055176 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:26:38.049 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.051+0000 7f19d5400640 1 --2- 172.21.15.123:0/1386055176 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19e0141d50 0x7f19e01487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:38.050 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.051+0000 7f19dd400640 1 -- 172.21.15.123:0/1386055176 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3117319154 0 0) 0x7f19e00b43c0 con 0x7f19e00b7110 2024-04-17T05:26:38.050 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.052+0000 7f19dd400640 1 -- 172.21.15.123:0/1386055176 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19c4003520 con 0x7f19e00b7110 2024-04-17T05:26:38.050 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.052+0000 7f19d5400640 1 -- 172.21.15.123:0/1386055176 >> v1:172.21.15.164:6789/0 conn(0x7f19e00b3fe0 legacy=0x7f19e0141640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:38.050 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.052+0000 7f19d5400640 1 -- 172.21.15.123:0/1386055176 >> v1:172.21.15.123:6789/0 conn(0x7f19e00b7110 legacy=0x7f19e0152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:38.050 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.052+0000 7f19d5400640 1 -- 172.21.15.123:0/1386055176 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19e0147fa0 con 0x7f19e0141d50 2024-04-17T05:26:38.051 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.053+0000 7f19d5400640 1 --2- 172.21.15.123:0/1386055176 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19e0141d50 0x7f19e01487a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f19c80097d0 tx=0x7f19c802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23fcaa84b24d085 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:38.051 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.053+0000 7f19dd400640 1 -- 172.21.15.123:0/1386055176 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c8035020 con 0x7f19e0141d50 2024-04-17T05:26:38.051 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.053+0000 7f19dd400640 1 -- 172.21.15.123:0/1386055176 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19c8031800 con 0x7f19e0141d50 2024-04-17T05:26:38.051 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.053+0000 7f19dd400640 1 -- 172.21.15.123:0/1386055176 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c8031bb0 con 0x7f19e0141d50 2024-04-17T05:26:38.052 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.054+0000 7f19e5000640 1 -- 172.21.15.123:0/1386055176 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19e0141d50 msgr2=0x7f19e01487a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:38.052 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.054+0000 7f19e5000640 1 --2- 172.21.15.123:0/1386055176 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19e0141d50 0x7f19e01487a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f19c80097d0 tx=0x7f19c802b8a0 comp rx=0 tx=0).stop 2024-04-17T05:26:38.052 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.054+0000 7f19e5000640 1 -- 172.21.15.123:0/1386055176 shutdown_connections 2024-04-17T05:26:38.052 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.054+0000 7f19e5000640 1 --2- 172.21.15.123:0/1386055176 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19e0141d50 0x7f19e01487a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:38.052 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.054+0000 7f19e5000640 1 -- 172.21.15.123:0/1386055176 >> 172.21.15.123:0/1386055176 conn(0x7f19e00bd4f0 msgr2=0x7f19e00bd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:38.052 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.054+0000 7f19e5000640 1 -- 172.21.15.123:0/1386055176 shutdown_connections 2024-04-17T05:26:38.052 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.054+0000 7f19e5000640 1 -- 172.21.15.123:0/1386055176 wait complete. 2024-04-17T05:26:38.054 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.056+0000 7f19e5000640 1 Processor -- start 2024-04-17T05:26:38.054 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.057+0000 7f19e5000640 1 -- start start 2024-04-17T05:26:38.057 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.058+0000 7f19e5000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19e00b3fe0 0x7f19e0144f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:38.057 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.058+0000 7f19e5000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19e00b7110 0x7f19e014b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:38.058 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.058+0000 7f19e5000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19e0141d50 0x7f19e01dd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:38.058 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.058+0000 7f19e5000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f19e00b4b90 con 0x7f19e00b3fe0 2024-04-17T05:26:38.058 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.058+0000 7f19e5000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f19e00b4a10 con 0x7f19e00b7110 2024-04-17T05:26:38.058 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.058+0000 7f19e5000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f19e00b4d10 con 0x7f19e0141d50 2024-04-17T05:26:38.058 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.058+0000 7f19dde00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19e00b3fe0 0x7f19e0144f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:38.058 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.058+0000 7f19dde00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19e00b3fe0 0x7f19e0144f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39188/0 (socket says 172.21.15.123:39188) 2024-04-17T05:26:38.058 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.058+0000 7f19dde00640 1 -- 172.21.15.123:0/2205142366 learned_addr learned my addr 172.21.15.123:0/2205142366 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:26:38.058 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.058+0000 7f19de800640 1 --2- 172.21.15.123:0/2205142366 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19e0141d50 0x7f19e01dd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:38.058 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.058+0000 7f19d5400640 1 --2- 172.21.15.123:0/2205142366 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19e00b7110 0x7f19e014b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:38.058 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.058+0000 7f19dde00640 1 -- 172.21.15.123:0/2205142366 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19e0141d50 msgr2=0x7f19e01dd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:38.058 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.058+0000 7f19dde00640 1 --2- 172.21.15.123:0/2205142366 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19e0141d50 0x7f19e01dd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:38.058 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.059+0000 7f19dde00640 1 -- 172.21.15.123:0/2205142366 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19e00b7110 msgr2=0x7f19e014b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:38.058 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.059+0000 7f19dde00640 1 --2- 172.21.15.123:0/2205142366 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19e00b7110 0x7f19e014b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:38.059 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.059+0000 7f19dde00640 1 -- 172.21.15.123:0/2205142366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19e0142f40 con 0x7f19e00b3fe0 2024-04-17T05:26:38.059 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.059+0000 7f19d5400640 1 --2- 172.21.15.123:0/2205142366 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19e00b7110 0x7f19e014b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T05:26:38.059 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.059+0000 7f19dde00640 1 --2- 172.21.15.123:0/2205142366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19e00b3fe0 0x7f19e0144f40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f19d000c450 tx=0x7f19d000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:38.059 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.059+0000 7f19d6a00640 1 -- 172.21.15.123:0/2205142366 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d00052d0 con 0x7f19e00b3fe0 2024-04-17T05:26:38.059 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.059+0000 7f19d6a00640 1 -- 172.21.15.123:0/2205142366 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19d0005470 con 0x7f19e00b3fe0 2024-04-17T05:26:38.059 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.059+0000 7f19e5000640 1 -- 172.21.15.123:0/2205142366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19e01444d0 con 0x7f19e00b3fe0 2024-04-17T05:26:38.059 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.059+0000 7f19d6a00640 1 -- 172.21.15.123:0/2205142366 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d0012870 con 0x7f19e00b3fe0 2024-04-17T05:26:38.059 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.059+0000 7f19e5000640 1 -- 172.21.15.123:0/2205142366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19e014b450 con 0x7f19e00b3fe0 2024-04-17T05:26:38.059 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.059+0000 7f19d6a00640 1 -- 172.21.15.123:0/2205142366 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f19d0012a10 con 0x7f19e00b3fe0 2024-04-17T05:26:38.059 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.060+0000 7f19d6a00640 1 -- 172.21.15.123:0/2205142366 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f19d0012d00 con 0x7f19e00b3fe0 2024-04-17T05:26:38.060 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.061+0000 7f19e5000640 1 -- 172.21.15.123:0/2205142366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19e0069320 con 0x7f19e00b3fe0 2024-04-17T05:26:38.061 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.063+0000 7f19d6a00640 1 -- 172.21.15.123:0/2205142366 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7f19d00035f0 con 0x7f19e00b3fe0 2024-04-17T05:26:38.074 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-17T05:26:38.076+0000 7ff2583db040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-17T05:26:38.129 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.131+0000 7f19e5000640 1 -- 172.21.15.123:0/2205142366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f19e006b920 con 0x7f19e00b3fe0 2024-04-17T05:26:38.130 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.132+0000 7f19d6a00640 1 -- 172.21.15.123:0/2205142366 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f19d0003880 con 0x7f19e00b3fe0 2024-04-17T05:26:38.130 INFO:teuthology.misc.health.smithi123.stdout: 2024-04-17T05:26:38.130 INFO:teuthology.misc.health.smithi123.stdout:{"epoch":10,"fsid":"0787c5c0-e77a-4102-a899-30db48b19c68","created":"2024-04-17T05:26:33.031507+0000","modified":"2024-04-17T05:26:36.682131+0000","last_up_change":"0.000000","last_in_change":"2024-04-17T05:26:36.682131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"15c87cdb-9415-45a6-a2a6-ea6bec9daece","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"281751b5-486d-4845-b4aa-b308bf7cec62","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b42257d3-bd20-4db5-aa37-1bf5c512d0f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0f26b891-bbe6-478e-8dee-78e69bb48cf0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"43e59318-2740-4625-9d64-eec1fd43c322","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"aaa3acf4-4adc-4337-aba3-363851d35310","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6f765b27-7377-4d81-9192-23a965651145","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5547394b-ec2f-4311-846d-369af4b1acf1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T05:26:38.131 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.133+0000 7f19e5000640 1 -- 172.21.15.123:0/2205142366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19e00b3fe0 msgr2=0x7f19e0144f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:38.131 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.133+0000 7f19e5000640 1 --2- 172.21.15.123:0/2205142366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19e00b3fe0 0x7f19e0144f40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f19d000c450 tx=0x7f19d000c910 comp rx=0 tx=0).stop 2024-04-17T05:26:38.131 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.133+0000 7f19e5000640 1 -- 172.21.15.123:0/2205142366 shutdown_connections 2024-04-17T05:26:38.131 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.133+0000 7f19e5000640 1 --2- 172.21.15.123:0/2205142366 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f19e0141d50 0x7f19e01dd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:38.131 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.133+0000 7f19e5000640 1 --2- 172.21.15.123:0/2205142366 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19e00b7110 0x7f19e014b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:38.132 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.133+0000 7f19e5000640 1 --2- 172.21.15.123:0/2205142366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19e00b3fe0 0x7f19e0144f40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:38.132 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.133+0000 7f19e5000640 1 -- 172.21.15.123:0/2205142366 >> 172.21.15.123:0/2205142366 conn(0x7f19e00bd4f0 msgr2=0x7f19e0145dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:38.132 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.133+0000 7f19e5000640 1 -- 172.21.15.123:0/2205142366 shutdown_connections 2024-04-17T05:26:38.132 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:38.133+0000 7f19e5000640 1 -- 172.21.15.123:0/2205142366 wait complete. 2024-04-17T05:26:38.137 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-17T05:26:38.138+0000 7ff2583db040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-17T05:26:38.149 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-17T05:26:38.268 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-17T05:26:38.269+0000 7ff2583db040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-17T05:26:38.271 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-17T05:26:38.273+0000 7f8d53c52040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-17T05:26:38.591 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-17T05:26:38.593+0000 7f8d53c52040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-17T05:26:38.652 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-17T05:26:38.654+0000 7f8d53c52040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-17T05:26:38.783 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-17T05:26:38.785+0000 7f8d53c52040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-17T05:26:39.315 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-17T05:26:39.317+0000 7ff1f9400640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-17T05:26:39.316 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-04-17T05:26:39.318+0000 7ff1f9400640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-17T05:26:40.771 INFO:tasks.ceph.osd.2.smithi123.stderr:2024-04-17T05:26:40.773+0000 7f73e3511640 -1 osd.2 0 log_to_monitors true 2024-04-17T05:26:40.798 INFO:tasks.ceph.osd.3.smithi123.stderr:2024-04-17T05:26:40.800+0000 7efdee1bb640 -1 osd.3 0 log_to_monitors true 2024-04-17T05:26:41.004 INFO:tasks.ceph.osd.0.smithi123.stderr:2024-04-17T05:26:41.004+0000 7f686e38a640 -1 osd.0 0 log_to_monitors true 2024-04-17T05:26:41.039 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-04-17T05:26:41.037+0000 7fb23b413640 -1 osd.4 0 log_to_monitors true 2024-04-17T05:26:41.039 INFO:tasks.ceph.osd.1.smithi123.stderr:2024-04-17T05:26:41.038+0000 7ffa53a0d640 -1 osd.1 0 log_to_monitors true 2024-04-17T05:26:41.073 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-17T05:26:41.074+0000 7f796ac37640 -1 osd.5 0 log_to_monitors true 2024-04-17T05:26:41.346 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-04-17T05:26:41.348+0000 7f970d993640 -1 osd.6 0 log_to_monitors true 2024-04-17T05:26:41.364 INFO:tasks.ceph.osd.7.smithi164.stderr:2024-04-17T05:26:41.365+0000 7f5e1560d640 -1 osd.7 0 log_to_monitors true 2024-04-17T05:26:43.957 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-04-17T05:26:43.958+0000 7fb236600640 -1 osd.4 0 waiting for initial osdmap 2024-04-17T05:26:43.962 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-17T05:26:43.964+0000 7f7965a00640 -1 osd.5 0 waiting for initial osdmap 2024-04-17T05:26:43.983 INFO:tasks.ceph.osd.4.smithi164.stderr:2024-04-17T05:26:43.985+0000 7fb22bc00640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T05:26:43.987 INFO:tasks.ceph.osd.5.smithi164.stderr:2024-04-17T05:26:43.989+0000 7f795ba00640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T05:26:44.665 INFO:tasks.ceph.osd.2.smithi123.stderr:2024-04-17T05:26:44.666+0000 7f73de400640 -1 osd.2 0 waiting for initial osdmap 2024-04-17T05:26:44.682 INFO:tasks.ceph.osd.2.smithi123.stderr:2024-04-17T05:26:44.681+0000 7f73d4400640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T05:26:44.741 INFO:tasks.ceph.osd.1.smithi123.stderr:2024-04-17T05:26:44.743+0000 7ffa4ec00640 -1 osd.1 0 waiting for initial osdmap 2024-04-17T05:26:44.748 INFO:tasks.ceph.osd.1.smithi123.stderr:2024-04-17T05:26:44.750+0000 7ffa44200640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T05:26:44.754 INFO:tasks.ceph.osd.0.smithi123.stderr:2024-04-17T05:26:44.756+0000 7f6869c00640 -1 osd.0 0 waiting for initial osdmap 2024-04-17T05:26:44.759 INFO:tasks.ceph.osd.0.smithi123.stderr:2024-04-17T05:26:44.761+0000 7f685f200640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T05:26:44.771 INFO:tasks.ceph.osd.7.smithi164.stderr:2024-04-17T05:26:44.772+0000 7f5e10800640 -1 osd.7 0 waiting for initial osdmap 2024-04-17T05:26:44.772 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-04-17T05:26:44.774+0000 7f9708800640 -1 osd.6 0 waiting for initial osdmap 2024-04-17T05:26:44.779 INFO:tasks.ceph.osd.6.smithi164.stderr:2024-04-17T05:26:44.780+0000 7f96fe800640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T05:26:44.784 INFO:tasks.ceph.osd.7.smithi164.stderr:2024-04-17T05:26:44.786+0000 7f5e05e00640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T05:26:44.794 INFO:tasks.ceph.osd.3.smithi123.stderr:2024-04-17T05:26:44.795+0000 7efde9000640 -1 osd.3 0 waiting for initial osdmap 2024-04-17T05:26:44.799 INFO:tasks.ceph.osd.3.smithi123.stderr:2024-04-17T05:26:44.800+0000 7efddf000640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T05:26:44.955 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-17T05:26:45.118 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.119+0000 7ff3c5800640 1 Processor -- start 2024-04-17T05:26:45.119 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.119+0000 7ff3c5800640 1 -- start start 2024-04-17T05:26:45.120 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.121+0000 7ff3c5800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff3c006ff90 0x7ff3c013f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:45.120 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.121+0000 7ff3c5800640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff3c0149850 0x7ff3c013fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:45.120 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.121+0000 7ff3c5800640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3c00b2e70 con 0x7ff3c00b2a90 2024-04-17T05:26:45.121 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.121+0000 7ff3c5800640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ff3c0070c70 con 0x7ff3c006ff90 2024-04-17T05:26:45.121 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.121+0000 7ff3c5800640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7ff3c013ff40 con 0x7ff3c0149850 2024-04-17T05:26:45.121 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.121+0000 7ff3b7400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff3c006ff90 0x7ff3c013f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:45.121 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.121+0000 7ff3bfe00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff3c00b2a90 0x7ff3c0149140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49816/0 (socket says 172.21.15.123:49816) 2024-04-17T05:26:45.121 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.121+0000 7ff3bfe00640 1 -- 172.21.15.123:0/774452369 learned_addr learned my addr 172.21.15.123:0/774452369 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:26:45.121 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.121+0000 7ff3c4e00640 1 --2- 172.21.15.123:0/774452369 >> v2:172.21.15.164:3300/0 conn(0x7ff3c0149850 0x7ff3c013fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:45.121 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.121+0000 7ff3b7400640 1 -- 172.21.15.123:0/774452369 >> v2:172.21.15.164:3300/0 conn(0x7ff3c0149850 msgr2=0x7ff3c013fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:45.121 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.121+0000 7ff3b7400640 1 --2- 172.21.15.123:0/774452369 >> v2:172.21.15.164:3300/0 conn(0x7ff3c0149850 0x7ff3c013fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:45.121 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.121+0000 7ff3b7400640 1 -- 172.21.15.123:0/774452369 >> v1:172.21.15.123:6789/0 conn(0x7ff3c00b2a90 legacy=0x7ff3c0149140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:45.121 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.121+0000 7ff3b7400640 1 -- 172.21.15.123:0/774452369 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c0071a70 con 0x7ff3c006ff90 2024-04-17T05:26:45.121 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.121+0000 7ff3c4e00640 1 --2- 172.21.15.123:0/774452369 >> v2:172.21.15.164:3300/0 conn(0x7ff3c0149850 0x7ff3c013fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:26:45.123 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.122+0000 7ff3b7400640 1 --2- 172.21.15.123:0/774452369 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c006ff90 0x7ff3c013f4c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff3c00b5bb0 tx=0x7ff3a802b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c6cf6a759c7bae server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:45.123 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.123+0000 7ff3bf400640 1 -- 172.21.15.123:0/774452369 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a8038070 con 0x7ff3c006ff90 2024-04-17T05:26:45.123 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.123+0000 7ff3bf400640 1 -- 172.21.15.123:0/774452369 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3a8031520 con 0x7ff3c006ff90 2024-04-17T05:26:45.123 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.123+0000 7ff3bf400640 1 -- 172.21.15.123:0/774452369 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a80318f0 con 0x7ff3c006ff90 2024-04-17T05:26:45.123 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.123+0000 7ff3c5800640 1 -- 172.21.15.123:0/774452369 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c006ff90 msgr2=0x7ff3c013f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:45.123 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.123+0000 7ff3c5800640 1 --2- 172.21.15.123:0/774452369 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c006ff90 0x7ff3c013f4c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff3c00b5bb0 tx=0x7ff3a802b7c0 comp rx=0 tx=0).stop 2024-04-17T05:26:45.123 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.123+0000 7ff3c5800640 1 -- 172.21.15.123:0/774452369 shutdown_connections 2024-04-17T05:26:45.123 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.123+0000 7ff3c5800640 1 --2- 172.21.15.123:0/774452369 >> v2:172.21.15.164:3300/0 conn(0x7ff3c0149850 0x7ff3c013fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:45.123 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.123+0000 7ff3c5800640 1 --2- 172.21.15.123:0/774452369 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c006ff90 0x7ff3c013f4c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:45.123 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.123+0000 7ff3c5800640 1 -- 172.21.15.123:0/774452369 >> 172.21.15.123:0/774452369 conn(0x7ff3c006c280 msgr2=0x7ff3c00b9110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:45.123 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.124+0000 7ff3c5800640 1 -- 172.21.15.123:0/774452369 shutdown_connections 2024-04-17T05:26:45.123 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.124+0000 7ff3c5800640 1 -- 172.21.15.123:0/774452369 wait complete. 2024-04-17T05:26:45.124 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.125+0000 7ff3c5800640 1 Processor -- start 2024-04-17T05:26:45.124 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.125+0000 7ff3c5800640 1 -- start start 2024-04-17T05:26:45.126 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.126+0000 7ff3c5800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3c006ff90 0x7ff3c0140dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:45.127 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.126+0000 7ff3c5800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c00b2a90 0x7ff3c01391e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:45.127 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.126+0000 7ff3c5800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3c0149850 0x7ff3c0141bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:45.127 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.126+0000 7ff3c5800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c00b4ff0 con 0x7ff3c00b2a90 2024-04-17T05:26:45.127 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.126+0000 7ff3c5800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c0070900 con 0x7ff3c0149850 2024-04-17T05:26:45.127 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.126+0000 7ff3c5800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7ff3c00b5170 con 0x7ff3c006ff90 2024-04-17T05:26:45.127 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.126+0000 7ff3b7400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c00b2a90 0x7ff3c01391e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:45.127 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.126+0000 7ff3b7400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c00b2a90 0x7ff3c01391e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40520/0 (socket says 172.21.15.123:40520) 2024-04-17T05:26:45.127 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.126+0000 7ff3b7400640 1 -- 172.21.15.123:0/3250677158 learned_addr learned my addr 172.21.15.123:0/3250677158 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:26:45.127 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.126+0000 7ff3c4e00640 1 --2- 172.21.15.123:0/3250677158 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3c0149850 0x7ff3c0141bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:45.127 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.126+0000 7ff3b7400640 1 -- 172.21.15.123:0/3250677158 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3c006ff90 msgr2=0x7ff3c0140dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:45.127 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.126+0000 7ff3b7400640 1 --2- 172.21.15.123:0/3250677158 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3c006ff90 0x7ff3c0140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:45.127 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.126+0000 7ff3b7400640 1 -- 172.21.15.123:0/3250677158 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3c0149850 msgr2=0x7ff3c0141bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:45.127 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.126+0000 7ff3b7400640 1 --2- 172.21.15.123:0/3250677158 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3c0149850 0x7ff3c0141bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:45.128 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.127+0000 7ff3b7400640 1 -- 172.21.15.123:0/3250677158 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c0143880 con 0x7ff3c00b2a90 2024-04-17T05:26:45.128 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.127+0000 7ff3c4e00640 1 --2- 172.21.15.123:0/3250677158 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3c0149850 0x7ff3c0141bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:26:45.128 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.127+0000 7ff3b7400640 1 --2- 172.21.15.123:0/3250677158 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c00b2a90 0x7ff3c01391e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8000c00 tx=0x7ff3a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:45.128 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.127+0000 7ff3bcc00640 1 -- 172.21.15.123:0/3250677158 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a8042070 con 0x7ff3c00b2a90 2024-04-17T05:26:45.128 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.127+0000 7ff3bcc00640 1 -- 172.21.15.123:0/3250677158 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3a803d950 con 0x7ff3c00b2a90 2024-04-17T05:26:45.128 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.127+0000 7ff3c5800640 1 -- 172.21.15.123:0/3250677158 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3c01405c0 con 0x7ff3c00b2a90 2024-04-17T05:26:45.128 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.127+0000 7ff3bcc00640 1 -- 172.21.15.123:0/3250677158 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a8038040 con 0x7ff3c00b2a90 2024-04-17T05:26:45.128 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.127+0000 7ff3c5800640 1 -- 172.21.15.123:0/3250677158 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3c0142fd0 con 0x7ff3c00b2a90 2024-04-17T05:26:45.129 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.128+0000 7ff3c5800640 1 -- 172.21.15.123:0/3250677158 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3c004fd60 con 0x7ff3c00b2a90 2024-04-17T05:26:45.129 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.129+0000 7ff3bcc00640 1 -- 172.21.15.123:0/3250677158 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7ff3a8045070 con 0x7ff3c00b2a90 2024-04-17T05:26:45.129 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.130+0000 7ff3bcc00640 1 --2- 172.21.15.123:0/3250677158 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7ff39c06c890 0x7ff39c06ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:45.129 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.130+0000 7ff3bcc00640 1 -- 172.21.15.123:0/3250677158 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 4471+0+0 (secure 0 0 0) 0x7ff3a80ad0a0 con 0x7ff3c00b2a90 2024-04-17T05:26:45.129 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.130+0000 7ff3bfe00640 1 --2- 172.21.15.123:0/3250677158 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7ff39c06c890 0x7ff39c06ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:45.130 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.132+0000 7ff3bfe00640 1 --2- 172.21.15.123:0/3250677158 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7ff39c06c890 0x7ff39c06ed50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff3b00012e0 tx=0x7ff3b0001630 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:45.134 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.135+0000 7ff3bcc00640 1 -- 172.21.15.123:0/3250677158 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7ff3a807ba70 con 0x7ff3c00b2a90 2024-04-17T05:26:45.299 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:26:45.305 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:26:45.323 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.325+0000 7ff3c5800640 1 -- 172.21.15.123:0/3250677158 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff3c0143290 con 0x7ff3c00b2a90 2024-04-17T05:26:45.325 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.326+0000 7ff3bcc00640 1 -- 172.21.15.123:0/3250677158 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+10921 (secure 0 0 0) 0x7ff3a80abe20 con 0x7ff3c00b2a90 2024-04-17T05:26:45.325 INFO:teuthology.misc.health.smithi123.stdout: 2024-04-17T05:26:45.325 INFO:teuthology.misc.health.smithi123.stdout:{"epoch":14,"fsid":"0787c5c0-e77a-4102-a899-30db48b19c68","created":"2024-04-17T05:26:33.031507+0000","modified":"2024-04-17T05:26:44.988433+0000","last_up_change":"2024-04-17T05:26:44.988433+0000","last_in_change":"2024-04-17T05:26:36.682131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"15c87cdb-9415-45a6-a2a6-ea6bec9daece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6801","nonce":840753170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6803","nonce":840753170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6807","nonce":840753170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6805","nonce":840753170}]},"public_addr":"172.21.15.123:6801/840753170","cluster_addr":"172.21.15.123:6803/840753170","heartbeat_back_addr":"172.21.15.123:6807/840753170","heartbeat_front_addr":"172.21.15.123:6805/840753170","state":["exists","up"]},{"osd":1,"uuid":"281751b5-486d-4845-b4aa-b308bf7cec62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6822","nonce":2231878927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6827","nonce":2231878927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6831","nonce":2231878927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6829","nonce":2231878927}]},"public_addr":"172.21.15.123:6822/2231878927","cluster_addr":"172.21.15.123:6827/2231878927","heartbeat_back_addr":"172.21.15.123:6831/2231878927","heartbeat_front_addr":"172.21.15.123:6829/2231878927","state":["exists","up"]},{"osd":2,"uuid":"b42257d3-bd20-4db5-aa37-1bf5c512d0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6817","nonce":754360844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6820","nonce":754360844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6825","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6826","nonce":754360844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6823","nonce":754360844}]},"public_addr":"172.21.15.123:6817/754360844","cluster_addr":"172.21.15.123:6820/754360844","heartbeat_back_addr":"172.21.15.123:6826/754360844","heartbeat_front_addr":"172.21.15.123:6823/754360844","state":["exists","up"]},{"osd":3,"uuid":"0f26b891-bbe6-478e-8dee-78e69bb48cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6809","nonce":2898088574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6811","nonce":2898088574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6815","nonce":2898088574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6813","nonce":2898088574}]},"public_addr":"172.21.15.123:6809/2898088574","cluster_addr":"172.21.15.123:6811/2898088574","heartbeat_back_addr":"172.21.15.123:6815/2898088574","heartbeat_front_addr":"172.21.15.123:6813/2898088574","state":["exists","up"]},{"osd":4,"uuid":"43e59318-2740-4625-9d64-eec1fd43c322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6801","nonce":606484349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6804","nonce":606484349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6812","nonce":606484349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6808","nonce":606484349}]},"public_addr":"172.21.15.164:6801/606484349","cluster_addr":"172.21.15.164:6804/606484349","heartbeat_back_addr":"172.21.15.164:6812/606484349","heartbeat_front_addr":"172.21.15.164:6808/606484349","state":["exists","up"]},{"osd":5,"uuid":"aaa3acf4-4adc-4337-aba3-363851d35310","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6805","nonce":1376989593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6809","nonce":1376989593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6815","nonce":1376989593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6813","nonce":1376989593}]},"public_addr":"172.21.15.164:6805/1376989593","cluster_addr":"172.21.15.164:6809/1376989593","heartbeat_back_addr":"172.21.15.164:6815/1376989593","heartbeat_front_addr":"172.21.15.164:6813/1376989593","state":["exists","up"]},{"osd":6,"uuid":"6f765b27-7377-4d81-9192-23a965651145","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6817","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6821","nonce":1594306924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6823","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6826","nonce":1594306924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6831","nonce":1594306924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6829","nonce":1594306924}]},"public_addr":"172.21.15.164:6821/1594306924","cluster_addr":"172.21.15.164:6826/1594306924","heartbeat_back_addr":"172.21.15.164:6831/1594306924","heartbeat_front_addr":"172.21.15.164:6829/1594306924","state":["exists","up"]},{"osd":7,"uuid":"5547394b-ec2f-4311-846d-369af4b1acf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6818","nonce":295402697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6819","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6820","nonce":295402697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6825","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6827","nonce":295402697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6824","nonce":295402697}]},"public_addr":"172.21.15.164:6818/295402697","cluster_addr":"172.21.15.164:6820/295402697","heartbeat_back_addr":"172.21.15.164:6827/295402697","heartbeat_front_addr":"172.21.15.164:6824/295402697","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T05:26:45.327 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.328+0000 7ff3c5800640 1 -- 172.21.15.123:0/3250677158 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7ff39c06c890 msgr2=0x7ff39c06ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:45.327 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.328+0000 7ff3c5800640 1 --2- 172.21.15.123:0/3250677158 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7ff39c06c890 0x7ff39c06ed50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff3b00012e0 tx=0x7ff3b0001630 comp rx=0 tx=0).stop 2024-04-17T05:26:45.327 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.328+0000 7ff3c5800640 1 -- 172.21.15.123:0/3250677158 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c00b2a90 msgr2=0x7ff3c01391e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:45.328 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.328+0000 7ff3c5800640 1 --2- 172.21.15.123:0/3250677158 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c00b2a90 0x7ff3c01391e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8000c00 tx=0x7ff3a80046c0 comp rx=0 tx=0).stop 2024-04-17T05:26:45.328 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.328+0000 7ff3c5800640 1 -- 172.21.15.123:0/3250677158 shutdown_connections 2024-04-17T05:26:45.328 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.328+0000 7ff3c5800640 1 --2- 172.21.15.123:0/3250677158 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3c0149850 0x7ff3c0141bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:45.328 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.328+0000 7ff3c5800640 1 --2- 172.21.15.123:0/3250677158 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c00b2a90 0x7ff3c01391e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:45.328 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.328+0000 7ff3c5800640 1 --2- 172.21.15.123:0/3250677158 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7ff39c06c890 0x7ff39c06ed50 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:45.328 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.328+0000 7ff3c5800640 1 --2- 172.21.15.123:0/3250677158 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3c006ff90 0x7ff3c0140dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:45.328 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.328+0000 7ff3c5800640 1 -- 172.21.15.123:0/3250677158 >> 172.21.15.123:0/3250677158 conn(0x7ff3c006c280 msgr2=0x7ff3c00b86e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:45.328 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.328+0000 7ff3c5800640 1 -- 172.21.15.123:0/3250677158 shutdown_connections 2024-04-17T05:26:45.328 INFO:teuthology.misc.health.smithi123.stderr:2024-04-17T05:26:45.328+0000 7ff3c5800640 1 -- 172.21.15.123:0/3250677158 wait complete. 2024-04-17T05:26:45.343 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-17T05:26:45.343 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-17T05:26:45.343 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-17T05:26:45.343 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-17T05:26:45.389 INFO:tasks.ceph.mds.a:Started 2024-04-17T05:26:45.389 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-17T05:26:45.389 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-17T05:26:45.395 INFO:tasks.ceph.mds.b:Started 2024-04-17T05:26:45.395 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-17T05:26:45.398 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T05:26:45.538 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2024-04-17T05:26:45.559 INFO:tasks.ceph.mds.b.smithi164.stdout:starting mds.b at 2024-04-17T05:26:45.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.576+0000 7fe6c8e00640 1 Processor -- start 2024-04-17T05:26:45.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.576+0000 7fe6c8e00640 1 -- start start 2024-04-17T05:26:45.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.577+0000 7fe6c8e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe6c40b63f0 0x7fe6c4148110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:45.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.578+0000 7fe6c8e00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe6c40b59b0 0x7fe6c40b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:45.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.578+0000 7fe6c8e00640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6c40b4ae0 con 0x7fe6c40b3df0 2024-04-17T05:26:45.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.578+0000 7fe6c8e00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe6c40b4e10 con 0x7fe6c40b63f0 2024-04-17T05:26:45.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.578+0000 7fe6c8e00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7fe6c40b7830 con 0x7fe6c40b59b0 2024-04-17T05:26:45.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.578+0000 7fe6c1e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe6c40b63f0 0x7fe6c4148110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:45.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.578+0000 7fe6c1e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe6c40b63f0 0x7fe6c4148110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40552/0 (socket says 172.21.15.123:40552) 2024-04-17T05:26:45.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.578+0000 7fe6c1e00640 1 -- 172.21.15.123:0/3925791627 learned_addr learned my addr 172.21.15.123:0/3925791627 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:26:45.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.578+0000 7fe6c2800640 1 --2- 172.21.15.123:0/3925791627 >> v2:172.21.15.164:3300/0 conn(0x7fe6c40b59b0 0x7fe6c40b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:45.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.578+0000 7fe6c1e00640 1 -- 172.21.15.123:0/3925791627 >> v2:172.21.15.164:3300/0 conn(0x7fe6c40b59b0 msgr2=0x7fe6c40b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:45.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.578+0000 7fe6c1e00640 1 --2- 172.21.15.123:0/3925791627 >> v2:172.21.15.164:3300/0 conn(0x7fe6c40b59b0 0x7fe6c40b42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:45.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.578+0000 7fe6c1e00640 1 -- 172.21.15.123:0/3925791627 >> v1:172.21.15.164:6789/0 conn(0x7fe6c40b3df0 legacy=0x7fe6c40b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:45.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.578+0000 7fe6c1e00640 1 -- 172.21.15.123:0/3925791627 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c40b67d0 con 0x7fe6c40b63f0 2024-04-17T05:26:45.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.579+0000 7fe6c1e00640 1 --2- 172.21.15.123:0/3925791627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6c40b63f0 0x7fe6c4148110 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe6c40b4f90 tx=0x7fe6b402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5c8eee0fe6803 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:45.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.579+0000 7fe6c0a00640 1 -- 172.21.15.123:0/3925791627 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b4035020 con 0x7fe6c40b63f0 2024-04-17T05:26:45.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.579+0000 7fe6c0a00640 1 -- 172.21.15.123:0/3925791627 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b4031870 con 0x7fe6c40b63f0 2024-04-17T05:26:45.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.580+0000 7fe6c0a00640 1 -- 172.21.15.123:0/3925791627 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b4031c40 con 0x7fe6c40b63f0 2024-04-17T05:26:45.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.580+0000 7fe6c8e00640 1 -- 172.21.15.123:0/3925791627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6c40b63f0 msgr2=0x7fe6c4148110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:45.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.580+0000 7fe6c8e00640 1 --2- 172.21.15.123:0/3925791627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6c40b63f0 0x7fe6c4148110 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe6c40b4f90 tx=0x7fe6b402b910 comp rx=0 tx=0).stop 2024-04-17T05:26:45.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.580+0000 7fe6c8e00640 1 -- 172.21.15.123:0/3925791627 shutdown_connections 2024-04-17T05:26:45.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.580+0000 7fe6c8e00640 1 --2- 172.21.15.123:0/3925791627 >> v2:172.21.15.164:3300/0 conn(0x7fe6c40b59b0 0x7fe6c40b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:45.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.580+0000 7fe6c8e00640 1 --2- 172.21.15.123:0/3925791627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6c40b63f0 0x7fe6c4148110 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:45.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.580+0000 7fe6c8e00640 1 -- 172.21.15.123:0/3925791627 >> 172.21.15.123:0/3925791627 conn(0x7fe6c40bd590 msgr2=0x7fe6c40bd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:45.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.580+0000 7fe6c8e00640 1 -- 172.21.15.123:0/3925791627 shutdown_connections 2024-04-17T05:26:45.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.580+0000 7fe6c8e00640 1 -- 172.21.15.123:0/3925791627 wait complete. 2024-04-17T05:26:45.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.582+0000 7fe6c8e00640 1 Processor -- start 2024-04-17T05:26:45.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.582+0000 7fe6c8e00640 1 -- start start 2024-04-17T05:26:45.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.582+0000 7fe6c8e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6c40b3df0 0x7fe6c41cede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:45.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.582+0000 7fe6c8e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6c40b59b0 0x7fe6c41451a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:45.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.582+0000 7fe6c8e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6c40b63f0 0x7fe6c41e0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:45.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.582+0000 7fe6c8e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c4148650 con 0x7fe6c40b63f0 2024-04-17T05:26:45.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.582+0000 7fe6c8e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c4148a80 con 0x7fe6c40b59b0 2024-04-17T05:26:45.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.582+0000 7fe6c8e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fe6c41487d0 con 0x7fe6c40b3df0 2024-04-17T05:26:45.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.583+0000 7fe6c2800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6c40b63f0 0x7fe6c41e0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:45.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.583+0000 7fe6c1e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6c40b3df0 0x7fe6c41cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:45.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.583+0000 7fe6c2800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6c40b63f0 0x7fe6c41e0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40560/0 (socket says 172.21.15.123:40560) 2024-04-17T05:26:45.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.583+0000 7fe6c2800640 1 -- 172.21.15.123:0/2410839970 learned_addr learned my addr 172.21.15.123:0/2410839970 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:26:45.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.583+0000 7fe6c1400640 1 --2- 172.21.15.123:0/2410839970 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6c40b59b0 0x7fe6c41451a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:45.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.583+0000 7fe6c1e00640 1 -- 172.21.15.123:0/2410839970 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6c40b59b0 msgr2=0x7fe6c41451a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:45.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.583+0000 7fe6c1e00640 1 --2- 172.21.15.123:0/2410839970 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6c40b59b0 0x7fe6c41451a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:45.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.583+0000 7fe6c1e00640 1 -- 172.21.15.123:0/2410839970 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6c40b63f0 msgr2=0x7fe6c41e0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:45.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.583+0000 7fe6c1e00640 1 --2- 172.21.15.123:0/2410839970 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6c40b63f0 0x7fe6c41e0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:45.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.583+0000 7fe6c1e00640 1 -- 172.21.15.123:0/2410839970 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c41ce450 con 0x7fe6c40b3df0 2024-04-17T05:26:45.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.583+0000 7fe6c2800640 1 --2- 172.21.15.123:0/2410839970 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6c40b63f0 0x7fe6c41e0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T05:26:45.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.583+0000 7fe6c1e00640 1 --2- 172.21.15.123:0/2410839970 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6c40b3df0 0x7fe6c41cede0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4033000 tx=0x7fe6b40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:45.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.584+0000 7fe6ba000640 1 -- 172.21.15.123:0/2410839970 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b4040070 con 0x7fe6c40b3df0 2024-04-17T05:26:45.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.584+0000 7fe6ba000640 1 -- 172.21.15.123:0/2410839970 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b4030d00 con 0x7fe6c40b3df0 2024-04-17T05:26:45.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.584+0000 7fe6ba000640 1 -- 172.21.15.123:0/2410839970 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b4035040 con 0x7fe6c40b3df0 2024-04-17T05:26:45.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.584+0000 7fe6c8e00640 1 -- 172.21.15.123:0/2410839970 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6c41ce730 con 0x7fe6c40b3df0 2024-04-17T05:26:45.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.584+0000 7fe6c8e00640 1 -- 172.21.15.123:0/2410839970 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6c41cdd40 con 0x7fe6c40b3df0 2024-04-17T05:26:45.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.585+0000 7fe6c8e00640 1 -- 172.21.15.123:0/2410839970 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6c4068a40 con 0x7fe6c40b3df0 2024-04-17T05:26:45.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.586+0000 7fe6ba000640 1 -- 172.21.15.123:0/2410839970 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7fe6b404b060 con 0x7fe6c40b3df0 2024-04-17T05:26:45.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.587+0000 7fe6ba000640 1 --2- 172.21.15.123:0/2410839970 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe6a406c860 0x7fe6a406ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:45.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.587+0000 7fe6ba000640 1 -- 172.21.15.123:0/2410839970 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(14..14 src has 1..14) ==== 4471+0+0 (secure 0 0 0) 0x7fe6b40ad220 con 0x7fe6c40b3df0 2024-04-17T05:26:45.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.587+0000 7fe6c1400640 1 --2- 172.21.15.123:0/2410839970 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe6a406c860 0x7fe6a406ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:45.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.588+0000 7fe6c1400640 1 --2- 172.21.15.123:0/2410839970 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe6a406c860 0x7fe6a406ed20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe6c41d0480 tx=0x7fe6b0007e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:45.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.593+0000 7fe6ba000640 1 -- 172.21.15.123:0/2410839970 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fe6b407b640 con 0x7fe6c40b3df0 2024-04-17T05:26:45.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.782+0000 7fe6c8e00640 1 -- 172.21.15.123:0/2410839970 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe6c41ce900 con 0x7fe6c40b3df0 2024-04-17T05:26:45.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.784+0000 7fe6ba000640 1 -- 172.21.15.123:0/2410839970 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+10921 (secure 0 0 0) 0x7fe6b407f940 con 0x7fe6c40b3df0 2024-04-17T05:26:45.784 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:26:45.784 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":14,"fsid":"0787c5c0-e77a-4102-a899-30db48b19c68","created":"2024-04-17T05:26:33.031507+0000","modified":"2024-04-17T05:26:44.988433+0000","last_up_change":"2024-04-17T05:26:44.988433+0000","last_in_change":"2024-04-17T05:26:36.682131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"15c87cdb-9415-45a6-a2a6-ea6bec9daece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6801","nonce":840753170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6803","nonce":840753170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6807","nonce":840753170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6805","nonce":840753170}]},"public_addr":"172.21.15.123:6801/840753170","cluster_addr":"172.21.15.123:6803/840753170","heartbeat_back_addr":"172.21.15.123:6807/840753170","heartbeat_front_addr":"172.21.15.123:6805/840753170","state":["exists","up"]},{"osd":1,"uuid":"281751b5-486d-4845-b4aa-b308bf7cec62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6822","nonce":2231878927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6827","nonce":2231878927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6831","nonce":2231878927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6829","nonce":2231878927}]},"public_addr":"172.21.15.123:6822/2231878927","cluster_addr":"172.21.15.123:6827/2231878927","heartbeat_back_addr":"172.21.15.123:6831/2231878927","heartbeat_front_addr":"172.21.15.123:6829/2231878927","state":["exists","up"]},{"osd":2,"uuid":"b42257d3-bd20-4db5-aa37-1bf5c512d0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6817","nonce":754360844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6820","nonce":754360844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6825","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6826","nonce":754360844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6823","nonce":754360844}]},"public_addr":"172.21.15.123:6817/754360844","cluster_addr":"172.21.15.123:6820/754360844","heartbeat_back_addr":"172.21.15.123:6826/754360844","heartbeat_front_addr":"172.21.15.123:6823/754360844","state":["exists","up"]},{"osd":3,"uuid":"0f26b891-bbe6-478e-8dee-78e69bb48cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6809","nonce":2898088574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6811","nonce":2898088574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6815","nonce":2898088574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6813","nonce":2898088574}]},"public_addr":"172.21.15.123:6809/2898088574","cluster_addr":"172.21.15.123:6811/2898088574","heartbeat_back_addr":"172.21.15.123:6815/2898088574","heartbeat_front_addr":"172.21.15.123:6813/2898088574","state":["exists","up"]},{"osd":4,"uuid":"43e59318-2740-4625-9d64-eec1fd43c322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6801","nonce":606484349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6804","nonce":606484349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6812","nonce":606484349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6808","nonce":606484349}]},"public_addr":"172.21.15.164:6801/606484349","cluster_addr":"172.21.15.164:6804/606484349","heartbeat_back_addr":"172.21.15.164:6812/606484349","heartbeat_front_addr":"172.21.15.164:6808/606484349","state":["exists","up"]},{"osd":5,"uuid":"aaa3acf4-4adc-4337-aba3-363851d35310","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6805","nonce":1376989593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6809","nonce":1376989593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6815","nonce":1376989593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6813","nonce":1376989593}]},"public_addr":"172.21.15.164:6805/1376989593","cluster_addr":"172.21.15.164:6809/1376989593","heartbeat_back_addr":"172.21.15.164:6815/1376989593","heartbeat_front_addr":"172.21.15.164:6813/1376989593","state":["exists","up"]},{"osd":6,"uuid":"6f765b27-7377-4d81-9192-23a965651145","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6817","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6821","nonce":1594306924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6823","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6826","nonce":1594306924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6831","nonce":1594306924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6829","nonce":1594306924}]},"public_addr":"172.21.15.164:6821/1594306924","cluster_addr":"172.21.15.164:6826/1594306924","heartbeat_back_addr":"172.21.15.164:6831/1594306924","heartbeat_front_addr":"172.21.15.164:6829/1594306924","state":["exists","up"]},{"osd":7,"uuid":"5547394b-ec2f-4311-846d-369af4b1acf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6818","nonce":295402697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6819","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6820","nonce":295402697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6825","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6827","nonce":295402697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6824","nonce":295402697}]},"public_addr":"172.21.15.164:6818/295402697","cluster_addr":"172.21.15.164:6820/295402697","heartbeat_back_addr":"172.21.15.164:6827/295402697","heartbeat_front_addr":"172.21.15.164:6824/295402697","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T05:26:45.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.787+0000 7fe6c8e00640 1 -- 172.21.15.123:0/2410839970 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe6a406c860 msgr2=0x7fe6a406ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:45.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.787+0000 7fe6c8e00640 1 --2- 172.21.15.123:0/2410839970 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe6a406c860 0x7fe6a406ed20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe6c41d0480 tx=0x7fe6b0007e30 comp rx=0 tx=0).stop 2024-04-17T05:26:45.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.787+0000 7fe6c8e00640 1 -- 172.21.15.123:0/2410839970 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6c40b3df0 msgr2=0x7fe6c41cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:45.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.787+0000 7fe6c8e00640 1 --2- 172.21.15.123:0/2410839970 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6c40b3df0 0x7fe6c41cede0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4033000 tx=0x7fe6b40046c0 comp rx=0 tx=0).stop 2024-04-17T05:26:45.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.787+0000 7fe6c8e00640 1 -- 172.21.15.123:0/2410839970 shutdown_connections 2024-04-17T05:26:45.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.787+0000 7fe6c8e00640 1 --2- 172.21.15.123:0/2410839970 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6c40b63f0 0x7fe6c41e0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:45.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.787+0000 7fe6c8e00640 1 --2- 172.21.15.123:0/2410839970 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6c40b59b0 0x7fe6c41451a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:45.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.787+0000 7fe6c8e00640 1 --2- 172.21.15.123:0/2410839970 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe6a406c860 0x7fe6a406ed20 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:45.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.787+0000 7fe6c8e00640 1 --2- 172.21.15.123:0/2410839970 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6c40b3df0 0x7fe6c41cede0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:45.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.787+0000 7fe6c8e00640 1 -- 172.21.15.123:0/2410839970 >> 172.21.15.123:0/2410839970 conn(0x7fe6c40bd590 msgr2=0x7fe6c40bcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:45.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.787+0000 7fe6c8e00640 1 -- 172.21.15.123:0/2410839970 shutdown_connections 2024-04-17T05:26:45.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:45.787+0000 7fe6c8e00640 1 -- 172.21.15.123:0/2410839970 wait complete. 2024-04-17T05:26:45.803 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-04-17T05:26:45.804 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T05:26:46.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.009+0000 7fdb83c00640 1 Processor -- start 2024-04-17T05:26:46.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.009+0000 7fdb83c00640 1 -- start start 2024-04-17T05:26:46.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.010+0000 7fdb83c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdb7c09d630 0x7fdb7c09da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:46.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.010+0000 7fdb83c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdb7c142b30 0x7fdb7c142f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:46.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.010+0000 7fdb83c00640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb7c09cc30 con 0x7fdb7c1492e0 2024-04-17T05:26:46.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.010+0000 7fdb83c00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fdb7c09bcf0 con 0x7fdb7c09d630 2024-04-17T05:26:46.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.010+0000 7fdb83c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fdb7c09cea0 con 0x7fdb7c142b30 2024-04-17T05:26:46.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.010+0000 7fdb81200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdb7c09d630 0x7fdb7c09da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:46.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.011+0000 7fdb81200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdb7c09d630 0x7fdb7c09da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40574/0 (socket says 172.21.15.123:40574) 2024-04-17T05:26:46.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.011+0000 7fdb81200640 1 -- 172.21.15.123:0/269808442 learned_addr learned my addr 172.21.15.123:0/269808442 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:26:46.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.011+0000 7fdb81200640 1 -- 172.21.15.123:0/269808442 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdb7c142b30 msgr2=0x7fdb7c142f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:46.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.011+0000 7fdb81200640 1 --2- 172.21.15.123:0/269808442 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdb7c142b30 0x7fdb7c142f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:46.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.011+0000 7fdb81200640 1 -- 172.21.15.123:0/269808442 >> v1:172.21.15.164:6789/0 conn(0x7fdb7c1492e0 legacy=0x7fdb7c149770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:46.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.011+0000 7fdb81200640 1 -- 172.21.15.123:0/269808442 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7c09b3c0 con 0x7fdb7c09d630 2024-04-17T05:26:46.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.012+0000 7fdb81200640 1 --2- 172.21.15.123:0/269808442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdb7c09d630 0x7fdb7c09da10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c050880 tx=0x7fdb7002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b22d078a8be2d17d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:46.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.012+0000 7fdb7b400640 1 -- 172.21.15.123:0/269808442 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb700317c0 con 0x7fdb7c09d630 2024-04-17T05:26:46.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.012+0000 7fdb7b400640 1 -- 172.21.15.123:0/269808442 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb70037070 con 0x7fdb7c09d630 2024-04-17T05:26:46.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.012+0000 7fdb7b400640 1 -- 172.21.15.123:0/269808442 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb70031b80 con 0x7fdb7c09d630 2024-04-17T05:26:46.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.013+0000 7fdb83c00640 1 -- 172.21.15.123:0/269808442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdb7c09d630 msgr2=0x7fdb7c09da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:46.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.013+0000 7fdb83c00640 1 --2- 172.21.15.123:0/269808442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdb7c09d630 0x7fdb7c09da10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c050880 tx=0x7fdb7002b860 comp rx=0 tx=0).stop 2024-04-17T05:26:46.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.013+0000 7fdb83c00640 1 -- 172.21.15.123:0/269808442 shutdown_connections 2024-04-17T05:26:46.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.013+0000 7fdb83c00640 1 --2- 172.21.15.123:0/269808442 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdb7c142b30 0x7fdb7c142f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:46.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.013+0000 7fdb83c00640 1 --2- 172.21.15.123:0/269808442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdb7c09d630 0x7fdb7c09da10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:46.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.013+0000 7fdb83c00640 1 -- 172.21.15.123:0/269808442 >> 172.21.15.123:0/269808442 conn(0x7fdb7c0b93b0 msgr2=0x7fdb7c0b97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:46.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.013+0000 7fdb83c00640 1 -- 172.21.15.123:0/269808442 shutdown_connections 2024-04-17T05:26:46.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.013+0000 7fdb83c00640 1 -- 172.21.15.123:0/269808442 wait complete. 2024-04-17T05:26:46.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.014+0000 7fdb83c00640 1 Processor -- start 2024-04-17T05:26:46.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.015+0000 7fdb83c00640 1 -- start start 2024-04-17T05:26:46.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.015+0000 7fdb83c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdb7c09d630 0x7fdb7c0b8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:46.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.016+0000 7fdb83c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb7c142b30 0x7fdb7c0b0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:46.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.016+0000 7fdb83c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdb7c1492e0 0x7fdb7c1de990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:46.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.016+0000 7fdb83c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7c0b5b10 con 0x7fdb7c1492e0 2024-04-17T05:26:46.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.016+0000 7fdb83c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7c09b720 con 0x7fdb7c142b30 2024-04-17T05:26:46.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.016+0000 7fdb83c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fdb7c0b5c90 con 0x7fdb7c09d630 2024-04-17T05:26:46.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.016+0000 7fdb81c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdb7c1492e0 0x7fdb7c1de990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:46.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.016+0000 7fdb81c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdb7c1492e0 0x7fdb7c1de990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40590/0 (socket says 172.21.15.123:40590) 2024-04-17T05:26:46.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.016+0000 7fdb81c00640 1 -- 172.21.15.123:0/364804709 learned_addr learned my addr 172.21.15.123:0/364804709 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:26:46.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.016+0000 7fdb81200640 1 --2- 172.21.15.123:0/364804709 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdb7c09d630 0x7fdb7c0b8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:46.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.016+0000 7fdb7be00640 1 --2- 172.21.15.123:0/364804709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb7c142b30 0x7fdb7c0b0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:46.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.016+0000 7fdb81c00640 1 -- 172.21.15.123:0/364804709 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdb7c09d630 msgr2=0x7fdb7c0b8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:46.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.016+0000 7fdb81c00640 1 --2- 172.21.15.123:0/364804709 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdb7c09d630 0x7fdb7c0b8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:46.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.016+0000 7fdb81c00640 1 -- 172.21.15.123:0/364804709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb7c142b30 msgr2=0x7fdb7c0b0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:46.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.016+0000 7fdb81c00640 1 --2- 172.21.15.123:0/364804709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb7c142b30 0x7fdb7c0b0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:46.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.016+0000 7fdb81c00640 1 -- 172.21.15.123:0/364804709 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7c0b2420 con 0x7fdb7c1492e0 2024-04-17T05:26:46.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.016+0000 7fdb7be00640 1 --2- 172.21.15.123:0/364804709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb7c142b30 0x7fdb7c0b0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:26:46.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.016+0000 7fdb81200640 1 --2- 172.21.15.123:0/364804709 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdb7c09d630 0x7fdb7c0b8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:26:46.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.017+0000 7fdb81c00640 1 --2- 172.21.15.123:0/364804709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdb7c1492e0 0x7fdb7c1de990 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400b970 tx=0x7fdb7400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:46.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.017+0000 7fdb78c00640 1 -- 172.21.15.123:0/364804709 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb74019070 con 0x7fdb7c1492e0 2024-04-17T05:26:46.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.017+0000 7fdb78c00640 1 -- 172.21.15.123:0/364804709 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb7400cb60 con 0x7fdb7c1492e0 2024-04-17T05:26:46.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.017+0000 7fdb83c00640 1 -- 172.21.15.123:0/364804709 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb7c0b0a00 con 0x7fdb7c1492e0 2024-04-17T05:26:46.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.017+0000 7fdb78c00640 1 -- 172.21.15.123:0/364804709 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb74014440 con 0x7fdb7c1492e0 2024-04-17T05:26:46.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.017+0000 7fdb83c00640 1 -- 172.21.15.123:0/364804709 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb7c0b2010 con 0x7fdb7c1492e0 2024-04-17T05:26:46.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.018+0000 7fdb83c00640 1 -- 172.21.15.123:0/364804709 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb7c0af2f0 con 0x7fdb7c1492e0 2024-04-17T05:26:46.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.019+0000 7fdb78c00640 1 -- 172.21.15.123:0/364804709 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7fdb7401c070 con 0x7fdb7c1492e0 2024-04-17T05:26:46.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.020+0000 7fdb78c00640 1 --2- 172.21.15.123:0/364804709 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fdb5c06c860 0x7fdb5c06ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:46.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.020+0000 7fdb78c00640 1 -- 172.21.15.123:0/364804709 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4471+0+0 (secure 0 0 0) 0x7fdb7408b380 con 0x7fdb7c1492e0 2024-04-17T05:26:46.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.021+0000 7fdb81200640 1 --2- 172.21.15.123:0/364804709 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fdb5c06c860 0x7fdb5c06ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:46.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.022+0000 7fdb81200640 1 --2- 172.21.15.123:0/364804709 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fdb5c06c860 0x7fdb5c06ed20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdb70036000 tx=0x7fdb70008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:46.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.026+0000 7fdb78c00640 1 -- 172.21.15.123:0/364804709 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fdb7c0af2f0 con 0x7fdb7c1492e0 2024-04-17T05:26:46.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.265+0000 7fdb83c00640 1 -- 172.21.15.123:0/364804709 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb7c068a40 con 0x7fdb7c1492e0 2024-04-17T05:26:46.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.266+0000 7fdb78c00640 1 -- 172.21.15.123:0/364804709 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7fdb74059cc0 con 0x7fdb7c1492e0 2024-04-17T05:26:46.265 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:26:46.265 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/515699398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":515699398},{"type":"v1","addr":"172.21.15.123:6833","nonce":515699398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-17T05:26:46.265 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 2 2024-04-17T05:26:46.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.268+0000 7fdb83c00640 1 -- 172.21.15.123:0/364804709 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fdb5c06c860 msgr2=0x7fdb5c06ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:46.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.268+0000 7fdb83c00640 1 --2- 172.21.15.123:0/364804709 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fdb5c06c860 0x7fdb5c06ed20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdb70036000 tx=0x7fdb70008030 comp rx=0 tx=0).stop 2024-04-17T05:26:46.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.268+0000 7fdb83c00640 1 -- 172.21.15.123:0/364804709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdb7c1492e0 msgr2=0x7fdb7c1de990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:46.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.268+0000 7fdb83c00640 1 --2- 172.21.15.123:0/364804709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdb7c1492e0 0x7fdb7c1de990 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400b970 tx=0x7fdb7400be30 comp rx=0 tx=0).stop 2024-04-17T05:26:46.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.268+0000 7fdb83c00640 1 -- 172.21.15.123:0/364804709 shutdown_connections 2024-04-17T05:26:46.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.268+0000 7fdb83c00640 1 --2- 172.21.15.123:0/364804709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdb7c1492e0 0x7fdb7c1de990 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:46.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.268+0000 7fdb83c00640 1 --2- 172.21.15.123:0/364804709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb7c142b30 0x7fdb7c0b0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:46.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.268+0000 7fdb83c00640 1 --2- 172.21.15.123:0/364804709 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fdb5c06c860 0x7fdb5c06ed20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:46.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.268+0000 7fdb83c00640 1 --2- 172.21.15.123:0/364804709 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdb7c09d630 0x7fdb7c0b8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:46.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.268+0000 7fdb83c00640 1 -- 172.21.15.123:0/364804709 >> 172.21.15.123:0/364804709 conn(0x7fdb7c0b93b0 msgr2=0x7fdb7c149770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:46.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.268+0000 7fdb83c00640 1 -- 172.21.15.123:0/364804709 shutdown_connections 2024-04-17T05:26:46.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:46.269+0000 7fdb83c00640 1 -- 172.21.15.123:0/364804709 wait complete. 2024-04-17T05:26:48.286 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T05:26:48.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.491+0000 7f8a8ce00640 1 Processor -- start 2024-04-17T05:26:48.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.492+0000 7f8a8ce00640 1 -- start start 2024-04-17T05:26:48.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.493+0000 7f8a8ce00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a880b61c0 0x7f8a880b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:48.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.493+0000 7f8a8ce00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f8a880b4250 0x7f8a881480f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:48.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.493+0000 7f8a8ce00640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a880b4ab0 con 0x7f8a88148630 2024-04-17T05:26:48.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.493+0000 7f8a8ce00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f8a880b69b0 con 0x7f8a880b4250 2024-04-17T05:26:48.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.493+0000 7f8a8ce00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f8a880b4d90 con 0x7f8a880b61c0 2024-04-17T05:26:48.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.493+0000 7f8a7d400640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f8a880b4250 0x7f8a881480f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:48.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.493+0000 7f8a85e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a880b61c0 0x7f8a880b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:48.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.493+0000 7f8a7d400640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f8a880b4250 0x7f8a881480f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.123:33494/0 (socket says 172.21.15.123:33494) 2024-04-17T05:26:48.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.493+0000 7f8a7d400640 1 -- 172.21.15.123:0/1043479951 learned_addr learned my addr 172.21.15.123:0/1043479951 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:26:48.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.494+0000 7f8a85e00640 1 -- 172.21.15.123:0/1043479951 >> v2:172.21.15.164:3300/0 conn(0x7f8a880b4250 msgr2=0x7f8a881480f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:48.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.494+0000 7f8a85e00640 1 --2- 172.21.15.123:0/1043479951 >> v2:172.21.15.164:3300/0 conn(0x7f8a880b4250 0x7f8a881480f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:48.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.494+0000 7f8a85e00640 1 -- 172.21.15.123:0/1043479951 >> v1:172.21.15.164:6789/0 conn(0x7f8a88148630 legacy=0x7f8a880b52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:48.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.494+0000 7f8a85e00640 1 -- 172.21.15.123:0/1043479951 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a880b65a0 con 0x7f8a880b61c0 2024-04-17T05:26:48.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.496+0000 7f8a85e00640 1 --2- 172.21.15.123:0/1043479951 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a880b61c0 0x7f8a880b3d10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8a780097a0 tx=0x7f8a7802b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bc86ef718ba1eca server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:48.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.496+0000 7f8a85400640 1 -- 172.21.15.123:0/1043479951 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a78038070 con 0x7f8a880b61c0 2024-04-17T05:26:48.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.496+0000 7f8a85400640 1 -- 172.21.15.123:0/1043479951 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a78031700 con 0x7f8a880b61c0 2024-04-17T05:26:48.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.496+0000 7f8a85400640 1 -- 172.21.15.123:0/1043479951 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a78031ad0 con 0x7f8a880b61c0 2024-04-17T05:26:48.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.496+0000 7f8a8ce00640 1 -- 172.21.15.123:0/1043479951 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a880b61c0 msgr2=0x7f8a880b3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:48.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.496+0000 7f8a8ce00640 1 --2- 172.21.15.123:0/1043479951 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a880b61c0 0x7f8a880b3d10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8a780097a0 tx=0x7f8a7802b7a0 comp rx=0 tx=0).stop 2024-04-17T05:26:48.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.497+0000 7f8a8ce00640 1 -- 172.21.15.123:0/1043479951 shutdown_connections 2024-04-17T05:26:48.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.497+0000 7f8a8ce00640 1 --2- 172.21.15.123:0/1043479951 >> v2:172.21.15.164:3300/0 conn(0x7f8a880b4250 0x7f8a881480f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:48.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.497+0000 7f8a8ce00640 1 --2- 172.21.15.123:0/1043479951 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a880b61c0 0x7f8a880b3d10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:48.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.497+0000 7f8a8ce00640 1 -- 172.21.15.123:0/1043479951 >> 172.21.15.123:0/1043479951 conn(0x7f8a880bd6f0 msgr2=0x7f8a880bdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:48.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.497+0000 7f8a8ce00640 1 -- 172.21.15.123:0/1043479951 shutdown_connections 2024-04-17T05:26:48.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.497+0000 7f8a8ce00640 1 -- 172.21.15.123:0/1043479951 wait complete. 2024-04-17T05:26:48.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.498+0000 7f8a8ce00640 1 Processor -- start 2024-04-17T05:26:48.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.498+0000 7f8a8ce00640 1 -- start start 2024-04-17T05:26:48.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.499+0000 7f8a8ce00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a880b4250 0x7f8a88141140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:48.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.499+0000 7f8a8ce00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a880b61c0 0x7f8a88151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:48.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.499+0000 7f8a8ce00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a88148630 0x7f8a88151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:48.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.499+0000 7f8a8ce00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8a88152520 con 0x7f8a88148630 2024-04-17T05:26:48.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.499+0000 7f8a8ce00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8a880b5c10 con 0x7f8a880b4250 2024-04-17T05:26:48.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.499+0000 7f8a8ce00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f8a881526a0 con 0x7f8a880b61c0 2024-04-17T05:26:48.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.500+0000 7f8a86800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a88148630 0x7f8a88151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:48.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.500+0000 7f8a86800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a88148630 0x7f8a88151f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40598/0 (socket says 172.21.15.123:40598) 2024-04-17T05:26:48.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.500+0000 7f8a86800640 1 -- 172.21.15.123:0/3868446713 learned_addr learned my addr 172.21.15.123:0/3868446713 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:26:48.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.500+0000 7f8a85e00640 1 --2- 172.21.15.123:0/3868446713 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a880b4250 0x7f8a88141140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:48.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.500+0000 7f8a7d400640 1 --2- 172.21.15.123:0/3868446713 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a880b61c0 0x7f8a88151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:48.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.500+0000 7f8a86800640 1 -- 172.21.15.123:0/3868446713 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a880b61c0 msgr2=0x7f8a88151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:48.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.500+0000 7f8a86800640 1 --2- 172.21.15.123:0/3868446713 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a880b61c0 0x7f8a88151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:48.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.500+0000 7f8a86800640 1 -- 172.21.15.123:0/3868446713 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a880b4250 msgr2=0x7f8a88141140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:48.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.500+0000 7f8a86800640 1 --2- 172.21.15.123:0/3868446713 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a880b4250 0x7f8a88141140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:48.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.500+0000 7f8a86800640 1 -- 172.21.15.123:0/3868446713 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a8814aff0 con 0x7f8a88148630 2024-04-17T05:26:48.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.500+0000 7f8a86800640 1 --2- 172.21.15.123:0/3868446713 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a88148630 0x7f8a88151f50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8a8000c6b0 tx=0x7f8a8000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:48.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.501+0000 7f8a7ea00640 1 -- 172.21.15.123:0/3868446713 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a80003b70 con 0x7f8a88148630 2024-04-17T05:26:48.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.501+0000 7f8a7ea00640 1 -- 172.21.15.123:0/3868446713 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a80003d30 con 0x7f8a88148630 2024-04-17T05:26:48.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.501+0000 7f8a7ea00640 1 -- 172.21.15.123:0/3868446713 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a80005310 con 0x7f8a88148630 2024-04-17T05:26:48.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.501+0000 7f8a8ce00640 1 -- 172.21.15.123:0/3868446713 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a88149ba0 con 0x7f8a88148630 2024-04-17T05:26:48.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.501+0000 7f8a8ce00640 1 -- 172.21.15.123:0/3868446713 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a8814b260 con 0x7f8a88148630 2024-04-17T05:26:48.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.502+0000 7f8a8ce00640 1 -- 172.21.15.123:0/3868446713 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a88068a40 con 0x7f8a88148630 2024-04-17T05:26:48.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.503+0000 7f8a7ea00640 1 -- 172.21.15.123:0/3868446713 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f8a800054b0 con 0x7f8a88148630 2024-04-17T05:26:48.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.504+0000 7f8a7ea00640 1 --2- 172.21.15.123:0/3868446713 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8a6406c860 0x7f8a6406ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:48.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.504+0000 7f8a7ea00640 1 -- 172.21.15.123:0/3868446713 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f8a8008b580 con 0x7f8a88148630 2024-04-17T05:26:48.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.505+0000 7f8a85e00640 1 --2- 172.21.15.123:0/3868446713 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8a6406c860 0x7f8a6406ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:48.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.506+0000 7f8a85e00640 1 --2- 172.21.15.123:0/3868446713 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8a6406c860 0x7f8a6406ed20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8a78035000 tx=0x7f8a78008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:48.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.510+0000 7f8a7ea00640 1 -- 172.21.15.123:0/3868446713 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f8a80059dd0 con 0x7f8a88148630 2024-04-17T05:26:48.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.761+0000 7f8a8ce00640 1 -- 172.21.15.123:0/3868446713 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a88149190 con 0x7f8a88148630 2024-04-17T05:26:48.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.761+0000 7f8a7ea00640 1 -- 172.21.15.123:0/3868446713 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2219 (secure 0 0 0) 0x7f8a800596d0 con 0x7f8a88148630 2024-04-17T05:26:48.761 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:26:48.761 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/515699398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":515699398},{"type":"v1","addr":"172.21.15.123:6833","nonce":515699398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4243,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/1946746019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1946746019},{"type":"v1","addr":"172.21.15.164:6835","nonce":1946746019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-17T05:26:48.761 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 3 2024-04-17T05:26:48.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.764+0000 7f8a8ce00640 1 -- 172.21.15.123:0/3868446713 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8a6406c860 msgr2=0x7f8a6406ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:48.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.764+0000 7f8a8ce00640 1 --2- 172.21.15.123:0/3868446713 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8a6406c860 0x7f8a6406ed20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8a78035000 tx=0x7f8a78008030 comp rx=0 tx=0).stop 2024-04-17T05:26:48.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.764+0000 7f8a8ce00640 1 -- 172.21.15.123:0/3868446713 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a88148630 msgr2=0x7f8a88151f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:48.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.764+0000 7f8a8ce00640 1 --2- 172.21.15.123:0/3868446713 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a88148630 0x7f8a88151f50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8a8000c6b0 tx=0x7f8a8000cb70 comp rx=0 tx=0).stop 2024-04-17T05:26:48.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.764+0000 7f8a8ce00640 1 -- 172.21.15.123:0/3868446713 shutdown_connections 2024-04-17T05:26:48.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.764+0000 7f8a8ce00640 1 --2- 172.21.15.123:0/3868446713 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a88148630 0x7f8a88151f50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:48.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.764+0000 7f8a8ce00640 1 --2- 172.21.15.123:0/3868446713 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8a6406c860 0x7f8a6406ed20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:48.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.764+0000 7f8a8ce00640 1 --2- 172.21.15.123:0/3868446713 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a880b61c0 0x7f8a88151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:48.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.764+0000 7f8a8ce00640 1 --2- 172.21.15.123:0/3868446713 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a880b4250 0x7f8a88141140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:48.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.764+0000 7f8a8ce00640 1 -- 172.21.15.123:0/3868446713 >> 172.21.15.123:0/3868446713 conn(0x7f8a880bd6f0 msgr2=0x7f8a880b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:48.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.764+0000 7f8a8ce00640 1 -- 172.21.15.123:0/3868446713 shutdown_connections 2024-04-17T05:26:48.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.764+0000 7f8a8ce00640 1 -- 172.21.15.123:0/3868446713 wait complete. 2024-04-17T05:26:48.781 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T05:26:48.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.972+0000 7f07ade00640 1 Processor -- start 2024-04-17T05:26:48.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.972+0000 7f07ade00640 1 -- start start 2024-04-17T05:26:48.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.973+0000 7f07ade00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f07a80b63f0 0x7f07a8148110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:48.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.973+0000 7f07ade00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07a80b59b0 0x7f07a80b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:48.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.973+0000 7f07ade00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07a80b4ae0 con 0x7f07a80b3df0 2024-04-17T05:26:48.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.973+0000 7f07ade00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f07a80b4e10 con 0x7f07a80b63f0 2024-04-17T05:26:48.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.974+0000 7f07ade00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f07a80b7830 con 0x7f07a80b59b0 2024-04-17T05:26:48.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.974+0000 7f07a6a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f07a80b63f0 0x7f07a8148110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:48.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.974+0000 7f07a6a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f07a80b63f0 0x7f07a8148110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40606/0 (socket says 172.21.15.123:40606) 2024-04-17T05:26:48.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.974+0000 7f07a6a00640 1 -- 172.21.15.123:0/2530263854 learned_addr learned my addr 172.21.15.123:0/2530263854 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:26:48.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.974+0000 7f07a6a00640 1 -- 172.21.15.123:0/2530263854 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07a80b59b0 msgr2=0x7f07a80b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:48.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.974+0000 7f07a6a00640 1 --2- 172.21.15.123:0/2530263854 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07a80b59b0 0x7f07a80b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:48.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.974+0000 7f07a6a00640 1 -- 172.21.15.123:0/2530263854 >> v1:172.21.15.123:6789/0 conn(0x7f07a80b3df0 legacy=0x7f07a80b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:48.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.974+0000 7f07a6a00640 1 -- 172.21.15.123:0/2530263854 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07a80b67d0 con 0x7f07a80b63f0 2024-04-17T05:26:48.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.975+0000 7f07a6a00640 1 --2- 172.21.15.123:0/2530263854 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07a80b63f0 0x7f07a8148110 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0798009870 tx=0x7f079802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e6a41a9ca52b2a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:48.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.976+0000 7f07a6000640 1 -- 172.21.15.123:0/2530263854 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0798034070 con 0x7f07a80b63f0 2024-04-17T05:26:48.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.976+0000 7f07a6000640 1 -- 172.21.15.123:0/2530263854 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0798030840 con 0x7f07a80b63f0 2024-04-17T05:26:48.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.976+0000 7f07a6000640 1 -- 172.21.15.123:0/2530263854 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0798030c10 con 0x7f07a80b63f0 2024-04-17T05:26:48.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.976+0000 7f07ade00640 1 -- 172.21.15.123:0/2530263854 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07a80b63f0 msgr2=0x7f07a8148110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:48.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.976+0000 7f07ade00640 1 --2- 172.21.15.123:0/2530263854 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07a80b63f0 0x7f07a8148110 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0798009870 tx=0x7f079802b980 comp rx=0 tx=0).stop 2024-04-17T05:26:48.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.977+0000 7f07ade00640 1 -- 172.21.15.123:0/2530263854 shutdown_connections 2024-04-17T05:26:48.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.977+0000 7f07ade00640 1 --2- 172.21.15.123:0/2530263854 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07a80b59b0 0x7f07a80b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:48.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.977+0000 7f07ade00640 1 --2- 172.21.15.123:0/2530263854 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07a80b63f0 0x7f07a8148110 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:48.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.977+0000 7f07ade00640 1 -- 172.21.15.123:0/2530263854 >> 172.21.15.123:0/2530263854 conn(0x7f07a80bd590 msgr2=0x7f07a80bd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:48.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.977+0000 7f07ade00640 1 -- 172.21.15.123:0/2530263854 shutdown_connections 2024-04-17T05:26:48.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.977+0000 7f07ade00640 1 -- 172.21.15.123:0/2530263854 wait complete. 2024-04-17T05:26:48.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.978+0000 7f07ade00640 1 Processor -- start 2024-04-17T05:26:48.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.978+0000 7f07ade00640 1 -- start start 2024-04-17T05:26:48.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.979+0000 7f07ade00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07a80b3df0 0x7f07a81448a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:48.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.979+0000 7f07ade00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f07a80b59b0 0x7f07a81e0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:48.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.979+0000 7f07ade00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07a80b63f0 0x7f07a8138300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:48.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.979+0000 7f07ade00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f07a8148650 con 0x7f07a80b3df0 2024-04-17T05:26:48.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.979+0000 7f07ade00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f07a8148a80 con 0x7f07a80b59b0 2024-04-17T05:26:48.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.979+0000 7f07ade00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f07a81487d0 con 0x7f07a80b63f0 2024-04-17T05:26:48.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.979+0000 7f07a6a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07a80b3df0 0x7f07a81448a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:48.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.980+0000 7f07a6a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07a80b3df0 0x7f07a81448a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40608/0 (socket says 172.21.15.123:40608) 2024-04-17T05:26:48.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.980+0000 7f07a6a00640 1 -- 172.21.15.123:0/2376157543 learned_addr learned my addr 172.21.15.123:0/2376157543 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:26:48.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.980+0000 7f07a6a00640 1 -- 172.21.15.123:0/2376157543 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07a80b63f0 msgr2=0x7f07a8138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:48.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.980+0000 7f07a7400640 1 --2- 172.21.15.123:0/2376157543 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07a80b63f0 0x7f07a8138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:48.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.980+0000 7f07a6a00640 1 --2- 172.21.15.123:0/2376157543 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07a80b63f0 0x7f07a8138300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:48.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.980+0000 7f079fe00640 1 --2- 172.21.15.123:0/2376157543 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f07a80b59b0 0x7f07a81e0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:48.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.980+0000 7f07a6a00640 1 -- 172.21.15.123:0/2376157543 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f07a80b59b0 msgr2=0x7f07a81e0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:48.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.980+0000 7f07a6a00640 1 --2- 172.21.15.123:0/2376157543 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f07a80b59b0 0x7f07a81e0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:48.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.980+0000 7f07a6a00640 1 -- 172.21.15.123:0/2376157543 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07a81cdee0 con 0x7f07a80b3df0 2024-04-17T05:26:48.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.980+0000 7f079fe00640 1 --2- 172.21.15.123:0/2376157543 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f07a80b59b0 0x7f07a81e0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:26:48.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.980+0000 7f07a6a00640 1 --2- 172.21.15.123:0/2376157543 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07a80b3df0 0x7f07a81448a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0798000c00 tx=0x7f07980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:48.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.981+0000 7f079f400640 1 -- 172.21.15.123:0/2376157543 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0798034040 con 0x7f07a80b3df0 2024-04-17T05:26:48.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.981+0000 7f079f400640 1 -- 172.21.15.123:0/2376157543 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0798039d90 con 0x7f07a80b3df0 2024-04-17T05:26:48.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.981+0000 7f079f400640 1 -- 172.21.15.123:0/2376157543 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0798043610 con 0x7f07a80b3df0 2024-04-17T05:26:48.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.981+0000 7f07ade00640 1 -- 172.21.15.123:0/2376157543 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07a81e1790 con 0x7f07a80b3df0 2024-04-17T05:26:48.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.981+0000 7f07ade00640 1 -- 172.21.15.123:0/2376157543 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07a81442c0 con 0x7f07a80b3df0 2024-04-17T05:26:48.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.982+0000 7f07ade00640 1 -- 172.21.15.123:0/2376157543 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07a8068a40 con 0x7f07a80b3df0 2024-04-17T05:26:48.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.983+0000 7f079f400640 1 -- 172.21.15.123:0/2376157543 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f079804a060 con 0x7f07a80b3df0 2024-04-17T05:26:48.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.984+0000 7f079f400640 1 --2- 172.21.15.123:0/2376157543 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f078406c890 0x7f078406ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:48.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.984+0000 7f079f400640 1 -- 172.21.15.123:0/2376157543 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f07980ad960 con 0x7f07a80b3df0 2024-04-17T05:26:48.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.988+0000 7f079f400640 1 -- 172.21.15.123:0/2376157543 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f079803e070 con 0x7f07a80b3df0 2024-04-17T05:26:48.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.998+0000 7f079fe00640 1 --2- 172.21.15.123:0/2376157543 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f078406c890 0x7f078406ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:48.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:48.999+0000 7f079fe00640 1 --2- 172.21.15.123:0/2376157543 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f078406c890 0x7f078406ed50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f07a81db450 tx=0x7f0790009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:49.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.196+0000 7f07ade00640 1 -- 172.21.15.123:0/2376157543 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f07a8146b50 con 0x7f07a80b3df0 2024-04-17T05:26:49.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.198+0000 7f079f400640 1 -- 172.21.15.123:0/2376157543 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12896 (secure 0 0 0) 0x7f079802d330 con 0x7f07a80b3df0 2024-04-17T05:26:49.197 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:26:49.197 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":18,"fsid":"0787c5c0-e77a-4102-a899-30db48b19c68","created":"2024-04-17T05:26:33.031507+0000","modified":"2024-04-17T05:26:49.013133+0000","last_up_change":"2024-04-17T05:26:44.988433+0000","last_in_change":"2024-04-17T05:26:36.682131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T05:26:46.329778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"15c87cdb-9415-45a6-a2a6-ea6bec9daece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6801","nonce":840753170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6803","nonce":840753170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6807","nonce":840753170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6805","nonce":840753170}]},"public_addr":"172.21.15.123:6801/840753170","cluster_addr":"172.21.15.123:6803/840753170","heartbeat_back_addr":"172.21.15.123:6807/840753170","heartbeat_front_addr":"172.21.15.123:6805/840753170","state":["exists","up"]},{"osd":1,"uuid":"281751b5-486d-4845-b4aa-b308bf7cec62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6822","nonce":2231878927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6827","nonce":2231878927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6831","nonce":2231878927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6829","nonce":2231878927}]},"public_addr":"172.21.15.123:6822/2231878927","cluster_addr":"172.21.15.123:6827/2231878927","heartbeat_back_addr":"172.21.15.123:6831/2231878927","heartbeat_front_addr":"172.21.15.123:6829/2231878927","state":["exists","up"]},{"osd":2,"uuid":"b42257d3-bd20-4db5-aa37-1bf5c512d0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6817","nonce":754360844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6820","nonce":754360844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6825","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6826","nonce":754360844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6823","nonce":754360844}]},"public_addr":"172.21.15.123:6817/754360844","cluster_addr":"172.21.15.123:6820/754360844","heartbeat_back_addr":"172.21.15.123:6826/754360844","heartbeat_front_addr":"172.21.15.123:6823/754360844","state":["exists","up"]},{"osd":3,"uuid":"0f26b891-bbe6-478e-8dee-78e69bb48cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6809","nonce":2898088574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6811","nonce":2898088574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6815","nonce":2898088574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6813","nonce":2898088574}]},"public_addr":"172.21.15.123:6809/2898088574","cluster_addr":"172.21.15.123:6811/2898088574","heartbeat_back_addr":"172.21.15.123:6815/2898088574","heartbeat_front_addr":"172.21.15.123:6813/2898088574","state":["exists","up"]},{"osd":4,"uuid":"43e59318-2740-4625-9d64-eec1fd43c322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6801","nonce":606484349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6804","nonce":606484349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6812","nonce":606484349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6808","nonce":606484349}]},"public_addr":"172.21.15.164:6801/606484349","cluster_addr":"172.21.15.164:6804/606484349","heartbeat_back_addr":"172.21.15.164:6812/606484349","heartbeat_front_addr":"172.21.15.164:6808/606484349","state":["exists","up"]},{"osd":5,"uuid":"aaa3acf4-4adc-4337-aba3-363851d35310","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6805","nonce":1376989593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6809","nonce":1376989593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6815","nonce":1376989593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6813","nonce":1376989593}]},"public_addr":"172.21.15.164:6805/1376989593","cluster_addr":"172.21.15.164:6809/1376989593","heartbeat_back_addr":"172.21.15.164:6815/1376989593","heartbeat_front_addr":"172.21.15.164:6813/1376989593","state":["exists","up"]},{"osd":6,"uuid":"6f765b27-7377-4d81-9192-23a965651145","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6817","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6821","nonce":1594306924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6823","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6826","nonce":1594306924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6831","nonce":1594306924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6829","nonce":1594306924}]},"public_addr":"172.21.15.164:6821/1594306924","cluster_addr":"172.21.15.164:6826/1594306924","heartbeat_back_addr":"172.21.15.164:6831/1594306924","heartbeat_front_addr":"172.21.15.164:6829/1594306924","state":["exists","up"]},{"osd":7,"uuid":"5547394b-ec2f-4311-846d-369af4b1acf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6818","nonce":295402697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6819","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6820","nonce":295402697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6825","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6827","nonce":295402697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6824","nonce":295402697}]},"public_addr":"172.21.15.164:6818/295402697","cluster_addr":"172.21.15.164:6820/295402697","heartbeat_back_addr":"172.21.15.164:6827/295402697","heartbeat_front_addr":"172.21.15.164:6824/295402697","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.034807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.022201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.751897+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.850533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.083608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.047524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.314753+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.413586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T05:26:49.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.201+0000 7f07ade00640 1 -- 172.21.15.123:0/2376157543 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f078406c890 msgr2=0x7f078406ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:49.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.201+0000 7f07ade00640 1 --2- 172.21.15.123:0/2376157543 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f078406c890 0x7f078406ed50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f07a81db450 tx=0x7f0790009040 comp rx=0 tx=0).stop 2024-04-17T05:26:49.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.201+0000 7f07ade00640 1 -- 172.21.15.123:0/2376157543 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07a80b3df0 msgr2=0x7f07a81448a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:49.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.201+0000 7f07ade00640 1 --2- 172.21.15.123:0/2376157543 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07a80b3df0 0x7f07a81448a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0798000c00 tx=0x7f07980046c0 comp rx=0 tx=0).stop 2024-04-17T05:26:49.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.201+0000 7f07ade00640 1 -- 172.21.15.123:0/2376157543 shutdown_connections 2024-04-17T05:26:49.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.201+0000 7f07ade00640 1 --2- 172.21.15.123:0/2376157543 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f078406c890 0x7f078406ed50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:49.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.201+0000 7f07ade00640 1 --2- 172.21.15.123:0/2376157543 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07a80b63f0 0x7f07a8138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:49.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.201+0000 7f07ade00640 1 --2- 172.21.15.123:0/2376157543 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f07a80b59b0 0x7f07a81e0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:49.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.201+0000 7f07ade00640 1 --2- 172.21.15.123:0/2376157543 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07a80b3df0 0x7f07a81448a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:49.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.201+0000 7f07ade00640 1 -- 172.21.15.123:0/2376157543 >> 172.21.15.123:0/2376157543 conn(0x7f07a80bd590 msgr2=0x7f07a80b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:49.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.201+0000 7f07ade00640 1 -- 172.21.15.123:0/2376157543 shutdown_connections 2024-04-17T05:26:49.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.201+0000 7f07ade00640 1 -- 172.21.15.123:0/2376157543 wait complete. 2024-04-17T05:26:49.219 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T05:26:46.329778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-17T05:26:49.219 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T05:26:49.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.429+0000 7f65d7200640 1 Processor -- start 2024-04-17T05:26:49.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.429+0000 7f65d7200640 1 -- start start 2024-04-17T05:26:49.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.430+0000 7f65d7200640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f65d80b66c0 0x7f65d80afd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:49.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.430+0000 7f65d7200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f65d80b3fa0 0x7f65d814fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:49.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.430+0000 7f65d7200640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65d81504e0 con 0x7f65d81500b0 2024-04-17T05:26:49.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.430+0000 7f65d7200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f65d80b3d20 con 0x7f65d80b3fa0 2024-04-17T05:26:49.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.430+0000 7f65d7200640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f65d80b6aa0 con 0x7f65d80b66c0 2024-04-17T05:26:49.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.431+0000 7f65d5400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f65d80b3fa0 0x7f65d814fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:49.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.431+0000 7f65d5400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f65d80b3fa0 0x7f65d814fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40616/0 (socket says 172.21.15.123:40616) 2024-04-17T05:26:49.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.431+0000 7f65d5400640 1 -- 172.21.15.123:0/3560789936 learned_addr learned my addr 172.21.15.123:0/3560789936 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:26:49.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.431+0000 7f65d5e00640 1 --2- 172.21.15.123:0/3560789936 >> v2:172.21.15.164:3300/0 conn(0x7f65d80b66c0 0x7f65d80afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:49.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.431+0000 7f65d5400640 1 -- 172.21.15.123:0/3560789936 >> v2:172.21.15.164:3300/0 conn(0x7f65d80b66c0 msgr2=0x7f65d80afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:49.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.431+0000 7f65d5400640 1 --2- 172.21.15.123:0/3560789936 >> v2:172.21.15.164:3300/0 conn(0x7f65d80b66c0 0x7f65d80afd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:49.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.431+0000 7f65d5400640 1 -- 172.21.15.123:0/3560789936 >> v1:172.21.15.164:6789/0 conn(0x7f65d81500b0 legacy=0x7f65d806cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:49.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.431+0000 7f65d5400640 1 -- 172.21.15.123:0/3560789936 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d80b5650 con 0x7f65d80b3fa0 2024-04-17T05:26:49.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.432+0000 7f65d5400640 1 --2- 172.21.15.123:0/3560789936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65d80b3fa0 0x7f65d814fb70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f65d80b70f0 tx=0x7f65c402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a31b85ccbb6f071c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:49.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.433+0000 7f65d4a00640 1 -- 172.21.15.123:0/3560789936 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c40317c0 con 0x7f65d80b3fa0 2024-04-17T05:26:49.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.433+0000 7f65d4a00640 1 -- 172.21.15.123:0/3560789936 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65c4037070 con 0x7f65d80b3fa0 2024-04-17T05:26:49.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.433+0000 7f65d4a00640 1 -- 172.21.15.123:0/3560789936 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c4031b80 con 0x7f65d80b3fa0 2024-04-17T05:26:49.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.433+0000 7f65d7200640 1 -- 172.21.15.123:0/3560789936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65d80b3fa0 msgr2=0x7f65d814fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:49.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.433+0000 7f65d7200640 1 --2- 172.21.15.123:0/3560789936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65d80b3fa0 0x7f65d814fb70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f65d80b70f0 tx=0x7f65c402b860 comp rx=0 tx=0).stop 2024-04-17T05:26:49.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.434+0000 7f65d7200640 1 -- 172.21.15.123:0/3560789936 shutdown_connections 2024-04-17T05:26:49.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.434+0000 7f65d7200640 1 --2- 172.21.15.123:0/3560789936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65d80b3fa0 0x7f65d814fb70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:49.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.434+0000 7f65d7200640 1 --2- 172.21.15.123:0/3560789936 >> v2:172.21.15.164:3300/0 conn(0x7f65d80b66c0 0x7f65d80afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:49.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.434+0000 7f65d7200640 1 -- 172.21.15.123:0/3560789936 >> 172.21.15.123:0/3560789936 conn(0x7f65d80b9a30 msgr2=0x7f65d80b5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:49.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.434+0000 7f65d7200640 1 -- 172.21.15.123:0/3560789936 shutdown_connections 2024-04-17T05:26:49.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.434+0000 7f65d7200640 1 -- 172.21.15.123:0/3560789936 wait complete. 2024-04-17T05:26:49.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.435+0000 7f65d7200640 1 Processor -- start 2024-04-17T05:26:49.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.436+0000 7f65d7200640 1 -- start start 2024-04-17T05:26:49.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.437+0000 7f65d7200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65d80b3fa0 0x7f65d8072ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:49.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.437+0000 7f65d7200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65d80b66c0 0x7f65d809dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:49.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.437+0000 7f65d7200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65d81500b0 0x7f65d81e1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:49.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.437+0000 7f65d7200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f65d814f5f0 con 0x7f65d80b66c0 2024-04-17T05:26:49.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.437+0000 7f65d7200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f65d80b4ed0 con 0x7f65d81500b0 2024-04-17T05:26:49.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.437+0000 7f65d7200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f65d80ae260 con 0x7f65d80b3fa0 2024-04-17T05:26:49.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.437+0000 7f65d5400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65d80b66c0 0x7f65d809dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:49.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.437+0000 7f65d5400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65d80b66c0 0x7f65d809dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40626/0 (socket says 172.21.15.123:40626) 2024-04-17T05:26:49.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.437+0000 7f65d5400640 1 -- 172.21.15.123:0/701110066 learned_addr learned my addr 172.21.15.123:0/701110066 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:26:49.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.437+0000 7f65d5e00640 1 --2- 172.21.15.123:0/701110066 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65d80b3fa0 0x7f65d8072ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:49.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.437+0000 7f65d6800640 1 --2- 172.21.15.123:0/701110066 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65d81500b0 0x7f65d81e1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:49.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.437+0000 7f65d5400640 1 -- 172.21.15.123:0/701110066 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65d80b3fa0 msgr2=0x7f65d8072ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:49.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.437+0000 7f65d5400640 1 --2- 172.21.15.123:0/701110066 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65d80b3fa0 0x7f65d8072ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:49.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.437+0000 7f65d5400640 1 -- 172.21.15.123:0/701110066 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65d81500b0 msgr2=0x7f65d81e1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:49.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.437+0000 7f65d5400640 1 --2- 172.21.15.123:0/701110066 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65d81500b0 0x7f65d81e1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:49.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.438+0000 7f65d5400640 1 -- 172.21.15.123:0/701110066 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d809e170 con 0x7f65d80b66c0 2024-04-17T05:26:49.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.438+0000 7f65d5400640 1 --2- 172.21.15.123:0/701110066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65d80b66c0 0x7f65d809dc30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f65c4000c00 tx=0x7f65c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:49.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.438+0000 7f65ce000640 1 -- 172.21.15.123:0/701110066 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c4032860 con 0x7f65d80b66c0 2024-04-17T05:26:49.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.438+0000 7f65ce000640 1 -- 172.21.15.123:0/701110066 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65c4032a00 con 0x7f65d80b66c0 2024-04-17T05:26:49.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.438+0000 7f65ce000640 1 -- 172.21.15.123:0/701110066 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c4032df0 con 0x7f65d80b66c0 2024-04-17T05:26:49.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.438+0000 7f65d7200640 1 -- 172.21.15.123:0/701110066 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65d809e440 con 0x7f65d80b66c0 2024-04-17T05:26:49.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.438+0000 7f65d7200640 1 -- 172.21.15.123:0/701110066 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65d809ef20 con 0x7f65d80b66c0 2024-04-17T05:26:49.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.440+0000 7f65d7200640 1 -- 172.21.15.123:0/701110066 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65d8075b30 con 0x7f65d80b66c0 2024-04-17T05:26:49.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.441+0000 7f65ce000640 1 -- 172.21.15.123:0/701110066 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f65c404c060 con 0x7f65d80b66c0 2024-04-17T05:26:49.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.442+0000 7f65ce000640 1 --2- 172.21.15.123:0/701110066 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f65b806c860 0x7f65b806ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:49.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.442+0000 7f65ce000640 1 -- 172.21.15.123:0/701110066 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f65c40ad370 con 0x7f65d80b66c0 2024-04-17T05:26:49.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.442+0000 7f65d5e00640 1 --2- 172.21.15.123:0/701110066 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f65b806c860 0x7f65b806ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:49.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.443+0000 7f65d5e00640 1 --2- 172.21.15.123:0/701110066 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f65b806c860 0x7f65b806ed20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f65c8006fd0 tx=0x7f65c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:49.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.446+0000 7f65ce000640 1 -- 172.21.15.123:0/701110066 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f65c4040070 con 0x7f65d80b66c0 2024-04-17T05:26:49.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.677+0000 7f65d7200640 1 -- 172.21.15.123:0/701110066 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f65d814bc60 con 0x7f65d80b66c0 2024-04-17T05:26:49.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.679+0000 7f65ce000640 1 -- 172.21.15.123:0/701110066 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) ==== 93+0+10 (secure 0 0 0) 0x7f65c4031e90 con 0x7f65d80b66c0 2024-04-17T05:26:49.678 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-04-17T05:26:49.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.681+0000 7f65d7200640 1 -- 172.21.15.123:0/701110066 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f65b806c860 msgr2=0x7f65b806ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:49.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.681+0000 7f65d7200640 1 --2- 172.21.15.123:0/701110066 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f65b806c860 0x7f65b806ed20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f65c8006fd0 tx=0x7f65c8008040 comp rx=0 tx=0).stop 2024-04-17T05:26:49.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.681+0000 7f65d7200640 1 -- 172.21.15.123:0/701110066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65d80b66c0 msgr2=0x7f65d809dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:49.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.681+0000 7f65d7200640 1 --2- 172.21.15.123:0/701110066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65d80b66c0 0x7f65d809dc30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f65c4000c00 tx=0x7f65c40046c0 comp rx=0 tx=0).stop 2024-04-17T05:26:49.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.681+0000 7f65d7200640 1 -- 172.21.15.123:0/701110066 shutdown_connections 2024-04-17T05:26:49.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.681+0000 7f65d7200640 1 --2- 172.21.15.123:0/701110066 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65d81500b0 0x7f65d81e1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:49.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.681+0000 7f65d7200640 1 --2- 172.21.15.123:0/701110066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65d80b66c0 0x7f65d809dc30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:49.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.681+0000 7f65d7200640 1 --2- 172.21.15.123:0/701110066 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f65b806c860 0x7f65b806ed20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:49.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.681+0000 7f65d7200640 1 --2- 172.21.15.123:0/701110066 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f65d80b3fa0 0x7f65d8072ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:49.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.681+0000 7f65d7200640 1 -- 172.21.15.123:0/701110066 >> 172.21.15.123:0/701110066 conn(0x7f65d80b9a30 msgr2=0x7f65d80b7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:49.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.681+0000 7f65d7200640 1 -- 172.21.15.123:0/701110066 shutdown_connections 2024-04-17T05:26:49.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.681+0000 7f65d7200640 1 -- 172.21.15.123:0/701110066 wait complete. 2024-04-17T05:26:49.701 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-17T05:26:49.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.905+0000 7f84b3e00640 1 Processor -- start 2024-04-17T05:26:49.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.905+0000 7f84b3e00640 1 -- start start 2024-04-17T05:26:49.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.907+0000 7f84b3e00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f84b4072be0 0x7f84b40ba800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:49.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.907+0000 7f84b3e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84b413e510 0x7f84b413e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:49.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.907+0000 7f84b3e00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84b40bad40 con 0x7f84b4071be0 2024-04-17T05:26:49.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.907+0000 7f84b3e00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f84b4072fc0 con 0x7f84b4072be0 2024-04-17T05:26:49.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.907+0000 7f84b3e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f84b40b0b00 con 0x7f84b413e510 2024-04-17T05:26:49.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.907+0000 7f84b2000640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f84b4071be0 0x7f84b4071040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49832/0 (socket says 172.21.15.123:49832) 2024-04-17T05:26:49.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.907+0000 7f84b2000640 1 -- 172.21.15.123:0/2385909500 learned_addr learned my addr 172.21.15.123:0/2385909500 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:26:49.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.907+0000 7f84b3400640 1 --2- 172.21.15.123:0/2385909500 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84b413e510 0x7f84b413e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:49.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.907+0000 7f84b2a00640 1 --2- 172.21.15.123:0/2385909500 >> v2:172.21.15.164:3300/0 conn(0x7f84b4072be0 0x7f84b40ba800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:49.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.907+0000 7f84b1600640 1 -- 172.21.15.123:0/2385909500 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1771012593 0 0) 0x7f84b40bad40 con 0x7f84b4071be0 2024-04-17T05:26:49.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.908+0000 7f84b1600640 1 -- 172.21.15.123:0/2385909500 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8498003520 con 0x7f84b4071be0 2024-04-17T05:26:49.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.908+0000 7f84b1600640 1 -- 172.21.15.123:0/2385909500 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3494358754 0 0) 0x7f8498003520 con 0x7f84b4071be0 2024-04-17T05:26:49.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.908+0000 7f84b1600640 1 -- 172.21.15.123:0/2385909500 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84b413e510 msgr2=0x7f84b413e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:49.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.908+0000 7f84b1600640 1 --2- 172.21.15.123:0/2385909500 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84b413e510 0x7f84b413e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:49.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.908+0000 7f84b1600640 1 -- 172.21.15.123:0/2385909500 >> v2:172.21.15.164:3300/0 conn(0x7f84b4072be0 msgr2=0x7f84b40ba800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:49.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.908+0000 7f84b1600640 1 --2- 172.21.15.123:0/2385909500 >> v2:172.21.15.164:3300/0 conn(0x7f84b4072be0 0x7f84b40ba800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:49.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.908+0000 7f84b1600640 1 -- 172.21.15.123:0/2385909500 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b40b0de0 con 0x7f84b4071be0 2024-04-17T05:26:49.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.908+0000 7f84b1600640 1 -- 172.21.15.123:0/2385909500 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1042962670 0 0) 0x7f84a0001670 con 0x7f84b4071be0 2024-04-17T05:26:49.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.908+0000 7f84b1600640 1 -- 172.21.15.123:0/2385909500 >> v1:172.21.15.123:6789/0 conn(0x7f84b4071be0 legacy=0x7f84b4071040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:49.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.908+0000 7f84b1600640 1 --2- 172.21.15.123:0/2385909500 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84980039b0 0x7f8498003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:49.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.908+0000 7f84b1600640 1 --2- 172.21.15.123:0/2385909500 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8498004800 0x7f8498004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:49.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.908+0000 7f84b1600640 1 --2- 172.21.15.123:0/2385909500 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84980051c0 0x7f849800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:49.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.908+0000 7f84b1600640 1 -- 172.21.15.123:0/2385909500 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f84b4072fc0 con 0x7f84980039b0 2024-04-17T05:26:49.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.908+0000 7f84b1600640 1 -- 172.21.15.123:0/2385909500 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f84b40b0b00 con 0x7f8498004800 2024-04-17T05:26:49.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.908+0000 7f84b1600640 1 -- 172.21.15.123:0/2385909500 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f849800bf00 con 0x7f84980051c0 2024-04-17T05:26:49.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.908+0000 7f84b3400640 1 --2- 172.21.15.123:0/2385909500 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84b413e510 0x7f84b413e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T05:26:49.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.908+0000 7f84b2a00640 1 --2- 172.21.15.123:0/2385909500 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84980039b0 0x7f8498003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:49.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.909+0000 7f84b3400640 1 --2- 172.21.15.123:0/2385909500 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84980051c0 0x7f849800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:49.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.909+0000 7f84b2000640 1 --2- 172.21.15.123:0/2385909500 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8498004800 0x7f8498004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:49.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.909+0000 7f84b2a00640 1 -- 172.21.15.123:0/2385909500 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84980051c0 msgr2=0x7f849800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:49.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.909+0000 7f84b2a00640 1 --2- 172.21.15.123:0/2385909500 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84980051c0 0x7f849800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:49.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.909+0000 7f84b2a00640 1 -- 172.21.15.123:0/2385909500 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8498004800 msgr2=0x7f8498004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:49.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.909+0000 7f84b2a00640 1 --2- 172.21.15.123:0/2385909500 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8498004800 0x7f8498004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:49.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.909+0000 7f84b2a00640 1 -- 172.21.15.123:0/2385909500 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8498003520 con 0x7f84980039b0 2024-04-17T05:26:49.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.909+0000 7f84b2000640 1 --2- 172.21.15.123:0/2385909500 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8498004800 0x7f8498004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:26:49.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.910+0000 7f84b2a00640 1 --2- 172.21.15.123:0/2385909500 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84980039b0 0x7f8498003dd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f84a4009af0 tx=0x7f8498005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f288c324177c64e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:49.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.910+0000 7f84b1600640 1 -- 172.21.15.123:0/2385909500 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a4039070 con 0x7f84980039b0 2024-04-17T05:26:49.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.910+0000 7f84b1600640 1 -- 172.21.15.123:0/2385909500 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84a402c710 con 0x7f84980039b0 2024-04-17T05:26:49.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.910+0000 7f84b1600640 1 -- 172.21.15.123:0/2385909500 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a4009690 con 0x7f84980039b0 2024-04-17T05:26:49.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.911+0000 7f84b3e00640 1 -- 172.21.15.123:0/2385909500 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84980039b0 msgr2=0x7f8498003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:49.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.911+0000 7f84b3e00640 1 --2- 172.21.15.123:0/2385909500 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84980039b0 0x7f8498003dd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f84a4009af0 tx=0x7f8498005830 comp rx=0 tx=0).stop 2024-04-17T05:26:49.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.911+0000 7f84b3400640 1 -- 172.21.15.123:0/2385909500 reap_dead start 2024-04-17T05:26:49.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.911+0000 7f84b3e00640 1 -- 172.21.15.123:0/2385909500 shutdown_connections 2024-04-17T05:26:49.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.911+0000 7f84b3e00640 1 -- 172.21.15.123:0/2385909500 >> 172.21.15.123:0/2385909500 conn(0x7f84b406da00 msgr2=0x7f84b40ba0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:49.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.911+0000 7f84b3e00640 1 -- 172.21.15.123:0/2385909500 shutdown_connections 2024-04-17T05:26:49.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.911+0000 7f84b3e00640 1 -- 172.21.15.123:0/2385909500 wait complete. 2024-04-17T05:26:49.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.912+0000 7f84b3e00640 1 Processor -- start 2024-04-17T05:26:49.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.913+0000 7f84b3e00640 1 -- start start 2024-04-17T05:26:49.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.913+0000 7f84b3e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84980039b0 0x7f84b4141ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:49.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.913+0000 7f84b3e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84b413f120 0x7f84b413f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:49.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.913+0000 7f84b3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84b4142000 0x7f84b413fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:49.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.913+0000 7f84b3e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f84b413eb00 con 0x7f84b413f120 2024-04-17T05:26:49.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.913+0000 7f84b3e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f84b413e980 con 0x7f84b4142000 2024-04-17T05:26:49.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.913+0000 7f84b3e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f84b413ec80 con 0x7f84980039b0 2024-04-17T05:26:49.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.914+0000 7f84b2000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84b413f120 0x7f84b413f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:49.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.914+0000 7f84b2000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84b413f120 0x7f84b413f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40644/0 (socket says 172.21.15.123:40644) 2024-04-17T05:26:49.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.914+0000 7f84b2000640 1 -- 172.21.15.123:0/2451590524 learned_addr learned my addr 172.21.15.123:0/2451590524 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:26:49.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.914+0000 7f84b2a00640 1 --2- 172.21.15.123:0/2451590524 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84980039b0 0x7f84b4141ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:49.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.914+0000 7f84b3400640 1 --2- 172.21.15.123:0/2451590524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84b4142000 0x7f84b413fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:49.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.914+0000 7f84b2000640 1 -- 172.21.15.123:0/2451590524 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84980039b0 msgr2=0x7f84b4141ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:49.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.914+0000 7f84b2000640 1 --2- 172.21.15.123:0/2451590524 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84980039b0 0x7f84b4141ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:49.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.914+0000 7f84b2000640 1 -- 172.21.15.123:0/2451590524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84b4142000 msgr2=0x7f84b413fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:49.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.914+0000 7f84b2000640 1 --2- 172.21.15.123:0/2451590524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84b4142000 0x7f84b413fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:49.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.914+0000 7f84b2000640 1 -- 172.21.15.123:0/2451590524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b4140fe0 con 0x7f84b413f120 2024-04-17T05:26:49.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.914+0000 7f84b2000640 1 --2- 172.21.15.123:0/2451590524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84b413f120 0x7f84b413f990 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f84a000d7e0 tx=0x7f84a000dca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:49.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.915+0000 7f84aaa00640 1 -- 172.21.15.123:0/2451590524 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a0019070 con 0x7f84b413f120 2024-04-17T05:26:49.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.915+0000 7f84aaa00640 1 -- 172.21.15.123:0/2451590524 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84a00074e0 con 0x7f84b413f120 2024-04-17T05:26:49.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.915+0000 7f84aaa00640 1 -- 172.21.15.123:0/2451590524 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a00049e0 con 0x7f84b413f120 2024-04-17T05:26:49.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.915+0000 7f84b3e00640 1 -- 172.21.15.123:0/2451590524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84b4148670 con 0x7f84b413f120 2024-04-17T05:26:49.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.915+0000 7f84b3e00640 1 -- 172.21.15.123:0/2451590524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84b4147500 con 0x7f84b413f120 2024-04-17T05:26:49.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.916+0000 7f84b3e00640 1 -- 172.21.15.123:0/2451590524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84b4068a40 con 0x7f84b413f120 2024-04-17T05:26:49.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.917+0000 7f84aaa00640 1 -- 172.21.15.123:0/2451590524 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f84a001c070 con 0x7f84b413f120 2024-04-17T05:26:49.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.918+0000 7f84aaa00640 1 --2- 172.21.15.123:0/2451590524 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f849406c860 0x7f849406ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:49.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.918+0000 7f84aaa00640 1 -- 172.21.15.123:0/2451590524 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f84a008b170 con 0x7f84b413f120 2024-04-17T05:26:49.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.918+0000 7f84b2a00640 1 --2- 172.21.15.123:0/2451590524 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f849406c860 0x7f849406ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:49.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.919+0000 7f84b2a00640 1 --2- 172.21.15.123:0/2451590524 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f849406c860 0x7f849406ed20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f84a4036000 tx=0x7f84a4030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:49.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:49.922+0000 7f84aaa00640 1 -- 172.21.15.123:0/2451590524 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f84a0059370 con 0x7f84b413f120 2024-04-17T05:26:50.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.130+0000 7f84b3e00640 1 -- 172.21.15.123:0/2451590524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f84b413bcc0 con 0x7f84b413f120 2024-04-17T05:26:50.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.138+0000 7f84aaa00640 1 -- 172.21.15.123:0/2451590524 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7f84a005d670 con 0x7f84b413f120 2024-04-17T05:26:50.137 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:26:50.137 INFO:teuthology.orchestra.run.smithi123.stdout:[ 2024-04-17T05:26:50.138 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-04-17T05:26:50.138 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 1, 2024-04-17T05:26:50.138 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": ".mgr" 2024-04-17T05:26:50.138 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-04-17T05:26:50.138 INFO:teuthology.orchestra.run.smithi123.stdout:] 2024-04-17T05:26:50.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.141+0000 7f84b3e00640 1 -- 172.21.15.123:0/2451590524 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f849406c860 msgr2=0x7f849406ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:50.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.141+0000 7f84b3e00640 1 --2- 172.21.15.123:0/2451590524 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f849406c860 0x7f849406ed20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f84a4036000 tx=0x7f84a4030000 comp rx=0 tx=0).stop 2024-04-17T05:26:50.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.141+0000 7f84b3e00640 1 -- 172.21.15.123:0/2451590524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84b413f120 msgr2=0x7f84b413f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:50.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.141+0000 7f84b3e00640 1 --2- 172.21.15.123:0/2451590524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84b413f120 0x7f84b413f990 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f84a000d7e0 tx=0x7f84a000dca0 comp rx=0 tx=0).stop 2024-04-17T05:26:50.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.141+0000 7f84b3e00640 1 -- 172.21.15.123:0/2451590524 shutdown_connections 2024-04-17T05:26:50.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.141+0000 7f84b3e00640 1 --2- 172.21.15.123:0/2451590524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84b4142000 0x7f84b413fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:50.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.141+0000 7f84b3e00640 1 --2- 172.21.15.123:0/2451590524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84b413f120 0x7f84b413f990 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:50.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.141+0000 7f84b3e00640 1 --2- 172.21.15.123:0/2451590524 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f849406c860 0x7f849406ed20 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:50.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.141+0000 7f84b3e00640 1 --2- 172.21.15.123:0/2451590524 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84980039b0 0x7f84b4141ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:50.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.141+0000 7f84b3e00640 1 -- 172.21.15.123:0/2451590524 >> 172.21.15.123:0/2451590524 conn(0x7f84b406da00 msgr2=0x7f84b4143030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:50.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.141+0000 7f84b3e00640 1 -- 172.21.15.123:0/2451590524 shutdown_connections 2024-04-17T05:26:50.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.141+0000 7f84b3e00640 1 -- 172.21.15.123:0/2451590524 wait complete. 2024-04-17T05:26:50.160 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-17T05:26:50.161 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-17T05:26:50.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.363+0000 7fc8d5600640 1 Processor -- start 2024-04-17T05:26:50.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.363+0000 7fc8d5600640 1 -- start start 2024-04-17T05:26:50.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.364+0000 7fc8d5600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc8d00b2be0 0x7fc8d00b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:50.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.364+0000 7fc8d5600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc8d0070b20 0x7fc8d013f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:50.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.365+0000 7fc8d5600640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8d00b2fc0 con 0x7fc8d01492c0 2024-04-17T05:26:50.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.365+0000 7fc8d5600640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc8d00b57c0 con 0x7fc8d0070b20 2024-04-17T05:26:50.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.365+0000 7fc8d5600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fc8d00b5aa0 con 0x7fc8d00b2be0 2024-04-17T05:26:50.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.365+0000 7fc8d4c00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc8d01492c0 0x7fc8d00b3c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49848/0 (socket says 172.21.15.123:49848) 2024-04-17T05:26:50.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.365+0000 7fc8d4c00640 1 -- 172.21.15.123:0/2273081788 learned_addr learned my addr 172.21.15.123:0/2273081788 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:26:50.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.365+0000 7fc8cf400640 1 --2- 172.21.15.123:0/2273081788 >> v2:172.21.15.123:3300/0 conn(0x7fc8d0070b20 0x7fc8d013f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:50.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.365+0000 7fc8cea00640 1 -- 172.21.15.123:0/2273081788 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 573095216 0 0) 0x7fc8d00b2fc0 con 0x7fc8d01492c0 2024-04-17T05:26:50.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.365+0000 7fc8cfe00640 1 --2- 172.21.15.123:0/2273081788 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc8d00b2be0 0x7fc8d00b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:50.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.365+0000 7fc8cea00640 1 -- 172.21.15.123:0/2273081788 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8b4003520 con 0x7fc8d01492c0 2024-04-17T05:26:50.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.365+0000 7fc8cf400640 1 -- 172.21.15.123:0/2273081788 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc8d00b2be0 msgr2=0x7fc8d00b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:50.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.365+0000 7fc8cf400640 1 --2- 172.21.15.123:0/2273081788 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc8d00b2be0 0x7fc8d00b4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:50.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.366+0000 7fc8cf400640 1 -- 172.21.15.123:0/2273081788 >> v1:172.21.15.123:6789/0 conn(0x7fc8d01492c0 legacy=0x7fc8d00b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:50.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.366+0000 7fc8cf400640 1 -- 172.21.15.123:0/2273081788 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8d0148da0 con 0x7fc8d0070b20 2024-04-17T05:26:50.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.367+0000 7fc8cf400640 1 --2- 172.21.15.123:0/2273081788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8d0070b20 0x7fc8d013f710 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0097a0 tx=0x7fc8bc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=588e4c3dea27255b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:50.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.367+0000 7fc8cea00640 1 -- 172.21.15.123:0/2273081788 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc0315a0 con 0x7fc8d0070b20 2024-04-17T05:26:50.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.367+0000 7fc8cea00640 1 -- 172.21.15.123:0/2273081788 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8bc037070 con 0x7fc8d0070b20 2024-04-17T05:26:50.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.367+0000 7fc8cea00640 1 -- 172.21.15.123:0/2273081788 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc031960 con 0x7fc8d0070b20 2024-04-17T05:26:50.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.367+0000 7fc8d5600640 1 -- 172.21.15.123:0/2273081788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8d0070b20 msgr2=0x7fc8d013f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:50.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.367+0000 7fc8d5600640 1 --2- 172.21.15.123:0/2273081788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8d0070b20 0x7fc8d013f710 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0097a0 tx=0x7fc8bc02b840 comp rx=0 tx=0).stop 2024-04-17T05:26:50.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.368+0000 7fc8d5600640 1 -- 172.21.15.123:0/2273081788 shutdown_connections 2024-04-17T05:26:50.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.368+0000 7fc8d5600640 1 --2- 172.21.15.123:0/2273081788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8d0070b20 0x7fc8d013f710 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:50.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.368+0000 7fc8d5600640 1 --2- 172.21.15.123:0/2273081788 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc8d00b2be0 0x7fc8d00b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:50.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.368+0000 7fc8d5600640 1 -- 172.21.15.123:0/2273081788 >> 172.21.15.123:0/2273081788 conn(0x7fc8d006c190 msgr2=0x7fc8d00b9260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:50.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.368+0000 7fc8d5600640 1 -- 172.21.15.123:0/2273081788 shutdown_connections 2024-04-17T05:26:50.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.368+0000 7fc8d5600640 1 -- 172.21.15.123:0/2273081788 wait complete. 2024-04-17T05:26:50.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.369+0000 7fc8d5600640 1 Processor -- start 2024-04-17T05:26:50.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.369+0000 7fc8d5600640 1 -- start start 2024-04-17T05:26:50.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.370+0000 7fc8d5600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc8d0070b20 0x7fc8d00b2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:50.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.370+0000 7fc8d5600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8d00b2be0 0x7fc8d00b91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:50.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.370+0000 7fc8d5600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8d01492c0 0x7fc8d01dd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:50.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.370+0000 7fc8d5600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d013fdd0 con 0x7fc8d00b2be0 2024-04-17T05:26:50.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.370+0000 7fc8d5600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d013fc50 con 0x7fc8d01492c0 2024-04-17T05:26:50.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.370+0000 7fc8d5600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fc8d0149710 con 0x7fc8d0070b20 2024-04-17T05:26:50.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.370+0000 7fc8cf400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8d00b2be0 0x7fc8d00b91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:50.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.370+0000 7fc8cf400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8d00b2be0 0x7fc8d00b91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40664/0 (socket says 172.21.15.123:40664) 2024-04-17T05:26:50.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.370+0000 7fc8cf400640 1 -- 172.21.15.123:0/3238759587 learned_addr learned my addr 172.21.15.123:0/3238759587 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:26:50.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.371+0000 7fc8cfe00640 1 --2- 172.21.15.123:0/3238759587 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc8d0070b20 0x7fc8d00b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:50.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.371+0000 7fc8d4c00640 1 --2- 172.21.15.123:0/3238759587 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8d01492c0 0x7fc8d01dd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:50.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.371+0000 7fc8cf400640 1 -- 172.21.15.123:0/3238759587 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc8d0070b20 msgr2=0x7fc8d00b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:50.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.371+0000 7fc8cf400640 1 --2- 172.21.15.123:0/3238759587 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc8d0070b20 0x7fc8d00b2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:50.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.371+0000 7fc8cf400640 1 -- 172.21.15.123:0/3238759587 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8d01492c0 msgr2=0x7fc8d01dd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:50.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.371+0000 7fc8cf400640 1 --2- 172.21.15.123:0/3238759587 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8d01492c0 0x7fc8d01dd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:50.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.371+0000 7fc8cf400640 1 -- 172.21.15.123:0/3238759587 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8d00b96f0 con 0x7fc8d00b2be0 2024-04-17T05:26:50.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.371+0000 7fc8cf400640 1 --2- 172.21.15.123:0/3238759587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8d00b2be0 0x7fc8d00b91b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0098c0 tx=0x7fc8bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:50.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.371+0000 7fc8c7e00640 1 -- 172.21.15.123:0/3238759587 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc032630 con 0x7fc8d00b2be0 2024-04-17T05:26:50.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.372+0000 7fc8c7e00640 1 -- 172.21.15.123:0/3238759587 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8bc0327f0 con 0x7fc8d00b2be0 2024-04-17T05:26:50.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.372+0000 7fc8c7e00640 1 -- 172.21.15.123:0/3238759587 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc032be0 con 0x7fc8d00b2be0 2024-04-17T05:26:50.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.372+0000 7fc8d5600640 1 -- 172.21.15.123:0/3238759587 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8d00b7ce0 con 0x7fc8d00b2be0 2024-04-17T05:26:50.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.372+0000 7fc8d5600640 1 -- 172.21.15.123:0/3238759587 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8d00b77c0 con 0x7fc8d00b2be0 2024-04-17T05:26:50.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.373+0000 7fc8d5600640 1 -- 172.21.15.123:0/3238759587 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8d0075b30 con 0x7fc8d00b2be0 2024-04-17T05:26:50.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.374+0000 7fc8c7e00640 1 -- 172.21.15.123:0/3238759587 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7fc8bc04e430 con 0x7fc8d00b2be0 2024-04-17T05:26:50.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.375+0000 7fc8c7e00640 1 --2- 172.21.15.123:0/3238759587 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc8b006c860 0x7fc8b006ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:50.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.375+0000 7fc8c7e00640 1 -- 172.21.15.123:0/3238759587 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fc8bc02f030 con 0x7fc8d00b2be0 2024-04-17T05:26:50.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.375+0000 7fc8cfe00640 1 --2- 172.21.15.123:0/3238759587 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc8b006c860 0x7fc8b006ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:50.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.376+0000 7fc8cfe00640 1 --2- 172.21.15.123:0/3238759587 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc8b006c860 0x7fc8b006ed20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc8c000a970 tx=0x7fc8c0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:50.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.380+0000 7fc8c7e00640 1 -- 172.21.15.123:0/3238759587 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fc8bc040070 con 0x7fc8d00b2be0 2024-04-17T05:26:50.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:50.585+0000 7fc8d5600640 1 -- 172.21.15.123:0/3238759587 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc8d00ba100 con 0x7fc8d00b2be0 2024-04-17T05:26:51.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.160+0000 7fc8c7e00640 1 -- 172.21.15.123:0/3238759587 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7fc8bc07be20 con 0x7fc8d00b2be0 2024-04-17T05:26:51.159 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' created 2024-04-17T05:26:51.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.163+0000 7fc8d5600640 1 -- 172.21.15.123:0/3238759587 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc8b006c860 msgr2=0x7fc8b006ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:51.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.163+0000 7fc8d5600640 1 --2- 172.21.15.123:0/3238759587 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc8b006c860 0x7fc8b006ed20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc8c000a970 tx=0x7fc8c0008040 comp rx=0 tx=0).stop 2024-04-17T05:26:51.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.163+0000 7fc8d5600640 1 -- 172.21.15.123:0/3238759587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8d00b2be0 msgr2=0x7fc8d00b91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:51.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.163+0000 7fc8d5600640 1 --2- 172.21.15.123:0/3238759587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8d00b2be0 0x7fc8d00b91b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc0098c0 tx=0x7fc8bc0046c0 comp rx=0 tx=0).stop 2024-04-17T05:26:51.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.164+0000 7fc8d5600640 1 -- 172.21.15.123:0/3238759587 shutdown_connections 2024-04-17T05:26:51.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.164+0000 7fc8d5600640 1 --2- 172.21.15.123:0/3238759587 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8d01492c0 0x7fc8d01dd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:51.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.164+0000 7fc8d5600640 1 --2- 172.21.15.123:0/3238759587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8d00b2be0 0x7fc8d00b91b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:51.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.164+0000 7fc8d5600640 1 --2- 172.21.15.123:0/3238759587 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc8b006c860 0x7fc8b006ed20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:51.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.164+0000 7fc8d5600640 1 --2- 172.21.15.123:0/3238759587 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc8d0070b20 0x7fc8d00b2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:51.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.164+0000 7fc8d5600640 1 -- 172.21.15.123:0/3238759587 >> 172.21.15.123:0/3238759587 conn(0x7fc8d006c190 msgr2=0x7fc8d00676c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:51.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.164+0000 7fc8d5600640 1 -- 172.21.15.123:0/3238759587 shutdown_connections 2024-04-17T05:26:51.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.164+0000 7fc8d5600640 1 -- 172.21.15.123:0/3238759587 wait complete. 2024-04-17T05:26:51.194 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-17T05:26:51.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.392+0000 7faca3e00640 1 Processor -- start 2024-04-17T05:26:51.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.392+0000 7faca3e00640 1 -- start start 2024-04-17T05:26:51.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.393+0000 7faca3e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7faca40ba6a0 0x7faca40b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:51.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.394+0000 7faca3e00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7faca4141a00 0x7faca4141e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:51.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.394+0000 7faca3e00640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faca4148240 con 0x7faca40b9a80 2024-04-17T05:26:51.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.394+0000 7faca3e00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7faca4142370 con 0x7faca40ba6a0 2024-04-17T05:26:51.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.394+0000 7faca3e00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7faca40b5e10 con 0x7faca4141a00 2024-04-17T05:26:51.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.394+0000 7faca2a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7faca40ba6a0 0x7faca40b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:51.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.394+0000 7faca2a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7faca40ba6a0 0x7faca40b48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40670/0 (socket says 172.21.15.123:40670) 2024-04-17T05:26:51.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.394+0000 7faca2a00640 1 -- 172.21.15.123:0/531932272 learned_addr learned my addr 172.21.15.123:0/531932272 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:26:51.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.394+0000 7faca2a00640 1 -- 172.21.15.123:0/531932272 >> v2:172.21.15.164:3300/0 conn(0x7faca4141a00 msgr2=0x7faca4141e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:51.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.394+0000 7faca2a00640 1 --2- 172.21.15.123:0/531932272 >> v2:172.21.15.164:3300/0 conn(0x7faca4141a00 0x7faca4141e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:51.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.394+0000 7faca2a00640 1 -- 172.21.15.123:0/531932272 >> v1:172.21.15.164:6789/0 conn(0x7faca40b9a80 legacy=0x7faca4147b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:51.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.394+0000 7faca2a00640 1 -- 172.21.15.123:0/531932272 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca40b57e0 con 0x7faca40ba6a0 2024-04-17T05:26:51.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.395+0000 7faca2a00640 1 --2- 172.21.15.123:0/531932272 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faca40ba6a0 0x7faca40b48f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faca40b44c0 tx=0x7fac9402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4ff1f905ee8d81e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:51.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.396+0000 7faca1600640 1 -- 172.21.15.123:0/531932272 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac9402e070 con 0x7faca40ba6a0 2024-04-17T05:26:51.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.396+0000 7faca1600640 1 -- 172.21.15.123:0/531932272 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac94037070 con 0x7faca40ba6a0 2024-04-17T05:26:51.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.396+0000 7faca1600640 1 -- 172.21.15.123:0/531932272 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac94031a00 con 0x7faca40ba6a0 2024-04-17T05:26:51.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.396+0000 7faca3e00640 1 -- 172.21.15.123:0/531932272 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faca40ba6a0 msgr2=0x7faca40b48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:51.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.396+0000 7faca3e00640 1 --2- 172.21.15.123:0/531932272 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faca40ba6a0 0x7faca40b48f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faca40b44c0 tx=0x7fac9402b880 comp rx=0 tx=0).stop 2024-04-17T05:26:51.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.396+0000 7faca3e00640 1 -- 172.21.15.123:0/531932272 shutdown_connections 2024-04-17T05:26:51.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.396+0000 7faca3e00640 1 --2- 172.21.15.123:0/531932272 >> v2:172.21.15.164:3300/0 conn(0x7faca4141a00 0x7faca4141e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:51.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.396+0000 7faca3e00640 1 --2- 172.21.15.123:0/531932272 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faca40ba6a0 0x7faca40b48f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:51.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.396+0000 7faca3e00640 1 -- 172.21.15.123:0/531932272 >> 172.21.15.123:0/531932272 conn(0x7faca406bda0 msgr2=0x7faca406c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:51.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.396+0000 7faca3e00640 1 -- 172.21.15.123:0/531932272 shutdown_connections 2024-04-17T05:26:51.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.396+0000 7faca3e00640 1 -- 172.21.15.123:0/531932272 wait complete. 2024-04-17T05:26:51.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.398+0000 7faca3e00640 1 Processor -- start 2024-04-17T05:26:51.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.398+0000 7faca3e00640 1 -- start start 2024-04-17T05:26:51.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.399+0000 7faca3e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faca40b9a80 0x7faca41cf320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:51.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.399+0000 7faca3e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faca40ba6a0 0x7faca4144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:51.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.399+0000 7faca3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faca4141a00 0x7faca41dd520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:51.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.399+0000 7faca3e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7faca40b5a80 con 0x7faca40b9a80 2024-04-17T05:26:51.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.399+0000 7faca3e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7faca40b71d0 con 0x7faca4141a00 2024-04-17T05:26:51.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.399+0000 7faca3e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7faca40b62a0 con 0x7faca40ba6a0 2024-04-17T05:26:51.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.399+0000 7faca2a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faca40b9a80 0x7faca41cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:51.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.399+0000 7faca2a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faca40b9a80 0x7faca41cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40680/0 (socket says 172.21.15.123:40680) 2024-04-17T05:26:51.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.399+0000 7faca2a00640 1 -- 172.21.15.123:0/460512484 learned_addr learned my addr 172.21.15.123:0/460512484 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:26:51.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.400+0000 7faca2000640 1 --2- 172.21.15.123:0/460512484 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faca40ba6a0 0x7faca4144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:51.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.400+0000 7faca3400640 1 --2- 172.21.15.123:0/460512484 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faca4141a00 0x7faca41dd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:51.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.400+0000 7faca2a00640 1 -- 172.21.15.123:0/460512484 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faca40ba6a0 msgr2=0x7faca4144bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:51.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.400+0000 7faca2a00640 1 --2- 172.21.15.123:0/460512484 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faca40ba6a0 0x7faca4144bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:51.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.400+0000 7faca2a00640 1 -- 172.21.15.123:0/460512484 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faca4141a00 msgr2=0x7faca41dd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:51.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.400+0000 7faca2a00640 1 --2- 172.21.15.123:0/460512484 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faca4141a00 0x7faca41dd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:51.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.400+0000 7faca2a00640 1 -- 172.21.15.123:0/460512484 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca41cdc20 con 0x7faca40b9a80 2024-04-17T05:26:51.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.400+0000 7faca3400640 1 --2- 172.21.15.123:0/460512484 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faca4141a00 0x7faca41dd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:26:51.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.400+0000 7faca2a00640 1 --2- 172.21.15.123:0/460512484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faca40b9a80 0x7faca41cf320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fac9402b8c0 tx=0x7fac940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:51.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.400+0000 7fac9aa00640 1 -- 172.21.15.123:0/460512484 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac94032880 con 0x7faca40b9a80 2024-04-17T05:26:51.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.400+0000 7fac9aa00640 1 -- 172.21.15.123:0/460512484 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac94032a20 con 0x7faca40b9a80 2024-04-17T05:26:51.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.400+0000 7faca3e00640 1 -- 172.21.15.123:0/460512484 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faca41cf980 con 0x7faca40b9a80 2024-04-17T05:26:51.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.400+0000 7fac9aa00640 1 -- 172.21.15.123:0/460512484 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac94032e10 con 0x7faca40b9a80 2024-04-17T05:26:51.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.401+0000 7faca3e00640 1 -- 172.21.15.123:0/460512484 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faca41ce250 con 0x7faca40b9a80 2024-04-17T05:26:51.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.402+0000 7faca3e00640 1 -- 172.21.15.123:0/460512484 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faca41cddf0 con 0x7faca40b9a80 2024-04-17T05:26:51.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.403+0000 7fac9aa00640 1 -- 172.21.15.123:0/460512484 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fac9404c060 con 0x7faca40b9a80 2024-04-17T05:26:51.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.403+0000 7fac9aa00640 1 --2- 172.21.15.123:0/460512484 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fac8406c8f0 0x7fac8406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:51.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.404+0000 7fac9aa00640 1 -- 172.21.15.123:0/460512484 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7fac940ad590 con 0x7faca40b9a80 2024-04-17T05:26:51.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.404+0000 7faca2000640 1 --2- 172.21.15.123:0/460512484 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fac8406c8f0 0x7fac8406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:51.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.405+0000 7faca2000640 1 --2- 172.21.15.123:0/460512484 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fac8406c8f0 0x7fac8406edb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faca41e1b50 tx=0x7fac90009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:51.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.409+0000 7fac9aa00640 1 -- 172.21.15.123:0/460512484 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fac94040070 con 0x7faca40b9a80 2024-04-17T05:26:51.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:51.611+0000 7faca3e00640 1 -- 172.21.15.123:0/460512484 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7faca40759b0 con 0x7faca40b9a80 2024-04-17T05:26:52.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.166+0000 7fac9aa00640 1 -- 172.21.15.123:0/460512484 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) ==== 171+0+0 (secure 0 0 0) 0x7fac9407b700 con 0x7faca40b9a80 2024-04-17T05:26:52.166 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' created 2024-04-17T05:26:52.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.170+0000 7faca3e00640 1 -- 172.21.15.123:0/460512484 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fac8406c8f0 msgr2=0x7fac8406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:52.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.170+0000 7faca3e00640 1 --2- 172.21.15.123:0/460512484 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fac8406c8f0 0x7fac8406edb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faca41e1b50 tx=0x7fac90009040 comp rx=0 tx=0).stop 2024-04-17T05:26:52.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.170+0000 7faca3e00640 1 -- 172.21.15.123:0/460512484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faca40b9a80 msgr2=0x7faca41cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:52.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.170+0000 7faca3e00640 1 --2- 172.21.15.123:0/460512484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faca40b9a80 0x7faca41cf320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fac9402b8c0 tx=0x7fac940046c0 comp rx=0 tx=0).stop 2024-04-17T05:26:52.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.170+0000 7faca3e00640 1 -- 172.21.15.123:0/460512484 shutdown_connections 2024-04-17T05:26:52.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.170+0000 7faca3e00640 1 --2- 172.21.15.123:0/460512484 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faca4141a00 0x7faca41dd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:52.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.170+0000 7faca3e00640 1 --2- 172.21.15.123:0/460512484 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fac8406c8f0 0x7fac8406edb0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:52.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.170+0000 7faca3e00640 1 --2- 172.21.15.123:0/460512484 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faca40ba6a0 0x7faca4144bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:52.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.170+0000 7faca3e00640 1 --2- 172.21.15.123:0/460512484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faca40b9a80 0x7faca41cf320 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:52.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.170+0000 7faca3e00640 1 -- 172.21.15.123:0/460512484 >> 172.21.15.123:0/460512484 conn(0x7faca406bda0 msgr2=0x7faca40bc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:52.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.170+0000 7faca3e00640 1 -- 172.21.15.123:0/460512484 shutdown_connections 2024-04-17T05:26:52.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.170+0000 7faca3e00640 1 -- 172.21.15.123:0/460512484 wait complete. 2024-04-17T05:26:52.199 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-17T05:26:52.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.385+0000 7f28f7000640 1 Processor -- start 2024-04-17T05:26:52.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.385+0000 7f28f7000640 1 -- start start 2024-04-17T05:26:52.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.386+0000 7f28f7000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28f006e970 0x7f28f006d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:52.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.386+0000 7f28f7000640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f28f0147a40 0x7f28f014e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:52.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.386+0000 7f28f7000640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28f006ded0 con 0x7f28f009c800 2024-04-17T05:26:52.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.387+0000 7f28f7000640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f28f0143f60 con 0x7f28f0147a40 2024-04-17T05:26:52.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.387+0000 7f28f7000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f28f009ddd0 con 0x7f28f006e970 2024-04-17T05:26:52.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.387+0000 7f28e7e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28f006e970 0x7f28f006d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:52.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.387+0000 7f28f5000640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f28f0147a40 0x7f28f014e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:52.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.387+0000 7f28f5000640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f28f0147a40 0x7f28f014e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.123:33602/0 (socket says 172.21.15.123:33602) 2024-04-17T05:26:52.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.387+0000 7f28f5000640 1 -- 172.21.15.123:0/4133238419 learned_addr learned my addr 172.21.15.123:0/4133238419 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:26:52.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.388+0000 7f28e7e00640 1 -- 172.21.15.123:0/4133238419 >> v2:172.21.15.164:3300/0 conn(0x7f28f0147a40 msgr2=0x7f28f014e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:52.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.388+0000 7f28e7e00640 1 --2- 172.21.15.123:0/4133238419 >> v2:172.21.15.164:3300/0 conn(0x7f28f0147a40 0x7f28f014e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:52.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.388+0000 7f28e7e00640 1 -- 172.21.15.123:0/4133238419 >> v1:172.21.15.164:6789/0 conn(0x7f28f009c800 legacy=0x7f28f0147330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:52.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.388+0000 7f28e7e00640 1 -- 172.21.15.123:0/4133238419 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28f009cc90 con 0x7f28f006e970 2024-04-17T05:26:52.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.388+0000 7f28f5000640 1 --2- 172.21.15.123:0/4133238419 >> v2:172.21.15.164:3300/0 conn(0x7f28f0147a40 0x7f28f014e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T05:26:52.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.389+0000 7f28e7e00640 1 --2- 172.21.15.123:0/4133238419 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28f006e970 0x7f28f006d2d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f28d80097a0 tx=0x7f28d802b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b693d184eaf467ea server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:52.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.390+0000 7f28ef400640 1 -- 172.21.15.123:0/4133238419 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d8039070 con 0x7f28f006e970 2024-04-17T05:26:52.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.390+0000 7f28ef400640 1 -- 172.21.15.123:0/4133238419 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28d80316f0 con 0x7f28f006e970 2024-04-17T05:26:52.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.390+0000 7f28ef400640 1 -- 172.21.15.123:0/4133238419 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d8031ac0 con 0x7f28f006e970 2024-04-17T05:26:52.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.391+0000 7f28f7000640 1 -- 172.21.15.123:0/4133238419 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28f006e970 msgr2=0x7f28f006d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:52.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.391+0000 7f28f7000640 1 --2- 172.21.15.123:0/4133238419 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28f006e970 0x7f28f006d2d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f28d80097a0 tx=0x7f28d802b790 comp rx=0 tx=0).stop 2024-04-17T05:26:52.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.391+0000 7f28f7000640 1 -- 172.21.15.123:0/4133238419 shutdown_connections 2024-04-17T05:26:52.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.391+0000 7f28f7000640 1 --2- 172.21.15.123:0/4133238419 >> v2:172.21.15.164:3300/0 conn(0x7f28f0147a40 0x7f28f014e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:52.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.391+0000 7f28f7000640 1 --2- 172.21.15.123:0/4133238419 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28f006e970 0x7f28f006d2d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:52.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.391+0000 7f28f7000640 1 -- 172.21.15.123:0/4133238419 >> 172.21.15.123:0/4133238419 conn(0x7f28f00b93b0 msgr2=0x7f28f00b97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:52.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.391+0000 7f28f7000640 1 -- 172.21.15.123:0/4133238419 shutdown_connections 2024-04-17T05:26:52.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.391+0000 7f28f7000640 1 -- 172.21.15.123:0/4133238419 wait complete. 2024-04-17T05:26:52.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.393+0000 7f28f7000640 1 Processor -- start 2024-04-17T05:26:52.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.393+0000 7f28f7000640 1 -- start start 2024-04-17T05:26:52.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.394+0000 7f28f7000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f28f006e970 0x7f28f01cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:52.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.394+0000 7f28f7000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28f0147a40 0x7f28f01ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:52.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.394+0000 7f28f7000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28f00702a0 0x7f28f01423c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:52.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.394+0000 7f28f7000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f28f0147e50 con 0x7f28f0147a40 2024-04-17T05:26:52.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.394+0000 7f28f7000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f28f009cf70 con 0x7f28f006e970 2024-04-17T05:26:52.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.394+0000 7f28f7000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f28f0147fd0 con 0x7f28f00702a0 2024-04-17T05:26:52.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.394+0000 7f28e7e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28f0147a40 0x7f28f01ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:52.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.394+0000 7f28e7e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28f0147a40 0x7f28f01ce5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40692/0 (socket says 172.21.15.123:40692) 2024-04-17T05:26:52.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.394+0000 7f28e7e00640 1 -- 172.21.15.123:0/4264314560 learned_addr learned my addr 172.21.15.123:0/4264314560 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:26:52.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.394+0000 7f28efe00640 1 --2- 172.21.15.123:0/4264314560 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f28f006e970 0x7f28f01cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:52.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.394+0000 7f28f5000640 1 --2- 172.21.15.123:0/4264314560 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28f00702a0 0x7f28f01423c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:52.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.395+0000 7f28e7e00640 1 -- 172.21.15.123:0/4264314560 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28f00702a0 msgr2=0x7f28f01423c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:52.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.395+0000 7f28e7e00640 1 --2- 172.21.15.123:0/4264314560 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28f00702a0 0x7f28f01423c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:52.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.395+0000 7f28e7e00640 1 -- 172.21.15.123:0/4264314560 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f28f006e970 msgr2=0x7f28f01cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:52.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.395+0000 7f28e7e00640 1 --2- 172.21.15.123:0/4264314560 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f28f006e970 0x7f28f01cd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:52.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.395+0000 7f28e7e00640 1 -- 172.21.15.123:0/4264314560 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28f01cd130 con 0x7f28f0147a40 2024-04-17T05:26:52.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.395+0000 7f28e7e00640 1 --2- 172.21.15.123:0/4264314560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28f0147a40 0x7f28f01ce5a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f28d802bda0 tx=0x7f28d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:52.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.395+0000 7f28ecc00640 1 -- 172.21.15.123:0/4264314560 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d8039040 con 0x7f28f0147a40 2024-04-17T05:26:52.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.395+0000 7f28ecc00640 1 -- 172.21.15.123:0/4264314560 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28d8031e60 con 0x7f28f0147a40 2024-04-17T05:26:52.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.395+0000 7f28ecc00640 1 -- 172.21.15.123:0/4264314560 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d80346e0 con 0x7f28f0147a40 2024-04-17T05:26:52.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.395+0000 7f28f7000640 1 -- 172.21.15.123:0/4264314560 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28f01ceae0 con 0x7f28f0147a40 2024-04-17T05:26:52.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.396+0000 7f28f7000640 1 -- 172.21.15.123:0/4264314560 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28f01cf090 con 0x7f28f0147a40 2024-04-17T05:26:52.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.397+0000 7f28f7000640 1 -- 172.21.15.123:0/4264314560 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28f01cd300 con 0x7f28f0147a40 2024-04-17T05:26:52.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.398+0000 7f28ecc00640 1 -- 172.21.15.123:0/4264314560 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f28d8046020 con 0x7f28f0147a40 2024-04-17T05:26:52.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.399+0000 7f28ecc00640 1 --2- 172.21.15.123:0/4264314560 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f28cc06c8f0 0x7f28cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:52.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.399+0000 7f28ecc00640 1 -- 172.21.15.123:0/4264314560 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7f28d80acbc0 con 0x7f28f0147a40 2024-04-17T05:26:52.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.399+0000 7f28efe00640 1 --2- 172.21.15.123:0/4264314560 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f28cc06c8f0 0x7f28cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:52.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.401+0000 7f28efe00640 1 --2- 172.21.15.123:0/4264314560 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f28cc06c8f0 0x7f28cc06edb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f28e0007fd0 tx=0x7f28e0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:52.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.404+0000 7f28ecc00640 1 -- 172.21.15.123:0/4264314560 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f28d807b040 con 0x7f28f0147a40 2024-04-17T05:26:52.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:52.640+0000 7f28f7000640 1 -- 172.21.15.123:0/4264314560 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f28f0068a40 con 0x7f28f0147a40 2024-04-17T05:26:53.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.209+0000 7f28ecc00640 1 -- 172.21.15.123:0/4264314560 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f28d807a940 con 0x7f28f0147a40 2024-04-17T05:26:53.215 INFO:teuthology.orchestra.run.smithi123.stderr:new fs with metadata pool 2 and data pool 3 2024-04-17T05:26:53.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.218+0000 7f28f7000640 1 -- 172.21.15.123:0/4264314560 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f28cc06c8f0 msgr2=0x7f28cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:53.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.218+0000 7f28f7000640 1 --2- 172.21.15.123:0/4264314560 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f28cc06c8f0 0x7f28cc06edb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f28e0007fd0 tx=0x7f28e0009040 comp rx=0 tx=0).stop 2024-04-17T05:26:53.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.218+0000 7f28f7000640 1 -- 172.21.15.123:0/4264314560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28f0147a40 msgr2=0x7f28f01ce5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:53.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.218+0000 7f28f7000640 1 --2- 172.21.15.123:0/4264314560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28f0147a40 0x7f28f01ce5a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f28d802bda0 tx=0x7f28d80046c0 comp rx=0 tx=0).stop 2024-04-17T05:26:53.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.219+0000 7f28f7000640 1 -- 172.21.15.123:0/4264314560 shutdown_connections 2024-04-17T05:26:53.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.219+0000 7f28f7000640 1 --2- 172.21.15.123:0/4264314560 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f28cc06c8f0 0x7f28cc06edb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:53.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.219+0000 7f28f7000640 1 --2- 172.21.15.123:0/4264314560 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28f00702a0 0x7f28f01423c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:53.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.219+0000 7f28f7000640 1 --2- 172.21.15.123:0/4264314560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28f0147a40 0x7f28f01ce5a0 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f28d802bda0 tx=0x7f28d80046c0 comp rx=0 tx=0).stop 2024-04-17T05:26:53.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.219+0000 7f28f7000640 1 --2- 172.21.15.123:0/4264314560 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f28f006e970 0x7f28f01cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:53.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.219+0000 7f28f7000640 1 -- 172.21.15.123:0/4264314560 >> 172.21.15.123:0/4264314560 conn(0x7f28f00b93b0 msgr2=0x7f28f00b3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:53.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.222+0000 7f28f7000640 1 -- 172.21.15.123:0/4264314560 shutdown_connections 2024-04-17T05:26:53.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.222+0000 7f28f7000640 1 -- 172.21.15.123:0/4264314560 wait complete. 2024-04-17T05:26:53.252 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-17T05:26:53.252 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-17T05:26:53.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.433+0000 7fb9f0200640 1 Processor -- start 2024-04-17T05:26:53.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.433+0000 7fb9f0200640 1 -- start start 2024-04-17T05:26:53.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.434+0000 7fb9f0200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb9e80b5330 0x7fb9e80b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:53.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.434+0000 7fb9f0200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9e80b6520 con 0x7fb9e80b6140 2024-04-17T05:26:53.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.435+0000 7fb9f0200640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9e8147dd0 con 0x7fb9e8142080 2024-04-17T05:26:53.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.435+0000 7fb9f0200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb9e81480b0 con 0x7fb9e80b5330 2024-04-17T05:26:53.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.435+0000 7fb9ed800640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb9e80b6140 0x7fb9e8141970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49860/0 (socket says 172.21.15.123:49860) 2024-04-17T05:26:53.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.435+0000 7fb9ed800640 1 -- 172.21.15.123:0/2568303647 learned_addr learned my addr 172.21.15.123:0/2568303647 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:26:53.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.435+0000 7fb9ee200640 1 --2- 172.21.15.123:0/2568303647 >> v2:172.21.15.123:3300/0 conn(0x7fb9e80b5330 0x7fb9e80b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:53.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.435+0000 7fb9e7e00640 1 -- 172.21.15.123:0/2568303647 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 231622648 0 0) 0x7fb9e80b6520 con 0x7fb9e80b6140 2024-04-17T05:26:53.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.435+0000 7fb9ee200640 1 -- 172.21.15.123:0/2568303647 >> v1:172.21.15.164:6789/0 conn(0x7fb9e8142080 legacy=0x7fb9e8150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:53.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.435+0000 7fb9ee200640 1 -- 172.21.15.123:0/2568303647 >> v1:172.21.15.123:6789/0 conn(0x7fb9e80b6140 legacy=0x7fb9e8141970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:53.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.435+0000 7fb9ee200640 1 -- 172.21.15.123:0/2568303647 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e8148390 con 0x7fb9e80b5330 2024-04-17T05:26:53.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.436+0000 7fb9ee200640 1 --2- 172.21.15.123:0/2568303647 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9e80b5330 0x7fb9e80b4d50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009d90 tx=0x7fb9e002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b4b16b9d0572402 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:53.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.437+0000 7fb9e7e00640 1 -- 172.21.15.123:0/2568303647 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0039070 con 0x7fb9e80b5330 2024-04-17T05:26:53.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.437+0000 7fb9e7e00640 1 -- 172.21.15.123:0/2568303647 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9e002cbd0 con 0x7fb9e80b5330 2024-04-17T05:26:53.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.437+0000 7fb9e7e00640 1 -- 172.21.15.123:0/2568303647 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0034440 con 0x7fb9e80b5330 2024-04-17T05:26:53.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.437+0000 7fb9f0200640 1 -- 172.21.15.123:0/2568303647 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9e80b5330 msgr2=0x7fb9e80b4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:53.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.437+0000 7fb9f0200640 1 --2- 172.21.15.123:0/2568303647 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9e80b5330 0x7fb9e80b4d50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009d90 tx=0x7fb9e002be20 comp rx=0 tx=0).stop 2024-04-17T05:26:53.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.437+0000 7fb9f0200640 1 -- 172.21.15.123:0/2568303647 shutdown_connections 2024-04-17T05:26:53.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.437+0000 7fb9f0200640 1 --2- 172.21.15.123:0/2568303647 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9e80b5330 0x7fb9e80b4d50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:53.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.437+0000 7fb9f0200640 1 -- 172.21.15.123:0/2568303647 >> 172.21.15.123:0/2568303647 conn(0x7fb9e806c1a0 msgr2=0x7fb9e80bd480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:53.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.437+0000 7fb9f0200640 1 -- 172.21.15.123:0/2568303647 shutdown_connections 2024-04-17T05:26:53.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.438+0000 7fb9f0200640 1 -- 172.21.15.123:0/2568303647 wait complete. 2024-04-17T05:26:53.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.439+0000 7fb9f0200640 1 Processor -- start 2024-04-17T05:26:53.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.439+0000 7fb9f0200640 1 -- start start 2024-04-17T05:26:53.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.440+0000 7fb9f0200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9e80b5330 0x7fb9e81497b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:53.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.440+0000 7fb9f0200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb9e80b6140 0x7fb9e814ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:53.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.441+0000 7fb9f0200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9e8142080 0x7fb9e81e0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:53.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.441+0000 7fb9f0200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e80b7e00 con 0x7fb9e8142080 2024-04-17T05:26:53.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.441+0000 7fb9f0200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e8148ac0 con 0x7fb9e80b6140 2024-04-17T05:26:53.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.441+0000 7fb9f0200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fb9e80b7f80 con 0x7fb9e80b5330 2024-04-17T05:26:53.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.441+0000 7fb9ee200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9e8142080 0x7fb9e81e0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:53.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.441+0000 7fb9ee200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9e8142080 0x7fb9e81e0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40710/0 (socket says 172.21.15.123:40710) 2024-04-17T05:26:53.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.441+0000 7fb9ee200640 1 -- 172.21.15.123:0/231153797 learned_addr learned my addr 172.21.15.123:0/231153797 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:26:53.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.441+0000 7fb9ed800640 1 --2- 172.21.15.123:0/231153797 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9e80b5330 0x7fb9e81497b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:53.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.441+0000 7fb9ece00640 1 --2- 172.21.15.123:0/231153797 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb9e80b6140 0x7fb9e814ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:53.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.441+0000 7fb9ee200640 1 -- 172.21.15.123:0/231153797 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9e80b5330 msgr2=0x7fb9e81497b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:53.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.441+0000 7fb9ee200640 1 --2- 172.21.15.123:0/231153797 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9e80b5330 0x7fb9e81497b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:53.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.441+0000 7fb9ee200640 1 -- 172.21.15.123:0/231153797 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb9e80b6140 msgr2=0x7fb9e814ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:53.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.441+0000 7fb9ee200640 1 --2- 172.21.15.123:0/231153797 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb9e80b6140 0x7fb9e814ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:53.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.441+0000 7fb9ee200640 1 -- 172.21.15.123:0/231153797 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e814afe0 con 0x7fb9e8142080 2024-04-17T05:26:53.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.442+0000 7fb9ee200640 1 --2- 172.21.15.123:0/231153797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9e8142080 0x7fb9e81e0d20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009d90 tx=0x7fb9e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:53.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.442+0000 7fb9e5600640 1 -- 172.21.15.123:0/231153797 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0044020 con 0x7fb9e8142080 2024-04-17T05:26:53.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.442+0000 7fb9e5600640 1 -- 172.21.15.123:0/231153797 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9e003f470 con 0x7fb9e8142080 2024-04-17T05:26:53.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.442+0000 7fb9e5600640 1 -- 172.21.15.123:0/231153797 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0039040 con 0x7fb9e8142080 2024-04-17T05:26:53.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.442+0000 7fb9f0200640 1 -- 172.21.15.123:0/231153797 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9e8148d80 con 0x7fb9e8142080 2024-04-17T05:26:53.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.442+0000 7fb9f0200640 1 -- 172.21.15.123:0/231153797 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9e81491d0 con 0x7fb9e8142080 2024-04-17T05:26:53.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.443+0000 7fb9f0200640 1 -- 172.21.15.123:0/231153797 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9e8068a40 con 0x7fb9e8142080 2024-04-17T05:26:53.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.444+0000 7fb9e5600640 1 -- 172.21.15.123:0/231153797 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb9e0047020 con 0x7fb9e8142080 2024-04-17T05:26:53.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.445+0000 7fb9e5600640 1 --2- 172.21.15.123:0/231153797 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fb9c806c8f0 0x7fb9c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:53.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.445+0000 7fb9e5600640 1 -- 172.21.15.123:0/231153797 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb9e00ae790 con 0x7fb9e8142080 2024-04-17T05:26:53.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.445+0000 7fb9ed800640 1 --2- 172.21.15.123:0/231153797 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fb9c806c8f0 0x7fb9c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:53.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.447+0000 7fb9ed800640 1 --2- 172.21.15.123:0/231153797 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fb9c806c8f0 0x7fb9c806edb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4007fd0 tx=0x7fb9d4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:53.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.450+0000 7fb9e5600640 1 -- 172.21.15.123:0/231153797 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fb9e004e030 con 0x7fb9e8142080 2024-04-17T05:26:53.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:53.655+0000 7fb9f0200640 1 -- 172.21.15.123:0/231153797 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fb9e8148f50 con 0x7fb9e8142080 2024-04-17T05:26:54.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.210+0000 7fb9e5600640 1 -- 172.21.15.123:0/231153797 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) ==== 157+0+0 (secure 0 0 0) 0x7fb9e007cbb0 con 0x7fb9e8142080 2024-04-17T05:26:54.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.213+0000 7fb9f0200640 1 -- 172.21.15.123:0/231153797 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fb9c806c8f0 msgr2=0x7fb9c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:54.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.213+0000 7fb9f0200640 1 --2- 172.21.15.123:0/231153797 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fb9c806c8f0 0x7fb9c806edb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4007fd0 tx=0x7fb9d4009040 comp rx=0 tx=0).stop 2024-04-17T05:26:54.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.213+0000 7fb9f0200640 1 -- 172.21.15.123:0/231153797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9e8142080 msgr2=0x7fb9e81e0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:54.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.213+0000 7fb9f0200640 1 --2- 172.21.15.123:0/231153797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9e8142080 0x7fb9e81e0d20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009d90 tx=0x7fb9e0004a40 comp rx=0 tx=0).stop 2024-04-17T05:26:54.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.213+0000 7fb9f0200640 1 -- 172.21.15.123:0/231153797 shutdown_connections 2024-04-17T05:26:54.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.213+0000 7fb9f0200640 1 --2- 172.21.15.123:0/231153797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9e8142080 0x7fb9e81e0d20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:54.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.213+0000 7fb9f0200640 1 --2- 172.21.15.123:0/231153797 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb9e80b6140 0x7fb9e814ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:54.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.213+0000 7fb9f0200640 1 --2- 172.21.15.123:0/231153797 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fb9c806c8f0 0x7fb9c806edb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:54.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.213+0000 7fb9f0200640 1 --2- 172.21.15.123:0/231153797 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb9e80b5330 0x7fb9e81497b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:54.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.213+0000 7fb9f0200640 1 -- 172.21.15.123:0/231153797 >> 172.21.15.123:0/231153797 conn(0x7fb9e806c1a0 msgr2=0x7fb9e813e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:54.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.214+0000 7fb9f0200640 1 -- 172.21.15.123:0/231153797 shutdown_connections 2024-04-17T05:26:54.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.214+0000 7fb9f0200640 1 -- 172.21.15.123:0/231153797 wait complete. 2024-04-17T05:26:54.235 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-17T05:26:54.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.451+0000 7eff1fe00640 1 Processor -- start 2024-04-17T05:26:54.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.451+0000 7eff1fe00640 1 -- start start 2024-04-17T05:26:54.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.452+0000 7eff1fe00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7eff200b54b0 0x7eff2009b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:54.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.452+0000 7eff1fe00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff200af0b0 con 0x7eff2014c0f0 2024-04-17T05:26:54.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.452+0000 7eff1fe00640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff200b5890 con 0x7eff200ae0f0 2024-04-17T05:26:54.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.452+0000 7eff1fe00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7eff2009ac60 con 0x7eff200b54b0 2024-04-17T05:26:54.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.452+0000 7eff1ea00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7eff200b54b0 0x7eff2009b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:54.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.453+0000 7eff16000640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7eff2014c0f0 0x7eff200afc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49866/0 (socket says 172.21.15.123:49866) 2024-04-17T05:26:54.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.453+0000 7eff1ea00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7eff200b54b0 0x7eff2009b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40724/0 (socket says 172.21.15.123:40724) 2024-04-17T05:26:54.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.453+0000 7eff16000640 1 -- 172.21.15.123:0/408913767 learned_addr learned my addr 172.21.15.123:0/408913767 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:26:54.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.453+0000 7eff1ea00640 1 -- 172.21.15.123:0/408913767 >> v1:172.21.15.164:6789/0 conn(0x7eff200ae0f0 legacy=0x7eff2014c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:54.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.453+0000 7eff1ea00640 1 -- 172.21.15.123:0/408913767 >> v1:172.21.15.123:6789/0 conn(0x7eff2014c0f0 legacy=0x7eff200afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:54.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.453+0000 7eff1ea00640 1 -- 172.21.15.123:0/408913767 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff2009af40 con 0x7eff200b54b0 2024-04-17T05:26:54.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.453+0000 7eff1e000640 1 -- 172.21.15.123:0/408913767 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2880257245 0 0) 0x7eff200af0b0 con 0x7eff2014c0f0 2024-04-17T05:26:54.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.454+0000 7eff1ea00640 1 --2- 172.21.15.123:0/408913767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff200b54b0 0x7eff2009b360 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7eff100097d0 tx=0x7eff1002b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f63ffcd3ed088f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:54.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.454+0000 7eff1e000640 1 -- 172.21.15.123:0/408913767 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff10031780 con 0x7eff200b54b0 2024-04-17T05:26:54.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.454+0000 7eff1e000640 1 -- 172.21.15.123:0/408913767 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff10037070 con 0x7eff200b54b0 2024-04-17T05:26:54.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.454+0000 7eff1e000640 1 -- 172.21.15.123:0/408913767 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff10031b40 con 0x7eff200b54b0 2024-04-17T05:26:54.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.455+0000 7eff1fe00640 1 -- 172.21.15.123:0/408913767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff200b54b0 msgr2=0x7eff2009b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:54.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.455+0000 7eff1fe00640 1 --2- 172.21.15.123:0/408913767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff200b54b0 0x7eff2009b360 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7eff100097d0 tx=0x7eff1002b820 comp rx=0 tx=0).stop 2024-04-17T05:26:54.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.455+0000 7eff1fe00640 1 -- 172.21.15.123:0/408913767 shutdown_connections 2024-04-17T05:26:54.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.455+0000 7eff1fe00640 1 --2- 172.21.15.123:0/408913767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff200b54b0 0x7eff2009b360 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:54.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.455+0000 7eff1fe00640 1 -- 172.21.15.123:0/408913767 >> 172.21.15.123:0/408913767 conn(0x7eff200b5bd0 msgr2=0x7eff200b5fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:54.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.455+0000 7eff1fe00640 1 -- 172.21.15.123:0/408913767 shutdown_connections 2024-04-17T05:26:54.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.455+0000 7eff1fe00640 1 -- 172.21.15.123:0/408913767 wait complete. 2024-04-17T05:26:54.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.457+0000 7eff1fe00640 1 Processor -- start 2024-04-17T05:26:54.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.457+0000 7eff1fe00640 1 -- start start 2024-04-17T05:26:54.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.458+0000 7eff1fe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff200ae0f0 0x7eff201497c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:54.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.458+0000 7eff1fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff200b54b0 0x7eff20148600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:54.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.458+0000 7eff1fe00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff2014c0f0 0x7eff20146f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:54.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.458+0000 7eff1fe00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7eff20157b20 con 0x7eff200ae0f0 2024-04-17T05:26:54.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.458+0000 7eff1fe00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7eff201579a0 con 0x7eff200b54b0 2024-04-17T05:26:54.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.458+0000 7eff1fe00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7eff20157ca0 con 0x7eff2014c0f0 2024-04-17T05:26:54.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.458+0000 7eff1ea00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff200ae0f0 0x7eff201497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:54.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.458+0000 7eff1ea00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff200ae0f0 0x7eff201497c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40726/0 (socket says 172.21.15.123:40726) 2024-04-17T05:26:54.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.458+0000 7eff1ea00640 1 -- 172.21.15.123:0/2042401056 learned_addr learned my addr 172.21.15.123:0/2042401056 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:26:54.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.458+0000 7eff1ea00640 1 -- 172.21.15.123:0/2042401056 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff2014c0f0 msgr2=0x7eff20146f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:54.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.458+0000 7eff1ea00640 1 --2- 172.21.15.123:0/2042401056 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff2014c0f0 0x7eff20146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:54.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.458+0000 7eff1ea00640 1 -- 172.21.15.123:0/2042401056 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff200b54b0 msgr2=0x7eff20148600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:54.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.458+0000 7eff1ea00640 1 --2- 172.21.15.123:0/2042401056 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff200b54b0 0x7eff20148600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:54.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.458+0000 7eff1ea00640 1 -- 172.21.15.123:0/2042401056 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff20148d50 con 0x7eff200ae0f0 2024-04-17T05:26:54.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.459+0000 7eff1ea00640 1 --2- 172.21.15.123:0/2042401056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff200ae0f0 0x7eff201497c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7eff1002be30 tx=0x7eff100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:54.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.459+0000 7eff17e00640 1 -- 172.21.15.123:0/2042401056 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff10032820 con 0x7eff200ae0f0 2024-04-17T05:26:54.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.459+0000 7eff17e00640 1 -- 172.21.15.123:0/2042401056 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff100329c0 con 0x7eff200ae0f0 2024-04-17T05:26:54.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.459+0000 7eff17e00640 1 -- 172.21.15.123:0/2042401056 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff10032db0 con 0x7eff200ae0f0 2024-04-17T05:26:54.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.459+0000 7eff1fe00640 1 -- 172.21.15.123:0/2042401056 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff2014f000 con 0x7eff200ae0f0 2024-04-17T05:26:54.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.459+0000 7eff1fe00640 1 -- 172.21.15.123:0/2042401056 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff20147490 con 0x7eff200ae0f0 2024-04-17T05:26:54.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.460+0000 7eff1fe00640 1 -- 172.21.15.123:0/2042401056 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff200759b0 con 0x7eff200ae0f0 2024-04-17T05:26:54.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.461+0000 7eff17e00640 1 -- 172.21.15.123:0/2042401056 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7eff100453f0 con 0x7eff200ae0f0 2024-04-17T05:26:54.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.462+0000 7eff17e00640 1 --2- 172.21.15.123:0/2042401056 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7efefc06c8f0 0x7efefc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:54.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.462+0000 7eff17e00640 1 -- 172.21.15.123:0/2042401056 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6007+0+0 (secure 0 0 0) 0x7eff100ada50 con 0x7eff200ae0f0 2024-04-17T05:26:54.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.462+0000 7eff16000640 1 --2- 172.21.15.123:0/2042401056 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7efefc06c8f0 0x7efefc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:54.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.464+0000 7eff16000640 1 --2- 172.21.15.123:0/2042401056 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7efefc06c8f0 0x7efefc06edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7eff08007fd0 tx=0x7eff08007960 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:54.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.466+0000 7eff17e00640 1 -- 172.21.15.123:0/2042401056 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7eff10040070 con 0x7eff200ae0f0 2024-04-17T05:26:54.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:54.673+0000 7eff1fe00640 1 -- 172.21.15.123:0/2042401056 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7eff200b6f70 con 0x7eff200ae0f0 2024-04-17T05:26:56.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.247+0000 7eff17e00640 1 -- 172.21.15.123:0/2042401056 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) ==== 228+0+0 (secure 0 0 0) 0x7eff1002f050 con 0x7eff200ae0f0 2024-04-17T05:26:56.250 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data_ec' created 2024-04-17T05:26:56.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.251+0000 7eff1fe00640 1 -- 172.21.15.123:0/2042401056 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7efefc06c8f0 msgr2=0x7efefc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:56.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.251+0000 7eff1fe00640 1 --2- 172.21.15.123:0/2042401056 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7efefc06c8f0 0x7efefc06edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7eff08007fd0 tx=0x7eff08007960 comp rx=0 tx=0).stop 2024-04-17T05:26:56.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.251+0000 7eff1fe00640 1 -- 172.21.15.123:0/2042401056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff200ae0f0 msgr2=0x7eff201497c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:56.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.251+0000 7eff1fe00640 1 --2- 172.21.15.123:0/2042401056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff200ae0f0 0x7eff201497c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7eff1002be30 tx=0x7eff100046c0 comp rx=0 tx=0).stop 2024-04-17T05:26:56.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.251+0000 7eff1fe00640 1 -- 172.21.15.123:0/2042401056 shutdown_connections 2024-04-17T05:26:56.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.251+0000 7eff1fe00640 1 --2- 172.21.15.123:0/2042401056 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7efefc06c8f0 0x7efefc06edb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:56.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.251+0000 7eff1fe00640 1 --2- 172.21.15.123:0/2042401056 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7eff2014c0f0 0x7eff20146f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:56.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.251+0000 7eff1fe00640 1 --2- 172.21.15.123:0/2042401056 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7eff200b54b0 0x7eff20148600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:56.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.251+0000 7eff1fe00640 1 --2- 172.21.15.123:0/2042401056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff200ae0f0 0x7eff201497c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:56.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.252+0000 7eff1fe00640 1 -- 172.21.15.123:0/2042401056 >> 172.21.15.123:0/2042401056 conn(0x7eff200b5bd0 msgr2=0x7eff200afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:56.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.252+0000 7eff1fe00640 1 -- 172.21.15.123:0/2042401056 shutdown_connections 2024-04-17T05:26:56.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.252+0000 7eff1fe00640 1 -- 172.21.15.123:0/2042401056 wait complete. 2024-04-17T05:26:56.279 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-17T05:26:56.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.467+0000 7f2854c00640 1 Processor -- start 2024-04-17T05:26:56.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.467+0000 7f2854c00640 1 -- start start 2024-04-17T05:26:56.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.469+0000 7f2854c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28500b9b00 0x7f28500b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:56.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.469+0000 7f2854c00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2850145c10 0x7f285014f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:56.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.469+0000 7f2854c00640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28500b2fd0 con 0x7f2850146070 2024-04-17T05:26:56.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.469+0000 7f2854c00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f28500b9ee0 con 0x7f2850145c10 2024-04-17T05:26:56.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.469+0000 7f2854c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f28500b3240 con 0x7f28500b9b00 2024-04-17T05:26:56.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.469+0000 7f2846a00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2850145c10 0x7f285014f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:56.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.470+0000 7f284f400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28500b9b00 0x7f28500b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:56.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.470+0000 7f2846a00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2850145c10 0x7f285014f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.123:56252/0 (socket says 172.21.15.123:56252) 2024-04-17T05:26:56.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.470+0000 7f284fe00640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f2850146070 0x7f28500b3b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.123:59198/0 (socket says 172.21.15.123:59198) 2024-04-17T05:26:56.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.470+0000 7f2846a00640 1 -- 172.21.15.123:0/1147412599 learned_addr learned my addr 172.21.15.123:0/1147412599 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:26:56.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.470+0000 7f284f400640 1 -- 172.21.15.123:0/1147412599 >> v2:172.21.15.164:3300/0 conn(0x7f2850145c10 msgr2=0x7f285014f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:56.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.470+0000 7f284f400640 1 --2- 172.21.15.123:0/1147412599 >> v2:172.21.15.164:3300/0 conn(0x7f2850145c10 0x7f285014f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:56.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.470+0000 7f284f400640 1 -- 172.21.15.123:0/1147412599 >> v1:172.21.15.164:6789/0 conn(0x7f2850146070 legacy=0x7f28500b3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:56.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.470+0000 7f284f400640 1 -- 172.21.15.123:0/1147412599 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28500b0800 con 0x7f28500b9b00 2024-04-17T05:26:56.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.471+0000 7f2846a00640 1 --2- 172.21.15.123:0/1147412599 >> v2:172.21.15.164:3300/0 conn(0x7f2850145c10 0x7f285014f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T05:26:56.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.472+0000 7f284f400640 1 --2- 172.21.15.123:0/1147412599 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28500b9b00 0x7f28500b1de0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2840009d90 tx=0x7f284002be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a1fd4c6d715b2f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:56.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.473+0000 7f284ea00640 1 -- 172.21.15.123:0/1147412599 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2840039070 con 0x7f28500b9b00 2024-04-17T05:26:56.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.473+0000 7f284ea00640 1 -- 172.21.15.123:0/1147412599 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f284002cbd0 con 0x7f28500b9b00 2024-04-17T05:26:56.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.473+0000 7f284ea00640 1 -- 172.21.15.123:0/1147412599 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2840034440 con 0x7f28500b9b00 2024-04-17T05:26:56.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.473+0000 7f2854c00640 1 -- 172.21.15.123:0/1147412599 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28500b9b00 msgr2=0x7f28500b1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:56.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.473+0000 7f2854c00640 1 --2- 172.21.15.123:0/1147412599 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28500b9b00 0x7f28500b1de0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2840009d90 tx=0x7f284002be20 comp rx=0 tx=0).stop 2024-04-17T05:26:56.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.474+0000 7f2854c00640 1 -- 172.21.15.123:0/1147412599 shutdown_connections 2024-04-17T05:26:56.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.474+0000 7f2854c00640 1 --2- 172.21.15.123:0/1147412599 >> v2:172.21.15.164:3300/0 conn(0x7f2850145c10 0x7f285014f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:56.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.474+0000 7f2854c00640 1 --2- 172.21.15.123:0/1147412599 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f28500b9b00 0x7f28500b1de0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:56.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.474+0000 7f2854c00640 1 -- 172.21.15.123:0/1147412599 >> 172.21.15.123:0/1147412599 conn(0x7f285006c100 msgr2=0x7f28500b9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:56.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.474+0000 7f2854c00640 1 -- 172.21.15.123:0/1147412599 shutdown_connections 2024-04-17T05:26:56.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.474+0000 7f2854c00640 1 -- 172.21.15.123:0/1147412599 wait complete. 2024-04-17T05:26:56.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.475+0000 7f2854c00640 1 Processor -- start 2024-04-17T05:26:56.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.475+0000 7f2854c00640 1 -- start start 2024-04-17T05:26:56.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.476+0000 7f2854c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28500b9b00 0x7f2850147ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:56.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.476+0000 7f2854c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2850145c10 0x7f285014ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:56.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.476+0000 7f2854c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2850146070 0x7f28501487a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:56.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.476+0000 7f2854c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f28500b5800 con 0x7f28500b9b00 2024-04-17T05:26:56.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.476+0000 7f2854c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f28500b0dc0 con 0x7f2850145c10 2024-04-17T05:26:56.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.476+0000 7f2854c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f285014f800 con 0x7f2850146070 2024-04-17T05:26:56.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.477+0000 7f284f400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28500b9b00 0x7f2850147ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:56.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.477+0000 7f284f400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28500b9b00 0x7f2850147ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50336/0 (socket says 172.21.15.123:50336) 2024-04-17T05:26:56.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.477+0000 7f284f400640 1 -- 172.21.15.123:0/570225278 learned_addr learned my addr 172.21.15.123:0/570225278 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:26:56.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.477+0000 7f2846a00640 1 --2- 172.21.15.123:0/570225278 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2850145c10 0x7f285014ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:56.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.477+0000 7f284fe00640 1 --2- 172.21.15.123:0/570225278 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2850146070 0x7f28501487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:56.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.477+0000 7f284f400640 1 -- 172.21.15.123:0/570225278 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2850146070 msgr2=0x7f28501487a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:56.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.477+0000 7f284f400640 1 --2- 172.21.15.123:0/570225278 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2850146070 0x7f28501487a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:56.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.477+0000 7f284f400640 1 -- 172.21.15.123:0/570225278 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2850145c10 msgr2=0x7f285014ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:56.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.477+0000 7f284f400640 1 --2- 172.21.15.123:0/570225278 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2850145c10 0x7f285014ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:56.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.477+0000 7f284f400640 1 -- 172.21.15.123:0/570225278 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28501466c0 con 0x7f28500b9b00 2024-04-17T05:26:56.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.477+0000 7f284f400640 1 --2- 172.21.15.123:0/570225278 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28500b9b00 0x7f2850147ed0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2840009d90 tx=0x7f2840004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:56.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.478+0000 7f2847e00640 1 -- 172.21.15.123:0/570225278 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2840044020 con 0x7f28500b9b00 2024-04-17T05:26:56.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.478+0000 7f2847e00640 1 -- 172.21.15.123:0/570225278 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f284003a040 con 0x7f28500b9b00 2024-04-17T05:26:56.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.478+0000 7f2847e00640 1 -- 172.21.15.123:0/570225278 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2840039070 con 0x7f28500b9b00 2024-04-17T05:26:56.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.478+0000 7f2854c00640 1 -- 172.21.15.123:0/570225278 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2850149270 con 0x7f28500b9b00 2024-04-17T05:26:56.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.478+0000 7f2854c00640 1 -- 172.21.15.123:0/570225278 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f285014b1b0 con 0x7f28500b9b00 2024-04-17T05:26:56.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.479+0000 7f2854c00640 1 -- 172.21.15.123:0/570225278 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2850146a70 con 0x7f28500b9b00 2024-04-17T05:26:56.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.480+0000 7f2847e00640 1 -- 172.21.15.123:0/570225278 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2840047020 con 0x7f28500b9b00 2024-04-17T05:26:56.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.481+0000 7f2847e00640 1 --2- 172.21.15.123:0/570225278 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f282c06c8f0 0x7f282c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:56.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.481+0000 7f2847e00640 1 -- 172.21.15.123:0/570225278 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7f28400ae7c0 con 0x7f28500b9b00 2024-04-17T05:26:56.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.482+0000 7f2846a00640 1 --2- 172.21.15.123:0/570225278 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f282c06c8f0 0x7f282c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:56.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.483+0000 7f2846a00640 1 --2- 172.21.15.123:0/570225278 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f282c06c8f0 0x7f282c06edb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f28500b88a0 tx=0x7f2838008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:56.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.486+0000 7f2847e00640 1 -- 172.21.15.123:0/570225278 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f284004e030 con 0x7f28500b9b00 2024-04-17T05:26:56.566 INFO:tasks.ceph.mds.b.smithi164.stderr:2024-04-17T05:26:56.569+0000 7ff358800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-17T05:26:56.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:56.686+0000 7f2854c00640 1 -- 172.21.15.123:0/570225278 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f285014d2d0 con 0x7f28500b9b00 2024-04-17T05:26:57.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.261+0000 7f2847e00640 1 -- 172.21.15.123:0/570225278 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v25) ==== 169+0+0 (secure 0 0 0) 0x7f284007c960 con 0x7f28500b9b00 2024-04-17T05:26:57.261 INFO:teuthology.orchestra.run.smithi123.stderr:set pool 4 allow_ec_overwrites to true 2024-04-17T05:26:57.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.265+0000 7f2854c00640 1 -- 172.21.15.123:0/570225278 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f282c06c8f0 msgr2=0x7f282c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:57.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.265+0000 7f2854c00640 1 --2- 172.21.15.123:0/570225278 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f282c06c8f0 0x7f282c06edb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f28500b88a0 tx=0x7f2838008040 comp rx=0 tx=0).stop 2024-04-17T05:26:57.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.265+0000 7f2854c00640 1 -- 172.21.15.123:0/570225278 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28500b9b00 msgr2=0x7f2850147ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:57.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.265+0000 7f2854c00640 1 --2- 172.21.15.123:0/570225278 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28500b9b00 0x7f2850147ed0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2840009d90 tx=0x7f2840004a40 comp rx=0 tx=0).stop 2024-04-17T05:26:57.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.265+0000 7f2854c00640 1 -- 172.21.15.123:0/570225278 shutdown_connections 2024-04-17T05:26:57.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.265+0000 7f2854c00640 1 --2- 172.21.15.123:0/570225278 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f282c06c8f0 0x7f282c06edb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:57.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.265+0000 7f2854c00640 1 --2- 172.21.15.123:0/570225278 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2850146070 0x7f28501487a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:57.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.265+0000 7f2854c00640 1 --2- 172.21.15.123:0/570225278 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2850145c10 0x7f285014ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:57.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.265+0000 7f2854c00640 1 --2- 172.21.15.123:0/570225278 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28500b9b00 0x7f2850147ed0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:57.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.265+0000 7f2854c00640 1 -- 172.21.15.123:0/570225278 >> 172.21.15.123:0/570225278 conn(0x7f285006c100 msgr2=0x7f28500b42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:57.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.265+0000 7f2854c00640 1 -- 172.21.15.123:0/570225278 shutdown_connections 2024-04-17T05:26:57.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.265+0000 7f2854c00640 1 -- 172.21.15.123:0/570225278 wait complete. 2024-04-17T05:26:57.303 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-17T05:26:57.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.488+0000 7f30c5000640 1 Processor -- start 2024-04-17T05:26:57.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.488+0000 7f30c5000640 1 -- start start 2024-04-17T05:26:57.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.489+0000 7f30c5000640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f30c0144250 0x7f30c0150680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:57.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.489+0000 7f30c5000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30c009cab0 con 0x7f30c009d410 2024-04-17T05:26:57.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.489+0000 7f30c5000640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30c00ae850 con 0x7f30c009c6d0 2024-04-17T05:26:57.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.489+0000 7f30c5000640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f30c009d930 con 0x7f30c0144250 2024-04-17T05:26:57.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.489+0000 7f30b5400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f30c009d410 0x7f30c0143b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59116/0 (socket says 172.21.15.123:59116) 2024-04-17T05:26:57.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.489+0000 7f30b5400640 1 -- 172.21.15.123:0/4054810684 learned_addr learned my addr 172.21.15.123:0/4054810684 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:26:57.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.490+0000 7f30be800640 1 --2- 172.21.15.123:0/4054810684 >> v2:172.21.15.164:3300/0 conn(0x7f30c0144250 0x7f30c0150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:57.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.490+0000 7f30bd400640 1 -- 172.21.15.123:0/4054810684 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3710160896 0 0) 0x7f30c009cab0 con 0x7f30c009d410 2024-04-17T05:26:57.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.490+0000 7f30bd400640 1 -- 172.21.15.123:0/4054810684 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30a4003520 con 0x7f30c009d410 2024-04-17T05:26:57.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.490+0000 7f30bd400640 1 -- 172.21.15.123:0/4054810684 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3755605510 0 0) 0x7f30a4003520 con 0x7f30c009d410 2024-04-17T05:26:57.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.490+0000 7f30bd400640 1 -- 172.21.15.123:0/4054810684 >> v2:172.21.15.164:3300/0 conn(0x7f30c0144250 msgr2=0x7f30c0150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:57.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.490+0000 7f30bd400640 1 --2- 172.21.15.123:0/4054810684 >> v2:172.21.15.164:3300/0 conn(0x7f30c0144250 0x7f30c0150680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:57.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.490+0000 7f30bd400640 1 -- 172.21.15.123:0/4054810684 >> v1:172.21.15.164:6789/0 conn(0x7f30c009c6d0 legacy=0x7f30c00b53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:57.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.490+0000 7f30bd400640 1 -- 172.21.15.123:0/4054810684 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30c009dc10 con 0x7f30c009d410 2024-04-17T05:26:57.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.490+0000 7f30bd400640 1 -- 172.21.15.123:0/4054810684 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1042962670 0 0) 0x7f30a8001670 con 0x7f30c009d410 2024-04-17T05:26:57.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.490+0000 7f30bd400640 1 -- 172.21.15.123:0/4054810684 >> v1:172.21.15.123:6789/0 conn(0x7f30c009d410 legacy=0x7f30c0143b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:57.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.490+0000 7f30bd400640 1 --2- 172.21.15.123:0/4054810684 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30a40039b0 0x7f30a4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:57.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.490+0000 7f30bd400640 1 --2- 172.21.15.123:0/4054810684 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30a4004800 0x7f30a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:57.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.490+0000 7f30bd400640 1 --2- 172.21.15.123:0/4054810684 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30a40052e0 0x7f30a400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:57.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.490+0000 7f30bd400640 1 -- 172.21.15.123:0/4054810684 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f30c009d930 con 0x7f30a40039b0 2024-04-17T05:26:57.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.490+0000 7f30bd400640 1 -- 172.21.15.123:0/4054810684 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f30a400c1b0 con 0x7f30a4004800 2024-04-17T05:26:57.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.490+0000 7f30bd400640 1 -- 172.21.15.123:0/4054810684 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f30a400c3b0 con 0x7f30a40052e0 2024-04-17T05:26:57.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.490+0000 7f30bde00640 1 --2- 172.21.15.123:0/4054810684 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30a40039b0 0x7f30a4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:57.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.491+0000 7f30b5400640 1 --2- 172.21.15.123:0/4054810684 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30a4004800 0x7f30a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:57.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.491+0000 7f30be800640 1 --2- 172.21.15.123:0/4054810684 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30a40052e0 0x7f30a400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:57.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.491+0000 7f30bde00640 1 -- 172.21.15.123:0/4054810684 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30a40052e0 msgr2=0x7f30a400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:57.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.491+0000 7f30bde00640 1 --2- 172.21.15.123:0/4054810684 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30a40052e0 0x7f30a400b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:57.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.491+0000 7f30bde00640 1 -- 172.21.15.123:0/4054810684 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30a4004800 msgr2=0x7f30a4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:57.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.491+0000 7f30bde00640 1 --2- 172.21.15.123:0/4054810684 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30a4004800 0x7f30a4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:57.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.491+0000 7f30bde00640 1 -- 172.21.15.123:0/4054810684 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a4003520 con 0x7f30a40039b0 2024-04-17T05:26:57.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.491+0000 7f30b5400640 1 --2- 172.21.15.123:0/4054810684 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30a4004800 0x7f30a4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:26:57.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.491+0000 7f30be800640 1 -- 172.21.15.123:0/4054810684 reap_dead start 2024-04-17T05:26:57.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.492+0000 7f30bde00640 1 --2- 172.21.15.123:0/4054810684 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30a40039b0 0x7f30a4003dd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f30b0001e20 tx=0x7f30a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f66836528defba3c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:57.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.492+0000 7f30bd400640 1 -- 172.21.15.123:0/4054810684 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b0001a70 con 0x7f30a40039b0 2024-04-17T05:26:57.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.492+0000 7f30bd400640 1 -- 172.21.15.123:0/4054810684 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b0003b70 con 0x7f30a40039b0 2024-04-17T05:26:57.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.492+0000 7f30bd400640 1 -- 172.21.15.123:0/4054810684 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b00050d0 con 0x7f30a40039b0 2024-04-17T05:26:57.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.493+0000 7f30c5000640 1 -- 172.21.15.123:0/4054810684 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30a40039b0 msgr2=0x7f30a4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:57.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.493+0000 7f30c5000640 1 --2- 172.21.15.123:0/4054810684 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30a40039b0 0x7f30a4003dd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f30b0001e20 tx=0x7f30a4005830 comp rx=0 tx=0).stop 2024-04-17T05:26:57.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.493+0000 7f30c5000640 1 -- 172.21.15.123:0/4054810684 shutdown_connections 2024-04-17T05:26:57.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.493+0000 7f30c5000640 1 --2- 172.21.15.123:0/4054810684 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30a40039b0 0x7f30a4003dd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:57.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.493+0000 7f30c5000640 1 -- 172.21.15.123:0/4054810684 >> 172.21.15.123:0/4054810684 conn(0x7f30c00b93b0 msgr2=0x7f30c00b97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:57.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.493+0000 7f30c5000640 1 -- 172.21.15.123:0/4054810684 shutdown_connections 2024-04-17T05:26:57.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.493+0000 7f30c5000640 1 -- 172.21.15.123:0/4054810684 wait complete. 2024-04-17T05:26:57.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.494+0000 7f30c5000640 1 Processor -- start 2024-04-17T05:26:57.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.495+0000 7f30c5000640 1 -- start start 2024-04-17T05:26:57.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.495+0000 7f30c5000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30a40039b0 0x7f30c01d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:57.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.495+0000 7f30c5000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30c00b0c90 0x7f30c00b1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:57.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.495+0000 7f30c5000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30c00b24e0 0x7f30c01e1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:57.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.495+0000 7f30c5000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f30c0148130 con 0x7f30c00b0c90 2024-04-17T05:26:57.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.495+0000 7f30c5000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f30c00b5bf0 con 0x7f30c00b24e0 2024-04-17T05:26:57.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.495+0000 7f30c5000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f30c01482b0 con 0x7f30a40039b0 2024-04-17T05:26:57.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.496+0000 7f30b5400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30c00b0c90 0x7f30c00b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:57.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.496+0000 7f30b5400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30c00b0c90 0x7f30c00b1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50354/0 (socket says 172.21.15.123:50354) 2024-04-17T05:26:57.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.496+0000 7f30b5400640 1 -- 172.21.15.123:0/2649990328 learned_addr learned my addr 172.21.15.123:0/2649990328 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:26:57.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.496+0000 7f30be800640 1 --2- 172.21.15.123:0/2649990328 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30c00b24e0 0x7f30c01e1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:57.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.496+0000 7f30bde00640 1 --2- 172.21.15.123:0/2649990328 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30a40039b0 0x7f30c01d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:57.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.496+0000 7f30b5400640 1 -- 172.21.15.123:0/2649990328 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30a40039b0 msgr2=0x7f30c01d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:57.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.496+0000 7f30b5400640 1 --2- 172.21.15.123:0/2649990328 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30a40039b0 0x7f30c01d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:57.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.496+0000 7f30b5400640 1 -- 172.21.15.123:0/2649990328 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30c00b24e0 msgr2=0x7f30c01e1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:57.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.496+0000 7f30b5400640 1 --2- 172.21.15.123:0/2649990328 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30c00b24e0 0x7f30c01e1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:57.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.496+0000 7f30b5400640 1 -- 172.21.15.123:0/2649990328 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30c00b18c0 con 0x7f30c00b0c90 2024-04-17T05:26:57.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.496+0000 7f30b5400640 1 --2- 172.21.15.123:0/2649990328 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30c00b0c90 0x7f30c00b1380 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f30a8000ff0 tx=0x7f30a800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:57.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.497+0000 7f30b6a00640 1 -- 172.21.15.123:0/2649990328 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a8019070 con 0x7f30c00b0c90 2024-04-17T05:26:57.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.497+0000 7f30b6a00640 1 -- 172.21.15.123:0/2649990328 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a80072d0 con 0x7f30c00b0c90 2024-04-17T05:26:57.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.497+0000 7f30b6a00640 1 -- 172.21.15.123:0/2649990328 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a80047e0 con 0x7f30c00b0c90 2024-04-17T05:26:57.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.497+0000 7f30c5000640 1 -- 172.21.15.123:0/2649990328 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30c00705b0 con 0x7f30c00b0c90 2024-04-17T05:26:57.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.497+0000 7f30c5000640 1 -- 172.21.15.123:0/2649990328 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30c0070890 con 0x7f30c00b0c90 2024-04-17T05:26:57.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.498+0000 7f30c5000640 1 -- 172.21.15.123:0/2649990328 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30c00b3fb0 con 0x7f30c00b0c90 2024-04-17T05:26:57.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.499+0000 7f30b6a00640 1 -- 172.21.15.123:0/2649990328 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f30a801c070 con 0x7f30c00b0c90 2024-04-17T05:26:57.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.500+0000 7f30b6a00640 1 --2- 172.21.15.123:0/2649990328 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f309c06c920 0x7f309c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:57.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.500+0000 7f30b6a00640 1 -- 172.21.15.123:0/2649990328 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6500+0+0 (secure 0 0 0) 0x7f30a808b750 con 0x7f30c00b0c90 2024-04-17T05:26:57.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.501+0000 7f30bde00640 1 --2- 172.21.15.123:0/2649990328 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f309c06c920 0x7f309c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:57.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.502+0000 7f30bde00640 1 --2- 172.21.15.123:0/2649990328 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f309c06c920 0x7f309c06ede0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f30b0034000 tx=0x7f30b0009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:57.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.504+0000 7f30b6a00640 1 -- 172.21.15.123:0/2649990328 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f30c00b3fb0 con 0x7f30c00b0c90 2024-04-17T05:26:57.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:57.741+0000 7f30c5000640 1 -- 172.21.15.123:0/2649990328 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f30c0068a40 con 0x7f30c00b0c90 2024-04-17T05:26:58.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.264+0000 7f30b6a00640 1 -- 172.21.15.123:0/2649990328 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7f30a8059850 con 0x7f30c00b0c90 2024-04-17T05:26:58.264 INFO:teuthology.orchestra.run.smithi123.stderr:added data pool 4 to fsmap 2024-04-17T05:26:58.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.268+0000 7f30c5000640 1 -- 172.21.15.123:0/2649990328 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f309c06c920 msgr2=0x7f309c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:58.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.268+0000 7f30c5000640 1 --2- 172.21.15.123:0/2649990328 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f309c06c920 0x7f309c06ede0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f30b0034000 tx=0x7f30b0009030 comp rx=0 tx=0).stop 2024-04-17T05:26:58.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.268+0000 7f30c5000640 1 -- 172.21.15.123:0/2649990328 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30c00b0c90 msgr2=0x7f30c00b1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:58.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.268+0000 7f30c5000640 1 --2- 172.21.15.123:0/2649990328 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30c00b0c90 0x7f30c00b1380 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f30a8000ff0 tx=0x7f30a800dc00 comp rx=0 tx=0).stop 2024-04-17T05:26:58.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.268+0000 7f30c5000640 1 -- 172.21.15.123:0/2649990328 shutdown_connections 2024-04-17T05:26:58.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.268+0000 7f30c5000640 1 --2- 172.21.15.123:0/2649990328 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30c00b24e0 0x7f30c01e1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:58.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.268+0000 7f30c5000640 1 --2- 172.21.15.123:0/2649990328 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30c00b0c90 0x7f30c00b1380 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:58.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.268+0000 7f30c5000640 1 --2- 172.21.15.123:0/2649990328 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f309c06c920 0x7f309c06ede0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:58.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.268+0000 7f30c5000640 1 --2- 172.21.15.123:0/2649990328 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f30a40039b0 0x7f30c01d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:58.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.268+0000 7f30c5000640 1 -- 172.21.15.123:0/2649990328 >> 172.21.15.123:0/2649990328 conn(0x7f30c00b93b0 msgr2=0x7f30c0145250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:58.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.268+0000 7f30c5000640 1 -- 172.21.15.123:0/2649990328 shutdown_connections 2024-04-17T05:26:58.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.268+0000 7f30c5000640 1 -- 172.21.15.123:0/2649990328 wait complete. 2024-04-17T05:26:58.291 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T05:26:58.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.493+0000 7fc39be00640 1 Processor -- start 2024-04-17T05:26:58.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.493+0000 7fc39be00640 1 -- start start 2024-04-17T05:26:58.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.493+0000 7fc39be00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc39c0adde0 0x7fc39c148570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:58.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.493+0000 7fc39be00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc39c0b3b50 0x7fc39c152400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:58.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.493+0000 7fc39be00640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc39c0ae1c0 con 0x7fc39c0b5860 2024-04-17T05:26:58.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.493+0000 7fc39be00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc39c142320 con 0x7fc39c0adde0 2024-04-17T05:26:58.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.493+0000 7fc39be00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7fc39c1480e0 con 0x7fc39c0b3b50 2024-04-17T05:26:58.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.494+0000 7fc39aa00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc39c0adde0 0x7fc39c148570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:58.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.494+0000 7fc39aa00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc39c0adde0 0x7fc39c148570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50360/0 (socket says 172.21.15.123:50360) 2024-04-17T05:26:58.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.494+0000 7fc39aa00640 1 -- 172.21.15.123:0/1469747973 learned_addr learned my addr 172.21.15.123:0/1469747973 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:26:58.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.494+0000 7fc39aa00640 1 -- 172.21.15.123:0/1469747973 >> v2:172.21.15.164:3300/0 conn(0x7fc39c0b3b50 msgr2=0x7fc39c152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:58.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.494+0000 7fc39aa00640 1 --2- 172.21.15.123:0/1469747973 >> v2:172.21.15.164:3300/0 conn(0x7fc39c0b3b50 0x7fc39c152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:58.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.494+0000 7fc39aa00640 1 -- 172.21.15.123:0/1469747973 >> v1:172.21.15.164:6789/0 conn(0x7fc39c0b5860 legacy=0x7fc39c0b2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:58.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.494+0000 7fc39aa00640 1 -- 172.21.15.123:0/1469747973 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc39c148ab0 con 0x7fc39c0adde0 2024-04-17T05:26:58.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.495+0000 7fc39aa00640 1 --2- 172.21.15.123:0/1469747973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc39c0adde0 0x7fc39c148570 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc39c06e7b0 tx=0x7fc38c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb178629be9e1e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:58.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.495+0000 7fc39a000640 1 -- 172.21.15.123:0/1469747973 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38c02e070 con 0x7fc39c0adde0 2024-04-17T05:26:58.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.495+0000 7fc39a000640 1 -- 172.21.15.123:0/1469747973 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc38c037070 con 0x7fc39c0adde0 2024-04-17T05:26:58.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.495+0000 7fc39a000640 1 -- 172.21.15.123:0/1469747973 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38c031a00 con 0x7fc39c0adde0 2024-04-17T05:26:58.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.496+0000 7fc39be00640 1 -- 172.21.15.123:0/1469747973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc39c0adde0 msgr2=0x7fc39c148570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:58.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.496+0000 7fc39be00640 1 --2- 172.21.15.123:0/1469747973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc39c0adde0 0x7fc39c148570 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc39c06e7b0 tx=0x7fc38c02b880 comp rx=0 tx=0).stop 2024-04-17T05:26:58.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.496+0000 7fc39be00640 1 -- 172.21.15.123:0/1469747973 shutdown_connections 2024-04-17T05:26:58.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.496+0000 7fc39be00640 1 --2- 172.21.15.123:0/1469747973 >> v2:172.21.15.164:3300/0 conn(0x7fc39c0b3b50 0x7fc39c152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:58.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.496+0000 7fc39be00640 1 --2- 172.21.15.123:0/1469747973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc39c0adde0 0x7fc39c148570 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:58.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.496+0000 7fc39be00640 1 -- 172.21.15.123:0/1469747973 >> 172.21.15.123:0/1469747973 conn(0x7fc39c0b9150 msgr2=0x7fc39c0b9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:58.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.496+0000 7fc39be00640 1 -- 172.21.15.123:0/1469747973 shutdown_connections 2024-04-17T05:26:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.496+0000 7fc39be00640 1 -- 172.21.15.123:0/1469747973 wait complete. 2024-04-17T05:26:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.498+0000 7fc39be00640 1 Processor -- start 2024-04-17T05:26:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.498+0000 7fc39be00640 1 -- start start 2024-04-17T05:26:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.499+0000 7fc39be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc39c0adde0 0x7fc39c1d1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.499+0000 7fc39be00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc39c0b3b50 0x7fc39c1de2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.499+0000 7fc39be00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc39c1d1690 0x7fc39c1de800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.499+0000 7fc39be00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c0ae510 con 0x7fc39c0b3b50 2024-04-17T05:26:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.499+0000 7fc39be00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c0b0650 con 0x7fc39c0adde0 2024-04-17T05:26:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.499+0000 7fc39be00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fc39c0ae690 con 0x7fc39c1d1690 2024-04-17T05:26:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.499+0000 7fc392000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc39c0b3b50 0x7fc39c1de2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.499+0000 7fc392000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc39c0b3b50 0x7fc39c1de2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50364/0 (socket says 172.21.15.123:50364) 2024-04-17T05:26:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.499+0000 7fc392000640 1 -- 172.21.15.123:0/2422595155 learned_addr learned my addr 172.21.15.123:0/2422595155 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:26:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.499+0000 7fc392000640 1 -- 172.21.15.123:0/2422595155 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc39c1d1690 msgr2=0x7fc39c1de800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:58.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.499+0000 7fc392000640 1 --2- 172.21.15.123:0/2422595155 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc39c1d1690 0x7fc39c1de800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:58.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.499+0000 7fc392000640 1 -- 172.21.15.123:0/2422595155 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc39c0adde0 msgr2=0x7fc39c1d1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:58.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.499+0000 7fc39aa00640 1 --2- 172.21.15.123:0/2422595155 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc39c0adde0 0x7fc39c1d1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:58.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.499+0000 7fc392000640 1 --2- 172.21.15.123:0/2422595155 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc39c0adde0 0x7fc39c1d1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:58.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.499+0000 7fc392000640 1 -- 172.21.15.123:0/2422595155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc39c1d2870 con 0x7fc39c0b3b50 2024-04-17T05:26:58.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.500+0000 7fc392000640 1 --2- 172.21.15.123:0/2422595155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc39c0b3b50 0x7fc39c1de2c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc38400b410 tx=0x7fc38400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:58.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.500+0000 7fc393400640 1 -- 172.21.15.123:0/2422595155 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc384015020 con 0x7fc39c0b3b50 2024-04-17T05:26:58.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.500+0000 7fc393400640 1 -- 172.21.15.123:0/2422595155 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc384011830 con 0x7fc39c0b3b50 2024-04-17T05:26:58.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.500+0000 7fc393400640 1 -- 172.21.15.123:0/2422595155 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc384011c20 con 0x7fc39c0b3b50 2024-04-17T05:26:58.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.500+0000 7fc39be00640 1 -- 172.21.15.123:0/2422595155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc39c14b3c0 con 0x7fc39c0b3b50 2024-04-17T05:26:58.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.500+0000 7fc39be00640 1 -- 172.21.15.123:0/2422595155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc39c1e17c0 con 0x7fc39c0b3b50 2024-04-17T05:26:58.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.501+0000 7fc39be00640 1 -- 172.21.15.123:0/2422595155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc39c14aca0 con 0x7fc39c0b3b50 2024-04-17T05:26:58.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.502+0000 7fc393400640 1 -- 172.21.15.123:0/2422595155 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc384018020 con 0x7fc39c0b3b50 2024-04-17T05:26:58.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.503+0000 7fc393400640 1 --2- 172.21.15.123:0/2422595155 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc37806c8f0 0x7fc37806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:58.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.503+0000 7fc393400640 1 -- 172.21.15.123:0/2422595155 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc38408bd20 con 0x7fc39c0b3b50 2024-04-17T05:26:58.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.504+0000 7fc39aa00640 1 --2- 172.21.15.123:0/2422595155 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc37806c8f0 0x7fc37806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:58.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.505+0000 7fc39aa00640 1 --2- 172.21.15.123:0/2422595155 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc37806c8f0 0x7fc37806edb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc38c036000 tx=0x7fc38c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:58.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.508+0000 7fc393400640 1 -- 172.21.15.123:0/2422595155 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fc38401f020 con 0x7fc39c0b3b50 2024-04-17T05:26:58.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.744+0000 7fc39be00640 1 -- 172.21.15.123:0/2422595155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc39c0ba080 con 0x7fc39c0b3b50 2024-04-17T05:26:58.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.745+0000 7fc393400640 1 -- 172.21.15.123:0/2422595155 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+3550 (secure 0 0 0) 0x7fc39c0ba080 con 0x7fc39c0b3b50 2024-04-17T05:26:58.744 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:26:58.745 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/515699398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":515699398},{"type":"v1","addr":"172.21.15.123:6833","nonce":515699398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T05:26:52.642446+0000","modified":"2024-04-17T05:26:57.743724+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4243},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4243":{"gid":4243,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/1946746019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1946746019},{"type":"v1","addr":"172.21.15.164:6835","nonce":1946746019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4243,"qdb_cluster":[4243]},"id":1}]} 2024-04-17T05:26:58.745 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 7 2024-04-17T05:26:58.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.747+0000 7fc39be00640 1 -- 172.21.15.123:0/2422595155 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc37806c8f0 msgr2=0x7fc37806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:58.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.747+0000 7fc39be00640 1 --2- 172.21.15.123:0/2422595155 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc37806c8f0 0x7fc37806edb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc38c036000 tx=0x7fc38c008030 comp rx=0 tx=0).stop 2024-04-17T05:26:58.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.747+0000 7fc39be00640 1 -- 172.21.15.123:0/2422595155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc39c0b3b50 msgr2=0x7fc39c1de2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:58.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.747+0000 7fc39be00640 1 --2- 172.21.15.123:0/2422595155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc39c0b3b50 0x7fc39c1de2c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc38400b410 tx=0x7fc38400b8d0 comp rx=0 tx=0).stop 2024-04-17T05:26:58.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.748+0000 7fc39be00640 1 -- 172.21.15.123:0/2422595155 shutdown_connections 2024-04-17T05:26:58.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.748+0000 7fc39be00640 1 --2- 172.21.15.123:0/2422595155 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc37806c8f0 0x7fc37806edb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:58.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.748+0000 7fc39be00640 1 --2- 172.21.15.123:0/2422595155 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc39c1d1690 0x7fc39c1de800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:58.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.748+0000 7fc39be00640 1 --2- 172.21.15.123:0/2422595155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc39c0b3b50 0x7fc39c1de2c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:58.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.748+0000 7fc39be00640 1 --2- 172.21.15.123:0/2422595155 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc39c0adde0 0x7fc39c1d1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:58.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.748+0000 7fc39be00640 1 -- 172.21.15.123:0/2422595155 >> 172.21.15.123:0/2422595155 conn(0x7fc39c0b9150 msgr2=0x7fc39c0b6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:58.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.748+0000 7fc39be00640 1 -- 172.21.15.123:0/2422595155 shutdown_connections 2024-04-17T05:26:58.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.748+0000 7fc39be00640 1 -- 172.21.15.123:0/2422595155 wait complete. 2024-04-17T05:26:58.763 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T05:26:58.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.968+0000 7f4fcb000640 1 Processor -- start 2024-04-17T05:26:58.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.968+0000 7f4fcb000640 1 -- start start 2024-04-17T05:26:58.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.968+0000 7f4fcb000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4fc40ba6a0 0x7f4fc40b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:58.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.968+0000 7f4fcb000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4fc4141a00 0x7f4fc4141e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:58.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.968+0000 7f4fcb000640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fc4148240 con 0x7f4fc40b9a80 2024-04-17T05:26:58.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.968+0000 7f4fcb000640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f4fc40b5e10 con 0x7f4fc4141a00 2024-04-17T05:26:58.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.968+0000 7f4fcb000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f4fc40b71d0 con 0x7f4fc40ba6a0 2024-04-17T05:26:58.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.969+0000 7f4fca600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4fc4141a00 0x7f4fc4141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:58.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.969+0000 7f4fca600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4fc4141a00 0x7f4fc4141e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50370/0 (socket says 172.21.15.123:50370) 2024-04-17T05:26:58.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.969+0000 7f4fca600640 1 -- 172.21.15.123:0/2170411764 learned_addr learned my addr 172.21.15.123:0/2170411764 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:26:58.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.969+0000 7f4fca600640 1 -- 172.21.15.123:0/2170411764 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4fc40ba6a0 msgr2=0x7f4fc40b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:58.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.969+0000 7f4fca600640 1 --2- 172.21.15.123:0/2170411764 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4fc40ba6a0 0x7f4fc40b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:58.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.969+0000 7f4fca600640 1 -- 172.21.15.123:0/2170411764 >> v1:172.21.15.164:6789/0 conn(0x7f4fc40b9a80 legacy=0x7f4fc4147b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:58.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.969+0000 7f4fca600640 1 -- 172.21.15.123:0/2170411764 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc40b57e0 con 0x7f4fc4141a00 2024-04-17T05:26:58.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.970+0000 7f4fca600640 1 --2- 172.21.15.123:0/2170411764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4fc4141a00 0x7f4fc4141e90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc009e50 tx=0x7f4fbc02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd73639ccf57f87f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:58.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.970+0000 7f4fc3e00640 1 -- 172.21.15.123:0/2170411764 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc02c9e0 con 0x7f4fc4141a00 2024-04-17T05:26:58.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.971+0000 7f4fc3e00640 1 -- 172.21.15.123:0/2170411764 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fbc02cb80 con 0x7f4fc4141a00 2024-04-17T05:26:58.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.971+0000 7f4fc3e00640 1 -- 172.21.15.123:0/2170411764 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc0343f0 con 0x7f4fc4141a00 2024-04-17T05:26:58.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.971+0000 7f4fcb000640 1 -- 172.21.15.123:0/2170411764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4fc4141a00 msgr2=0x7f4fc4141e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:58.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.971+0000 7f4fcb000640 1 --2- 172.21.15.123:0/2170411764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4fc4141a00 0x7f4fc4141e90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc009e50 tx=0x7f4fbc02be40 comp rx=0 tx=0).stop 2024-04-17T05:26:58.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.971+0000 7f4fcb000640 1 -- 172.21.15.123:0/2170411764 shutdown_connections 2024-04-17T05:26:58.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.971+0000 7f4fcb000640 1 --2- 172.21.15.123:0/2170411764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4fc4141a00 0x7f4fc4141e90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:58.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.971+0000 7f4fcb000640 1 --2- 172.21.15.123:0/2170411764 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4fc40ba6a0 0x7f4fc40b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:58.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.971+0000 7f4fcb000640 1 -- 172.21.15.123:0/2170411764 >> 172.21.15.123:0/2170411764 conn(0x7f4fc406bda0 msgr2=0x7f4fc406c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:58.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.971+0000 7f4fcb000640 1 -- 172.21.15.123:0/2170411764 shutdown_connections 2024-04-17T05:26:58.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.972+0000 7f4fcb000640 1 -- 172.21.15.123:0/2170411764 wait complete. 2024-04-17T05:26:58.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.973+0000 7f4fcb000640 1 Processor -- start 2024-04-17T05:26:58.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.973+0000 7f4fcb000640 1 -- start start 2024-04-17T05:26:58.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.974+0000 7f4fcb000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4fc40b9a80 0x7f4fc4144800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:58.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.974+0000 7f4fcb000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4fc40ba6a0 0x7f4fc41432b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:58.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.974+0000 7f4fcb000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4fc4141a00 0x7f4fc41437f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:58.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.974+0000 7f4fcb000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc40b62a0 con 0x7f4fc40b9a80 2024-04-17T05:26:58.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.974+0000 7f4fcb000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc40b5a80 con 0x7f4fc40ba6a0 2024-04-17T05:26:58.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.974+0000 7f4fcb000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f4fc40b6420 con 0x7f4fc4141a00 2024-04-17T05:26:58.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.974+0000 7f4fc9c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4fc40b9a80 0x7f4fc4144800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:58.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.974+0000 7f4fc9c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4fc40b9a80 0x7f4fc4144800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50382/0 (socket says 172.21.15.123:50382) 2024-04-17T05:26:58.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.974+0000 7f4fc9c00640 1 -- 172.21.15.123:0/1930653490 learned_addr learned my addr 172.21.15.123:0/1930653490 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:26:58.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.975+0000 7f4fc9200640 1 --2- 172.21.15.123:0/1930653490 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4fc40ba6a0 0x7f4fc41432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:58.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.975+0000 7f4fca600640 1 --2- 172.21.15.123:0/1930653490 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4fc4141a00 0x7f4fc41437f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:58.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.975+0000 7f4fc9c00640 1 -- 172.21.15.123:0/1930653490 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4fc4141a00 msgr2=0x7f4fc41437f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:58.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.975+0000 7f4fc9c00640 1 --2- 172.21.15.123:0/1930653490 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4fc4141a00 0x7f4fc41437f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:58.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.975+0000 7f4fc9c00640 1 -- 172.21.15.123:0/1930653490 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4fc40ba6a0 msgr2=0x7f4fc41432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:58.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.975+0000 7f4fc9c00640 1 --2- 172.21.15.123:0/1930653490 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4fc40ba6a0 0x7f4fc41432b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:58.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.975+0000 7f4fc9c00640 1 -- 172.21.15.123:0/1930653490 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc4142660 con 0x7f4fc40b9a80 2024-04-17T05:26:58.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.975+0000 7f4fc9200640 1 --2- 172.21.15.123:0/1930653490 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4fc40ba6a0 0x7f4fc41432b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:26:58.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.975+0000 7f4fc9c00640 1 --2- 172.21.15.123:0/1930653490 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4fc40b9a80 0x7f4fc4144800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4fb800b4d0 tx=0x7f4fb800b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:58.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.975+0000 7f4fc1600640 1 -- 172.21.15.123:0/1930653490 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb8014070 con 0x7f4fc40b9a80 2024-04-17T05:26:58.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.975+0000 7f4fc1600640 1 -- 172.21.15.123:0/1930653490 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fb8010610 con 0x7f4fc40b9a80 2024-04-17T05:26:58.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.975+0000 7f4fcb000640 1 -- 172.21.15.123:0/1930653490 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fc41de070 con 0x7f4fc40b9a80 2024-04-17T05:26:58.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.975+0000 7f4fc1600640 1 -- 172.21.15.123:0/1930653490 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb8010a00 con 0x7f4fc40b9a80 2024-04-17T05:26:58.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.975+0000 7f4fcb000640 1 -- 172.21.15.123:0/1930653490 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fc41ce2a0 con 0x7f4fc40b9a80 2024-04-17T05:26:58.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.977+0000 7f4fcb000640 1 -- 172.21.15.123:0/1930653490 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fc40759b0 con 0x7f4fc40b9a80 2024-04-17T05:26:58.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.978+0000 7f4fc1600640 1 -- 172.21.15.123:0/1930653490 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4fb8017070 con 0x7f4fc40b9a80 2024-04-17T05:26:58.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.978+0000 7f4fc1600640 1 --2- 172.21.15.123:0/1930653490 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f4fa406c8f0 0x7f4fa406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:58.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.979+0000 7f4fc1600640 1 -- 172.21.15.123:0/1930653490 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f4fb808b880 con 0x7f4fc40b9a80 2024-04-17T05:26:58.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.979+0000 7f4fc9200640 1 --2- 172.21.15.123:0/1930653490 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f4fa406c8f0 0x7f4fa406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:58.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.980+0000 7f4fc9200640 1 --2- 172.21.15.123:0/1930653490 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f4fa406c8f0 0x7f4fa406edb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4fb0007fd0 tx=0x7f4fb0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:58.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:58.983+0000 7f4fc1600640 1 -- 172.21.15.123:0/1930653490 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f4fb8059a00 con 0x7f4fc40b9a80 2024-04-17T05:26:59.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.169+0000 7f4fcb000640 1 -- 172.21.15.123:0/1930653490 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4fc40b4b00 con 0x7f4fc40b9a80 2024-04-17T05:26:59.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.174+0000 7f4fc1600640 1 -- 172.21.15.123:0/1930653490 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18526 (secure 0 0 0) 0x7f4fb8059300 con 0x7f4fc40b9a80 2024-04-17T05:26:59.172 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:26:59.172 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":26,"fsid":"0787c5c0-e77a-4102-a899-30db48b19c68","created":"2024-04-17T05:26:33.031507+0000","modified":"2024-04-17T05:26:57.743352+0000","last_up_change":"2024-04-17T05:26:44.988433+0000","last_in_change":"2024-04-17T05:26:36.682131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T05:26:46.329778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T05:26:50.600195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T05:26:51.626498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T05:26:55.264044+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15c87cdb-9415-45a6-a2a6-ea6bec9daece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6801","nonce":840753170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6803","nonce":840753170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6807","nonce":840753170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6805","nonce":840753170}]},"public_addr":"172.21.15.123:6801/840753170","cluster_addr":"172.21.15.123:6803/840753170","heartbeat_back_addr":"172.21.15.123:6807/840753170","heartbeat_front_addr":"172.21.15.123:6805/840753170","state":["exists","up"]},{"osd":1,"uuid":"281751b5-486d-4845-b4aa-b308bf7cec62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6822","nonce":2231878927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6827","nonce":2231878927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6831","nonce":2231878927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6829","nonce":2231878927}]},"public_addr":"172.21.15.123:6822/2231878927","cluster_addr":"172.21.15.123:6827/2231878927","heartbeat_back_addr":"172.21.15.123:6831/2231878927","heartbeat_front_addr":"172.21.15.123:6829/2231878927","state":["exists","up"]},{"osd":2,"uuid":"b42257d3-bd20-4db5-aa37-1bf5c512d0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6817","nonce":754360844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6820","nonce":754360844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6825","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6826","nonce":754360844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6823","nonce":754360844}]},"public_addr":"172.21.15.123:6817/754360844","cluster_addr":"172.21.15.123:6820/754360844","heartbeat_back_addr":"172.21.15.123:6826/754360844","heartbeat_front_addr":"172.21.15.123:6823/754360844","state":["exists","up"]},{"osd":3,"uuid":"0f26b891-bbe6-478e-8dee-78e69bb48cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6809","nonce":2898088574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6811","nonce":2898088574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6815","nonce":2898088574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6813","nonce":2898088574}]},"public_addr":"172.21.15.123:6809/2898088574","cluster_addr":"172.21.15.123:6811/2898088574","heartbeat_back_addr":"172.21.15.123:6815/2898088574","heartbeat_front_addr":"172.21.15.123:6813/2898088574","state":["exists","up"]},{"osd":4,"uuid":"43e59318-2740-4625-9d64-eec1fd43c322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6801","nonce":606484349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6804","nonce":606484349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6812","nonce":606484349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6808","nonce":606484349}]},"public_addr":"172.21.15.164:6801/606484349","cluster_addr":"172.21.15.164:6804/606484349","heartbeat_back_addr":"172.21.15.164:6812/606484349","heartbeat_front_addr":"172.21.15.164:6808/606484349","state":["exists","up"]},{"osd":5,"uuid":"aaa3acf4-4adc-4337-aba3-363851d35310","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6805","nonce":1376989593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6809","nonce":1376989593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6815","nonce":1376989593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6813","nonce":1376989593}]},"public_addr":"172.21.15.164:6805/1376989593","cluster_addr":"172.21.15.164:6809/1376989593","heartbeat_back_addr":"172.21.15.164:6815/1376989593","heartbeat_front_addr":"172.21.15.164:6813/1376989593","state":["exists","up"]},{"osd":6,"uuid":"6f765b27-7377-4d81-9192-23a965651145","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6817","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6821","nonce":1594306924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6823","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6826","nonce":1594306924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6831","nonce":1594306924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6829","nonce":1594306924}]},"public_addr":"172.21.15.164:6821/1594306924","cluster_addr":"172.21.15.164:6826/1594306924","heartbeat_back_addr":"172.21.15.164:6831/1594306924","heartbeat_front_addr":"172.21.15.164:6829/1594306924","state":["exists","up"]},{"osd":7,"uuid":"5547394b-ec2f-4311-846d-369af4b1acf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6818","nonce":295402697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6819","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6820","nonce":295402697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6825","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6827","nonce":295402697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6824","nonce":295402697}]},"public_addr":"172.21.15.164:6818/295402697","cluster_addr":"172.21.15.164:6820/295402697","heartbeat_back_addr":"172.21.15.164:6827/295402697","heartbeat_front_addr":"172.21.15.164:6824/295402697","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.034807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.022201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.751897+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.850533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.083608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.047524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.314753+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.413586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T05:26:59.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.175+0000 7f4fcb000640 1 -- 172.21.15.123:0/1930653490 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f4fa406c8f0 msgr2=0x7f4fa406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:59.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.175+0000 7f4fcb000640 1 --2- 172.21.15.123:0/1930653490 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f4fa406c8f0 0x7f4fa406edb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4fb0007fd0 tx=0x7f4fb0009040 comp rx=0 tx=0).stop 2024-04-17T05:26:59.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.175+0000 7f4fcb000640 1 -- 172.21.15.123:0/1930653490 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4fc40b9a80 msgr2=0x7f4fc4144800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:59.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.175+0000 7f4fcb000640 1 --2- 172.21.15.123:0/1930653490 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4fc40b9a80 0x7f4fc4144800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4fb800b4d0 tx=0x7f4fb800b990 comp rx=0 tx=0).stop 2024-04-17T05:26:59.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.175+0000 7f4fcb000640 1 -- 172.21.15.123:0/1930653490 shutdown_connections 2024-04-17T05:26:59.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.175+0000 7f4fcb000640 1 --2- 172.21.15.123:0/1930653490 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f4fa406c8f0 0x7f4fa406edb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:59.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.175+0000 7f4fcb000640 1 --2- 172.21.15.123:0/1930653490 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4fc4141a00 0x7f4fc41437f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:59.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.175+0000 7f4fcb000640 1 --2- 172.21.15.123:0/1930653490 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4fc40ba6a0 0x7f4fc41432b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:59.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.175+0000 7f4fcb000640 1 --2- 172.21.15.123:0/1930653490 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4fc40b9a80 0x7f4fc4144800 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:59.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.175+0000 7f4fcb000640 1 -- 172.21.15.123:0/1930653490 >> 172.21.15.123:0/1930653490 conn(0x7f4fc406bda0 msgr2=0x7f4fc40b85c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:59.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.175+0000 7f4fcb000640 1 -- 172.21.15.123:0/1930653490 shutdown_connections 2024-04-17T05:26:59.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.175+0000 7f4fcb000640 1 -- 172.21.15.123:0/1930653490 wait complete. 2024-04-17T05:26:59.193 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T05:26:59.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.396+0000 7fb571400640 1 Processor -- start 2024-04-17T05:26:59.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.396+0000 7fb571400640 1 -- start start 2024-04-17T05:26:59.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.397+0000 7fb571400640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fb56c09d410 0x7fb56c143b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:59.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.397+0000 7fb571400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb56c144080 0x7fb56c1444f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:59.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.397+0000 7fb571400640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb56c09cab0 con 0x7fb56c09c6d0 2024-04-17T05:26:59.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.397+0000 7fb571400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb56c0ae850 con 0x7fb56c144080 2024-04-17T05:26:59.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.397+0000 7fb571400640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7fb56c09d930 con 0x7fb56c09d410 2024-04-17T05:26:59.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.397+0000 7fb56b200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb56c144080 0x7fb56c1444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:59.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.397+0000 7fb56b200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb56c144080 0x7fb56c1444f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50390/0 (socket says 172.21.15.123:50390) 2024-04-17T05:26:59.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.397+0000 7fb56b200640 1 -- 172.21.15.123:0/3179296638 learned_addr learned my addr 172.21.15.123:0/3179296638 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:26:59.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.398+0000 7fb569e00640 1 --2- 172.21.15.123:0/3179296638 >> v2:172.21.15.164:3300/0 conn(0x7fb56c09d410 0x7fb56c143b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:59.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.398+0000 7fb56b200640 1 -- 172.21.15.123:0/3179296638 >> v2:172.21.15.164:3300/0 conn(0x7fb56c09d410 msgr2=0x7fb56c143b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:59.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.398+0000 7fb56b200640 1 --2- 172.21.15.123:0/3179296638 >> v2:172.21.15.164:3300/0 conn(0x7fb56c09d410 0x7fb56c143b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:59.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.398+0000 7fb56b200640 1 -- 172.21.15.123:0/3179296638 >> v1:172.21.15.164:6789/0 conn(0x7fb56c09c6d0 legacy=0x7fb56c0b53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:59.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.398+0000 7fb56b200640 1 -- 172.21.15.123:0/3179296638 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb56c09dc10 con 0x7fb56c144080 2024-04-17T05:26:59.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.399+0000 7fb56b200640 1 --2- 172.21.15.123:0/3179296638 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb56c144080 0x7fb56c1444f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb56c09ce80 tx=0x7fb56402bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=210d9b35045ba186 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:59.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.399+0000 7fb569400640 1 -- 172.21.15.123:0/3179296638 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56402c960 con 0x7fb56c144080 2024-04-17T05:26:59.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.399+0000 7fb569400640 1 -- 172.21.15.123:0/3179296638 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb56402cb00 con 0x7fb56c144080 2024-04-17T05:26:59.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.399+0000 7fb569400640 1 -- 172.21.15.123:0/3179296638 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5640343f0 con 0x7fb56c144080 2024-04-17T05:26:59.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.400+0000 7fb571400640 1 -- 172.21.15.123:0/3179296638 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb56c144080 msgr2=0x7fb56c1444f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:59.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.400+0000 7fb571400640 1 --2- 172.21.15.123:0/3179296638 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb56c144080 0x7fb56c1444f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb56c09ce80 tx=0x7fb56402bdc0 comp rx=0 tx=0).stop 2024-04-17T05:26:59.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.400+0000 7fb571400640 1 -- 172.21.15.123:0/3179296638 shutdown_connections 2024-04-17T05:26:59.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.400+0000 7fb571400640 1 --2- 172.21.15.123:0/3179296638 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb56c144080 0x7fb56c1444f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:59.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.400+0000 7fb571400640 1 --2- 172.21.15.123:0/3179296638 >> v2:172.21.15.164:3300/0 conn(0x7fb56c09d410 0x7fb56c143b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:59.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.400+0000 7fb571400640 1 -- 172.21.15.123:0/3179296638 >> 172.21.15.123:0/3179296638 conn(0x7fb56c0b93b0 msgr2=0x7fb56c0b97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:59.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.400+0000 7fb571400640 1 -- 172.21.15.123:0/3179296638 shutdown_connections 2024-04-17T05:26:59.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.400+0000 7fb571400640 1 -- 172.21.15.123:0/3179296638 wait complete. 2024-04-17T05:26:59.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.401+0000 7fb571400640 1 Processor -- start 2024-04-17T05:26:59.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.401+0000 7fb571400640 1 -- start start 2024-04-17T05:26:59.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.402+0000 7fb571400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb56c09c6d0 0x7fb56c0b8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:59.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.402+0000 7fb571400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb56c09d410 0x7fb56c141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:59.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.402+0000 7fb571400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb56c144080 0x7fb56c0b7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:59.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.402+0000 7fb571400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb56c148130 con 0x7fb56c09c6d0 2024-04-17T05:26:59.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.402+0000 7fb571400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb56c0b5bf0 con 0x7fb56c09d410 2024-04-17T05:26:59.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.402+0000 7fb571400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fb56c1482b0 con 0x7fb56c144080 2024-04-17T05:26:59.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.402+0000 7fb56a800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb56c09c6d0 0x7fb56c0b8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:59.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.403+0000 7fb56a800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb56c09c6d0 0x7fb56c0b8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50394/0 (socket says 172.21.15.123:50394) 2024-04-17T05:26:59.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.403+0000 7fb56a800640 1 -- 172.21.15.123:0/2572507984 learned_addr learned my addr 172.21.15.123:0/2572507984 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:26:59.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.403+0000 7fb569e00640 1 --2- 172.21.15.123:0/2572507984 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb56c09d410 0x7fb56c141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:59.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.403+0000 7fb56a800640 1 -- 172.21.15.123:0/2572507984 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb56c144080 msgr2=0x7fb56c0b7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:59.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.403+0000 7fb56a800640 1 --2- 172.21.15.123:0/2572507984 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb56c144080 0x7fb56c0b7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:59.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.403+0000 7fb56a800640 1 -- 172.21.15.123:0/2572507984 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb56c09d410 msgr2=0x7fb56c141fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:59.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.403+0000 7fb56a800640 1 --2- 172.21.15.123:0/2572507984 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb56c09d410 0x7fb56c141fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:59.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.403+0000 7fb56a800640 1 -- 172.21.15.123:0/2572507984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb56c0b81e0 con 0x7fb56c09c6d0 2024-04-17T05:26:59.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.403+0000 7fb56a800640 1 --2- 172.21.15.123:0/2572507984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb56c09c6d0 0x7fb56c0b8c50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb55c00c410 tx=0x7fb55c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:59.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.403+0000 7fb562a00640 1 -- 172.21.15.123:0/2572507984 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55c017070 con 0x7fb56c09c6d0 2024-04-17T05:26:59.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.403+0000 7fb562a00640 1 -- 172.21.15.123:0/2572507984 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb55c0035f0 con 0x7fb56c09c6d0 2024-04-17T05:26:59.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.403+0000 7fb571400640 1 -- 172.21.15.123:0/2572507984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb56c142500 con 0x7fb56c09c6d0 2024-04-17T05:26:59.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.403+0000 7fb562a00640 1 -- 172.21.15.123:0/2572507984 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55c0039e0 con 0x7fb56c09c6d0 2024-04-17T05:26:59.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.403+0000 7fb571400640 1 -- 172.21.15.123:0/2572507984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb56c0b7b20 con 0x7fb56c09c6d0 2024-04-17T05:26:59.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.405+0000 7fb571400640 1 -- 172.21.15.123:0/2572507984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb56c068a40 con 0x7fb56c09c6d0 2024-04-17T05:26:59.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.405+0000 7fb562a00640 1 -- 172.21.15.123:0/2572507984 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb55c01a070 con 0x7fb56c09c6d0 2024-04-17T05:26:59.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.406+0000 7fb562a00640 1 --2- 172.21.15.123:0/2572507984 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fb54c06c8f0 0x7fb54c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:59.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.406+0000 7fb562a00640 1 -- 172.21.15.123:0/2572507984 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb55c08b320 con 0x7fb56c09c6d0 2024-04-17T05:26:59.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.407+0000 7fb569e00640 1 --2- 172.21.15.123:0/2572507984 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fb54c06c8f0 0x7fb54c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:59.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.408+0000 7fb569e00640 1 --2- 172.21.15.123:0/2572507984 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fb54c06c8f0 0x7fb54c06edb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb56c0b38e0 tx=0x7fb558008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:59.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.411+0000 7fb562a00640 1 -- 172.21.15.123:0/2572507984 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fb55c059400 con 0x7fb56c09c6d0 2024-04-17T05:26:59.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.615+0000 7fb571400640 1 -- 172.21.15.123:0/2572507984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb56c06e100 con 0x7fb56c09c6d0 2024-04-17T05:26:59.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.617+0000 7fb562a00640 1 -- 172.21.15.123:0/2572507984 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18526 (secure 0 0 0) 0x7fb55c0010c0 con 0x7fb56c09c6d0 2024-04-17T05:26:59.615 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:26:59.615 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":26,"fsid":"0787c5c0-e77a-4102-a899-30db48b19c68","created":"2024-04-17T05:26:33.031507+0000","modified":"2024-04-17T05:26:57.743352+0000","last_up_change":"2024-04-17T05:26:44.988433+0000","last_in_change":"2024-04-17T05:26:36.682131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T05:26:46.329778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T05:26:50.600195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T05:26:51.626498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T05:26:55.264044+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15c87cdb-9415-45a6-a2a6-ea6bec9daece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6801","nonce":840753170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6803","nonce":840753170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6807","nonce":840753170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6805","nonce":840753170}]},"public_addr":"172.21.15.123:6801/840753170","cluster_addr":"172.21.15.123:6803/840753170","heartbeat_back_addr":"172.21.15.123:6807/840753170","heartbeat_front_addr":"172.21.15.123:6805/840753170","state":["exists","up"]},{"osd":1,"uuid":"281751b5-486d-4845-b4aa-b308bf7cec62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6822","nonce":2231878927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6827","nonce":2231878927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6831","nonce":2231878927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6829","nonce":2231878927}]},"public_addr":"172.21.15.123:6822/2231878927","cluster_addr":"172.21.15.123:6827/2231878927","heartbeat_back_addr":"172.21.15.123:6831/2231878927","heartbeat_front_addr":"172.21.15.123:6829/2231878927","state":["exists","up"]},{"osd":2,"uuid":"b42257d3-bd20-4db5-aa37-1bf5c512d0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6817","nonce":754360844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6820","nonce":754360844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6825","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6826","nonce":754360844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6823","nonce":754360844}]},"public_addr":"172.21.15.123:6817/754360844","cluster_addr":"172.21.15.123:6820/754360844","heartbeat_back_addr":"172.21.15.123:6826/754360844","heartbeat_front_addr":"172.21.15.123:6823/754360844","state":["exists","up"]},{"osd":3,"uuid":"0f26b891-bbe6-478e-8dee-78e69bb48cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6809","nonce":2898088574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6811","nonce":2898088574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6815","nonce":2898088574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6813","nonce":2898088574}]},"public_addr":"172.21.15.123:6809/2898088574","cluster_addr":"172.21.15.123:6811/2898088574","heartbeat_back_addr":"172.21.15.123:6815/2898088574","heartbeat_front_addr":"172.21.15.123:6813/2898088574","state":["exists","up"]},{"osd":4,"uuid":"43e59318-2740-4625-9d64-eec1fd43c322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6801","nonce":606484349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6804","nonce":606484349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6812","nonce":606484349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6808","nonce":606484349}]},"public_addr":"172.21.15.164:6801/606484349","cluster_addr":"172.21.15.164:6804/606484349","heartbeat_back_addr":"172.21.15.164:6812/606484349","heartbeat_front_addr":"172.21.15.164:6808/606484349","state":["exists","up"]},{"osd":5,"uuid":"aaa3acf4-4adc-4337-aba3-363851d35310","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6805","nonce":1376989593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6809","nonce":1376989593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6815","nonce":1376989593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6813","nonce":1376989593}]},"public_addr":"172.21.15.164:6805/1376989593","cluster_addr":"172.21.15.164:6809/1376989593","heartbeat_back_addr":"172.21.15.164:6815/1376989593","heartbeat_front_addr":"172.21.15.164:6813/1376989593","state":["exists","up"]},{"osd":6,"uuid":"6f765b27-7377-4d81-9192-23a965651145","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6817","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6821","nonce":1594306924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6823","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6826","nonce":1594306924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6831","nonce":1594306924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6829","nonce":1594306924}]},"public_addr":"172.21.15.164:6821/1594306924","cluster_addr":"172.21.15.164:6826/1594306924","heartbeat_back_addr":"172.21.15.164:6831/1594306924","heartbeat_front_addr":"172.21.15.164:6829/1594306924","state":["exists","up"]},{"osd":7,"uuid":"5547394b-ec2f-4311-846d-369af4b1acf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6818","nonce":295402697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6819","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6820","nonce":295402697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6825","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6827","nonce":295402697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6824","nonce":295402697}]},"public_addr":"172.21.15.164:6818/295402697","cluster_addr":"172.21.15.164:6820/295402697","heartbeat_back_addr":"172.21.15.164:6827/295402697","heartbeat_front_addr":"172.21.15.164:6824/295402697","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.034807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.022201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.751897+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.850533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.083608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.047524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.314753+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.413586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T05:26:59.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.619+0000 7fb571400640 1 -- 172.21.15.123:0/2572507984 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fb54c06c8f0 msgr2=0x7fb54c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:59.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.619+0000 7fb571400640 1 --2- 172.21.15.123:0/2572507984 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fb54c06c8f0 0x7fb54c06edb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb56c0b38e0 tx=0x7fb558008040 comp rx=0 tx=0).stop 2024-04-17T05:26:59.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.619+0000 7fb571400640 1 -- 172.21.15.123:0/2572507984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb56c09c6d0 msgr2=0x7fb56c0b8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:59.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.619+0000 7fb571400640 1 --2- 172.21.15.123:0/2572507984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb56c09c6d0 0x7fb56c0b8c50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb55c00c410 tx=0x7fb55c00c8d0 comp rx=0 tx=0).stop 2024-04-17T05:26:59.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.619+0000 7fb571400640 1 -- 172.21.15.123:0/2572507984 shutdown_connections 2024-04-17T05:26:59.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.619+0000 7fb571400640 1 --2- 172.21.15.123:0/2572507984 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fb54c06c8f0 0x7fb54c06edb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:59.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.619+0000 7fb571400640 1 --2- 172.21.15.123:0/2572507984 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb56c144080 0x7fb56c0b7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:59.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.619+0000 7fb571400640 1 --2- 172.21.15.123:0/2572507984 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb56c09d410 0x7fb56c141fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:59.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.619+0000 7fb571400640 1 --2- 172.21.15.123:0/2572507984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb56c09c6d0 0x7fb56c0b8c50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:59.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.619+0000 7fb571400640 1 -- 172.21.15.123:0/2572507984 >> 172.21.15.123:0/2572507984 conn(0x7fb56c0b93b0 msgr2=0x7fb56c0af050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:59.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.620+0000 7fb571400640 1 -- 172.21.15.123:0/2572507984 shutdown_connections 2024-04-17T05:26:59.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.620+0000 7fb571400640 1 -- 172.21.15.123:0/2572507984 wait complete. 2024-04-17T05:26:59.651 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T05:26:59.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.860+0000 7f233cc00640 1 Processor -- start 2024-04-17T05:26:59.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.860+0000 7f233cc00640 1 -- start start 2024-04-17T05:26:59.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.861+0000 7f233cc00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f23380b2ad0 0x7f2338148de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:59.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.861+0000 7f233cc00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2338070940 0x7f2338149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:59.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.861+0000 7f233cc00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23380b2eb0 con 0x7f233813f1f0 2024-04-17T05:26:59.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.861+0000 7f233cc00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f2338071cf0 con 0x7f23380b2ad0 2024-04-17T05:26:59.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.861+0000 7f233cc00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f23380b4fa0 con 0x7f2338070940 2024-04-17T05:26:59.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.861+0000 7f2337e00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f233813f1f0 0x7f233813f680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59118/0 (socket says 172.21.15.123:59118) 2024-04-17T05:26:59.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.861+0000 7f2337e00640 1 -- 172.21.15.123:0/3334994944 learned_addr learned my addr 172.21.15.123:0/3334994944 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:26:59.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.862+0000 7f2337400640 1 --2- 172.21.15.123:0/3334994944 >> v2:172.21.15.164:3300/0 conn(0x7f23380b2ad0 0x7f2338148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:59.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.862+0000 7f2336a00640 1 --2- 172.21.15.123:0/3334994944 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2338070940 0x7f2338149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:59.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.862+0000 7f2336000640 1 -- 172.21.15.123:0/3334994944 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1089085070 0 0) 0x7f23380b2eb0 con 0x7f233813f1f0 2024-04-17T05:26:59.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.862+0000 7f2336000640 1 -- 172.21.15.123:0/3334994944 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f231c003520 con 0x7f233813f1f0 2024-04-17T05:26:59.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.862+0000 7f2336000640 1 -- 172.21.15.123:0/3334994944 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4176889339 0 0) 0x7f231c003520 con 0x7f233813f1f0 2024-04-17T05:26:59.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.862+0000 7f2336000640 1 -- 172.21.15.123:0/3334994944 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2338070940 msgr2=0x7f2338149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:59.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.862+0000 7f2336000640 1 --2- 172.21.15.123:0/3334994944 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2338070940 0x7f2338149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:59.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.862+0000 7f2336000640 1 -- 172.21.15.123:0/3334994944 >> v2:172.21.15.164:3300/0 conn(0x7f23380b2ad0 msgr2=0x7f2338148de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:59.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.862+0000 7f2336000640 1 --2- 172.21.15.123:0/3334994944 >> v2:172.21.15.164:3300/0 conn(0x7f23380b2ad0 0x7f2338148de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:59.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.862+0000 7f2336000640 1 -- 172.21.15.123:0/3334994944 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23380b5280 con 0x7f233813f1f0 2024-04-17T05:26:59.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.862+0000 7f2336000640 1 -- 172.21.15.123:0/3334994944 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1042962670 0 0) 0x7f23300019f0 con 0x7f233813f1f0 2024-04-17T05:26:59.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.862+0000 7f2336000640 1 -- 172.21.15.123:0/3334994944 >> v1:172.21.15.123:6789/0 conn(0x7f233813f1f0 legacy=0x7f233813f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:59.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.862+0000 7f2336000640 1 --2- 172.21.15.123:0/3334994944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f231c0039b0 0x7f231c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:59.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.862+0000 7f2336000640 1 --2- 172.21.15.123:0/3334994944 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2338070940 0x7f231c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:59.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.862+0000 7f2336000640 1 --2- 172.21.15.123:0/3334994944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f231c004d40 0x7f231c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:59.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.862+0000 7f2336000640 1 -- 172.21.15.123:0/3334994944 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2338071cf0 con 0x7f231c004d40 2024-04-17T05:26:59.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.862+0000 7f2336000640 1 -- 172.21.15.123:0/3334994944 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f23380b4fa0 con 0x7f231c0039b0 2024-04-17T05:26:59.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.862+0000 7f2336000640 1 -- 172.21.15.123:0/3334994944 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f231c00baf0 con 0x7f2338070940 2024-04-17T05:26:59.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.863+0000 7f2337e00640 1 --2- 172.21.15.123:0/3334994944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f231c004d40 0x7f231c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:59.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.863+0000 7f2337400640 1 --2- 172.21.15.123:0/3334994944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f231c0039b0 0x7f231c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:59.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.863+0000 7f2336a00640 1 --2- 172.21.15.123:0/3334994944 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2338070940 0x7f231c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:59.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.863+0000 7f2337e00640 1 -- 172.21.15.123:0/3334994944 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2338070940 msgr2=0x7f231c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:59.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.863+0000 7f2337e00640 1 --2- 172.21.15.123:0/3334994944 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2338070940 0x7f231c004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:59.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.863+0000 7f2337e00640 1 -- 172.21.15.123:0/3334994944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f231c0039b0 msgr2=0x7f231c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:26:59.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.863+0000 7f2337e00640 1 --2- 172.21.15.123:0/3334994944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f231c0039b0 0x7f231c003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:59.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.863+0000 7f2337e00640 1 -- 172.21.15.123:0/3334994944 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231c003520 con 0x7f231c004d40 2024-04-17T05:26:59.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.864+0000 7f2337e00640 1 --2- 172.21.15.123:0/3334994944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f231c004d40 0x7f231c0051c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f233000a7a0 tx=0x7f231c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b7fc183732d552 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:59.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.864+0000 7f2336000640 1 -- 172.21.15.123:0/3334994944 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233000a3f0 con 0x7f231c004d40 2024-04-17T05:26:59.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.864+0000 7f2336000640 1 -- 172.21.15.123:0/3334994944 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2330034630 con 0x7f231c004d40 2024-04-17T05:26:59.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.864+0000 7f2336000640 1 -- 172.21.15.123:0/3334994944 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2330034a40 con 0x7f231c004d40 2024-04-17T05:26:59.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.865+0000 7f233cc00640 1 -- 172.21.15.123:0/3334994944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f231c004d40 msgr2=0x7f231c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:59.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.865+0000 7f233cc00640 1 --2- 172.21.15.123:0/3334994944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f231c004d40 0x7f231c0051c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f233000a7a0 tx=0x7f231c005830 comp rx=0 tx=0).stop 2024-04-17T05:26:59.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.865+0000 7f2337e00640 1 -- 172.21.15.123:0/3334994944 reap_dead start 2024-04-17T05:26:59.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.865+0000 7f233cc00640 1 -- 172.21.15.123:0/3334994944 shutdown_connections 2024-04-17T05:26:59.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.865+0000 7f233cc00640 1 -- 172.21.15.123:0/3334994944 >> 172.21.15.123:0/3334994944 conn(0x7f23380b9150 msgr2=0x7f23380b9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:26:59.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.865+0000 7f233cc00640 1 -- 172.21.15.123:0/3334994944 shutdown_connections 2024-04-17T05:26:59.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.865+0000 7f233cc00640 1 -- 172.21.15.123:0/3334994944 wait complete. 2024-04-17T05:26:59.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.867+0000 7f233cc00640 1 Processor -- start 2024-04-17T05:26:59.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.867+0000 7f233cc00640 1 -- start start 2024-04-17T05:26:59.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.868+0000 7f233cc00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f231c004d40 0x7f2338146320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:59.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.868+0000 7f233cc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23381dcf80 0x7f23381e04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:59.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.868+0000 7f233cc00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23381dd400 0x7f23381e0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:59.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.868+0000 7f233cc00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2338149320 con 0x7f23381dd400 2024-04-17T05:26:59.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.868+0000 7f233cc00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f23380b3560 con 0x7f23381dcf80 2024-04-17T05:26:59.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.868+0000 7f233cc00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f23381494a0 con 0x7f231c004d40 2024-04-17T05:26:59.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.868+0000 7f2337e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23381dd400 0x7f23381e0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:59.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.868+0000 7f2337e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23381dd400 0x7f23381e0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50408/0 (socket says 172.21.15.123:50408) 2024-04-17T05:26:59.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.868+0000 7f2337e00640 1 -- 172.21.15.123:0/1816442528 learned_addr learned my addr 172.21.15.123:0/1816442528 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:26:59.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.868+0000 7f2336a00640 1 --2- 172.21.15.123:0/1816442528 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23381dcf80 0x7f23381e04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:59.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.868+0000 7f2337400640 1 --2- 172.21.15.123:0/1816442528 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f231c004d40 0x7f2338146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:59.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.868+0000 7f2337e00640 1 -- 172.21.15.123:0/1816442528 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f231c004d40 msgr2=0x7f2338146320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:59.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.868+0000 7f2337e00640 1 --2- 172.21.15.123:0/1816442528 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f231c004d40 0x7f2338146320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:59.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.868+0000 7f2337e00640 1 -- 172.21.15.123:0/1816442528 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23381dcf80 msgr2=0x7f23381e04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:26:59.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.868+0000 7f2337e00640 1 --2- 172.21.15.123:0/1816442528 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23381dcf80 0x7f23381e04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:26:59.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.869+0000 7f2337e00640 1 -- 172.21.15.123:0/1816442528 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23381424c0 con 0x7f23381dd400 2024-04-17T05:26:59.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.869+0000 7f2337400640 1 --2- 172.21.15.123:0/1816442528 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f231c004d40 0x7f2338146320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:26:59.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.869+0000 7f2337e00640 1 --2- 172.21.15.123:0/1816442528 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23381dd400 0x7f23381e0a30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f233000a7a0 tx=0x7f23380b5450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:59.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.869+0000 7f232f400640 1 -- 172.21.15.123:0/1816442528 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2330001f30 con 0x7f23381dd400 2024-04-17T05:26:59.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.869+0000 7f232f400640 1 -- 172.21.15.123:0/1816442528 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2330044070 con 0x7f23381dd400 2024-04-17T05:26:59.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.869+0000 7f232f400640 1 -- 172.21.15.123:0/1816442528 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233000a3d0 con 0x7f23381dd400 2024-04-17T05:26:59.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.869+0000 7f233cc00640 1 -- 172.21.15.123:0/1816442528 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23381406e0 con 0x7f23381dd400 2024-04-17T05:26:59.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.869+0000 7f233cc00640 1 -- 172.21.15.123:0/1816442528 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2338140ca0 con 0x7f23381dd400 2024-04-17T05:26:59.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.870+0000 7f233cc00640 1 -- 172.21.15.123:0/1816442528 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23380759b0 con 0x7f23381dd400 2024-04-17T05:26:59.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.871+0000 7f232f400640 1 -- 172.21.15.123:0/1816442528 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f23300349f0 con 0x7f23381dd400 2024-04-17T05:26:59.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.872+0000 7f232f400640 1 --2- 172.21.15.123:0/1816442528 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f231406c920 0x7f231406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:26:59.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.872+0000 7f232f400640 1 -- 172.21.15.123:0/1816442528 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f23300ae1f0 con 0x7f23381dd400 2024-04-17T05:26:59.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.873+0000 7f2337400640 1 --2- 172.21.15.123:0/1816442528 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f231406c920 0x7f231406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:26:59.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.874+0000 7f2337400640 1 --2- 172.21.15.123:0/1816442528 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f231406c920 0x7f231406ede0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f233813ec50 tx=0x7f2328008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:26:59.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:26:59.877+0000 7f232f400640 1 -- 172.21.15.123:0/1816442528 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f233007c2d0 con 0x7f23381dd400 2024-04-17T05:27:00.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.116+0000 7f233cc00640 1 -- 172.21.15.123:0/1816442528 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2338140e70 con 0x7f23381dd400 2024-04-17T05:27:00.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.118+0000 7f232f400640 1 -- 172.21.15.123:0/1816442528 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+3550 (secure 0 0 0) 0x7f233007bbd0 con 0x7f23381dd400 2024-04-17T05:27:00.116 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:27:00.116 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/515699398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":515699398},{"type":"v1","addr":"172.21.15.123:6833","nonce":515699398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T05:26:52.642446+0000","modified":"2024-04-17T05:26:57.743724+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4243},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4243":{"gid":4243,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/1946746019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1946746019},{"type":"v1","addr":"172.21.15.164:6835","nonce":1946746019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4243,"qdb_cluster":[4243]},"id":1}]} 2024-04-17T05:27:00.116 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 7 2024-04-17T05:27:00.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.120+0000 7f233cc00640 1 -- 172.21.15.123:0/1816442528 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f231406c920 msgr2=0x7f231406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:00.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.120+0000 7f233cc00640 1 --2- 172.21.15.123:0/1816442528 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f231406c920 0x7f231406ede0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f233813ec50 tx=0x7f2328008040 comp rx=0 tx=0).stop 2024-04-17T05:27:00.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.120+0000 7f233cc00640 1 -- 172.21.15.123:0/1816442528 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23381dd400 msgr2=0x7f23381e0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:00.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.120+0000 7f233cc00640 1 --2- 172.21.15.123:0/1816442528 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23381dd400 0x7f23381e0a30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f233000a7a0 tx=0x7f23380b5450 comp rx=0 tx=0).stop 2024-04-17T05:27:00.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.120+0000 7f233cc00640 1 -- 172.21.15.123:0/1816442528 shutdown_connections 2024-04-17T05:27:00.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.120+0000 7f233cc00640 1 --2- 172.21.15.123:0/1816442528 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23381dd400 0x7f23381e0a30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:00.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.120+0000 7f233cc00640 1 --2- 172.21.15.123:0/1816442528 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23381dcf80 0x7f23381e04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:00.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.120+0000 7f233cc00640 1 --2- 172.21.15.123:0/1816442528 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f231406c920 0x7f231406ede0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:00.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.120+0000 7f233cc00640 1 --2- 172.21.15.123:0/1816442528 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f231c004d40 0x7f2338146320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:00.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.120+0000 7f233cc00640 1 -- 172.21.15.123:0/1816442528 >> 172.21.15.123:0/1816442528 conn(0x7f23380b9150 msgr2=0x7f2338072bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:00.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.121+0000 7f233cc00640 1 -- 172.21.15.123:0/1816442528 shutdown_connections 2024-04-17T05:27:00.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.121+0000 7f233cc00640 1 -- 172.21.15.123:0/1816442528 wait complete. 2024-04-17T05:27:00.138 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T05:27:00.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.351+0000 7fbe99c00640 1 Processor -- start 2024-04-17T05:27:00.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.351+0000 7fbe99c00640 1 -- start start 2024-04-17T05:27:00.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.352+0000 7fbe99c00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fbe9409d630 0x7fbe9409da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:00.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.352+0000 7fbe99c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe94142b30 0x7fbe94142f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:00.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.352+0000 7fbe99c00640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe9409cc30 con 0x7fbe941492e0 2024-04-17T05:27:00.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.352+0000 7fbe99c00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7fbe9409bcf0 con 0x7fbe9409d630 2024-04-17T05:27:00.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.352+0000 7fbe99c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fbe9409cea0 con 0x7fbe94142b30 2024-04-17T05:27:00.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.353+0000 7fbe92a00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fbe9409d630 0x7fbe9409da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:00.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.353+0000 7fbe92a00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fbe9409d630 0x7fbe9409da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.123:56328/0 (socket says 172.21.15.123:56328) 2024-04-17T05:27:00.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.353+0000 7fbe92a00640 1 -- 172.21.15.123:0/4242013481 learned_addr learned my addr 172.21.15.123:0/4242013481 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:00.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.353+0000 7fbe93400640 1 --2- 172.21.15.123:0/4242013481 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe94142b30 0x7fbe94142f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:00.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.354+0000 7fbe92a00640 1 -- 172.21.15.123:0/4242013481 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe94142b30 msgr2=0x7fbe94142f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:00.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.354+0000 7fbe92a00640 1 --2- 172.21.15.123:0/4242013481 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe94142b30 0x7fbe94142f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:00.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.354+0000 7fbe92a00640 1 -- 172.21.15.123:0/4242013481 >> v1:172.21.15.164:6789/0 conn(0x7fbe941492e0 legacy=0x7fbe94149770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:00.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.354+0000 7fbe92a00640 1 -- 172.21.15.123:0/4242013481 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9409b3c0 con 0x7fbe9409d630 2024-04-17T05:27:00.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.355+0000 7fbe92a00640 1 --2- 172.21.15.123:0/4242013481 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe9409d630 0x7fbe9409da10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbe84009870 tx=0x7fbe8402b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5ffc85fbf7e01b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:00.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.356+0000 7fbe91600640 1 -- 172.21.15.123:0/4242013481 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe84035020 con 0x7fbe9409d630 2024-04-17T05:27:00.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.356+0000 7fbe91600640 1 -- 172.21.15.123:0/4242013481 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe84031640 con 0x7fbe9409d630 2024-04-17T05:27:00.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.356+0000 7fbe91600640 1 -- 172.21.15.123:0/4242013481 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8402d040 con 0x7fbe9409d630 2024-04-17T05:27:00.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.356+0000 7fbe99c00640 1 -- 172.21.15.123:0/4242013481 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe9409d630 msgr2=0x7fbe9409da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:00.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.356+0000 7fbe99c00640 1 --2- 172.21.15.123:0/4242013481 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe9409d630 0x7fbe9409da10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbe84009870 tx=0x7fbe8402b8f0 comp rx=0 tx=0).stop 2024-04-17T05:27:00.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.356+0000 7fbe99c00640 1 -- 172.21.15.123:0/4242013481 shutdown_connections 2024-04-17T05:27:00.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.356+0000 7fbe99c00640 1 --2- 172.21.15.123:0/4242013481 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe94142b30 0x7fbe94142f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:00.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.356+0000 7fbe99c00640 1 --2- 172.21.15.123:0/4242013481 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe9409d630 0x7fbe9409da10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:00.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.356+0000 7fbe99c00640 1 -- 172.21.15.123:0/4242013481 >> 172.21.15.123:0/4242013481 conn(0x7fbe940b93b0 msgr2=0x7fbe940b97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:00.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.356+0000 7fbe99c00640 1 -- 172.21.15.123:0/4242013481 shutdown_connections 2024-04-17T05:27:00.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.356+0000 7fbe99c00640 1 -- 172.21.15.123:0/4242013481 wait complete. 2024-04-17T05:27:00.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.358+0000 7fbe99c00640 1 Processor -- start 2024-04-17T05:27:00.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.358+0000 7fbe99c00640 1 -- start start 2024-04-17T05:27:00.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.359+0000 7fbe99c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe9409d630 0x7fbe940b8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:00.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.359+0000 7fbe99c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe94142b30 0x7fbe941ddc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:00.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.359+0000 7fbe99c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe941492e0 0x7fbe941e0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:00.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.359+0000 7fbe99c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbe940b5b10 con 0x7fbe941492e0 2024-04-17T05:27:00.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.359+0000 7fbe99c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9409b980 con 0x7fbe94142b30 2024-04-17T05:27:00.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.359+0000 7fbe99c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fbe940b5c90 con 0x7fbe9409d630 2024-04-17T05:27:00.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.359+0000 7fbe93400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe941492e0 0x7fbe941e0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:00.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.359+0000 7fbe93400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe941492e0 0x7fbe941e0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50422/0 (socket says 172.21.15.123:50422) 2024-04-17T05:27:00.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.359+0000 7fbe93400640 1 -- 172.21.15.123:0/2194378011 learned_addr learned my addr 172.21.15.123:0/2194378011 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:00.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.360+0000 7fbe92a00640 1 --2- 172.21.15.123:0/2194378011 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe9409d630 0x7fbe940b8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:00.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.360+0000 7fbe93400640 1 -- 172.21.15.123:0/2194378011 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe9409d630 msgr2=0x7fbe940b8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:00.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.360+0000 7fbe93400640 1 --2- 172.21.15.123:0/2194378011 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe9409d630 0x7fbe940b8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:00.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.360+0000 7fbe93400640 1 -- 172.21.15.123:0/2194378011 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe94142b30 msgr2=0x7fbe941ddc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:00.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.360+0000 7fbe93400640 1 --2- 172.21.15.123:0/2194378011 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe94142b30 0x7fbe941ddc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:00.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.360+0000 7fbe93400640 1 -- 172.21.15.123:0/2194378011 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe940702a0 con 0x7fbe941492e0 2024-04-17T05:27:00.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.360+0000 7fbe93400640 1 --2- 172.21.15.123:0/2194378011 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe941492e0 0x7fbe941e0a30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c00efc0 tx=0x7fbe8c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:00.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.360+0000 7fbe8aa00640 1 -- 172.21.15.123:0/2194378011 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c018020 con 0x7fbe941492e0 2024-04-17T05:27:00.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.360+0000 7fbe8aa00640 1 -- 172.21.15.123:0/2194378011 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe8c014480 con 0x7fbe941492e0 2024-04-17T05:27:00.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.361+0000 7fbe99c00640 1 -- 172.21.15.123:0/2194378011 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe941dd4c0 con 0x7fbe941492e0 2024-04-17T05:27:00.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.361+0000 7fbe8aa00640 1 -- 172.21.15.123:0/2194378011 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c014870 con 0x7fbe941492e0 2024-04-17T05:27:00.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.361+0000 7fbe99c00640 1 -- 172.21.15.123:0/2194378011 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe940b1a50 con 0x7fbe941492e0 2024-04-17T05:27:00.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.362+0000 7fbe99c00640 1 -- 172.21.15.123:0/2194378011 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe94068a40 con 0x7fbe941492e0 2024-04-17T05:27:00.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.363+0000 7fbe8aa00640 1 -- 172.21.15.123:0/2194378011 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbe8c005d10 con 0x7fbe941492e0 2024-04-17T05:27:00.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.364+0000 7fbe8aa00640 1 --2- 172.21.15.123:0/2194378011 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fbe7406c920 0x7fbe7406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:00.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.364+0000 7fbe8aa00640 1 -- 172.21.15.123:0/2194378011 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fbe8c08c990 con 0x7fbe941492e0 2024-04-17T05:27:00.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.364+0000 7fbe92a00640 1 --2- 172.21.15.123:0/2194378011 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fbe7406c920 0x7fbe7406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:00.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.365+0000 7fbe92a00640 1 --2- 172.21.15.123:0/2194378011 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fbe7406c920 0x7fbe7406ede0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbe84036000 tx=0x7fbe8403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:00.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.368+0000 7fbe8aa00640 1 -- 172.21.15.123:0/2194378011 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fbe8c022070 con 0x7fbe941492e0 2024-04-17T05:27:00.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.569+0000 7fbe99c00640 1 -- 172.21.15.123:0/2194378011 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbe940b8cb0 con 0x7fbe941492e0 2024-04-17T05:27:00.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.571+0000 7fbe8aa00640 1 -- 172.21.15.123:0/2194378011 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18526 (secure 0 0 0) 0x7fbe941dd4c0 con 0x7fbe941492e0 2024-04-17T05:27:00.570 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:27:00.570 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":26,"fsid":"0787c5c0-e77a-4102-a899-30db48b19c68","created":"2024-04-17T05:26:33.031507+0000","modified":"2024-04-17T05:26:57.743352+0000","last_up_change":"2024-04-17T05:26:44.988433+0000","last_in_change":"2024-04-17T05:26:36.682131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T05:26:46.329778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T05:26:50.600195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T05:26:51.626498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T05:26:55.264044+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15c87cdb-9415-45a6-a2a6-ea6bec9daece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6801","nonce":840753170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6803","nonce":840753170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6807","nonce":840753170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6805","nonce":840753170}]},"public_addr":"172.21.15.123:6801/840753170","cluster_addr":"172.21.15.123:6803/840753170","heartbeat_back_addr":"172.21.15.123:6807/840753170","heartbeat_front_addr":"172.21.15.123:6805/840753170","state":["exists","up"]},{"osd":1,"uuid":"281751b5-486d-4845-b4aa-b308bf7cec62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6822","nonce":2231878927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6827","nonce":2231878927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6831","nonce":2231878927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6829","nonce":2231878927}]},"public_addr":"172.21.15.123:6822/2231878927","cluster_addr":"172.21.15.123:6827/2231878927","heartbeat_back_addr":"172.21.15.123:6831/2231878927","heartbeat_front_addr":"172.21.15.123:6829/2231878927","state":["exists","up"]},{"osd":2,"uuid":"b42257d3-bd20-4db5-aa37-1bf5c512d0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6817","nonce":754360844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6820","nonce":754360844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6825","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6826","nonce":754360844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6823","nonce":754360844}]},"public_addr":"172.21.15.123:6817/754360844","cluster_addr":"172.21.15.123:6820/754360844","heartbeat_back_addr":"172.21.15.123:6826/754360844","heartbeat_front_addr":"172.21.15.123:6823/754360844","state":["exists","up"]},{"osd":3,"uuid":"0f26b891-bbe6-478e-8dee-78e69bb48cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6809","nonce":2898088574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6811","nonce":2898088574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6815","nonce":2898088574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6813","nonce":2898088574}]},"public_addr":"172.21.15.123:6809/2898088574","cluster_addr":"172.21.15.123:6811/2898088574","heartbeat_back_addr":"172.21.15.123:6815/2898088574","heartbeat_front_addr":"172.21.15.123:6813/2898088574","state":["exists","up"]},{"osd":4,"uuid":"43e59318-2740-4625-9d64-eec1fd43c322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6801","nonce":606484349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6804","nonce":606484349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6812","nonce":606484349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6808","nonce":606484349}]},"public_addr":"172.21.15.164:6801/606484349","cluster_addr":"172.21.15.164:6804/606484349","heartbeat_back_addr":"172.21.15.164:6812/606484349","heartbeat_front_addr":"172.21.15.164:6808/606484349","state":["exists","up"]},{"osd":5,"uuid":"aaa3acf4-4adc-4337-aba3-363851d35310","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6805","nonce":1376989593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6809","nonce":1376989593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6815","nonce":1376989593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6813","nonce":1376989593}]},"public_addr":"172.21.15.164:6805/1376989593","cluster_addr":"172.21.15.164:6809/1376989593","heartbeat_back_addr":"172.21.15.164:6815/1376989593","heartbeat_front_addr":"172.21.15.164:6813/1376989593","state":["exists","up"]},{"osd":6,"uuid":"6f765b27-7377-4d81-9192-23a965651145","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6817","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6821","nonce":1594306924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6823","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6826","nonce":1594306924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6831","nonce":1594306924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6829","nonce":1594306924}]},"public_addr":"172.21.15.164:6821/1594306924","cluster_addr":"172.21.15.164:6826/1594306924","heartbeat_back_addr":"172.21.15.164:6831/1594306924","heartbeat_front_addr":"172.21.15.164:6829/1594306924","state":["exists","up"]},{"osd":7,"uuid":"5547394b-ec2f-4311-846d-369af4b1acf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6818","nonce":295402697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6819","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6820","nonce":295402697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6825","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6827","nonce":295402697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6824","nonce":295402697}]},"public_addr":"172.21.15.164:6818/295402697","cluster_addr":"172.21.15.164:6820/295402697","heartbeat_back_addr":"172.21.15.164:6827/295402697","heartbeat_front_addr":"172.21.15.164:6824/295402697","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.034807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.022201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.751897+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.850533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.083608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.047524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.314753+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.413586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T05:27:00.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.574+0000 7fbe99c00640 1 -- 172.21.15.123:0/2194378011 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fbe7406c920 msgr2=0x7fbe7406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:00.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.574+0000 7fbe99c00640 1 --2- 172.21.15.123:0/2194378011 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fbe7406c920 0x7fbe7406ede0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbe84036000 tx=0x7fbe8403c040 comp rx=0 tx=0).stop 2024-04-17T05:27:00.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.574+0000 7fbe99c00640 1 -- 172.21.15.123:0/2194378011 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe941492e0 msgr2=0x7fbe941e0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:00.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.574+0000 7fbe99c00640 1 --2- 172.21.15.123:0/2194378011 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe941492e0 0x7fbe941e0a30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c00efc0 tx=0x7fbe8c00c490 comp rx=0 tx=0).stop 2024-04-17T05:27:00.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.574+0000 7fbe99c00640 1 -- 172.21.15.123:0/2194378011 shutdown_connections 2024-04-17T05:27:00.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.574+0000 7fbe99c00640 1 --2- 172.21.15.123:0/2194378011 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe941492e0 0x7fbe941e0a30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:00.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.574+0000 7fbe99c00640 1 --2- 172.21.15.123:0/2194378011 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbe94142b30 0x7fbe941ddc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:00.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.574+0000 7fbe99c00640 1 --2- 172.21.15.123:0/2194378011 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fbe7406c920 0x7fbe7406ede0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:00.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.574+0000 7fbe99c00640 1 --2- 172.21.15.123:0/2194378011 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbe9409d630 0x7fbe940b8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:00.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.574+0000 7fbe99c00640 1 -- 172.21.15.123:0/2194378011 >> 172.21.15.123:0/2194378011 conn(0x7fbe940b93b0 msgr2=0x7fbe940b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:00.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.574+0000 7fbe99c00640 1 -- 172.21.15.123:0/2194378011 shutdown_connections 2024-04-17T05:27:00.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:00.574+0000 7fbe99c00640 1 -- 172.21.15.123:0/2194378011 wait complete. 2024-04-17T05:27:00.793 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-17T05:26:52.642446+0000', 'modified': '2024-04-17T05:26:57.743724+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'snap_rstat': True, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4243}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4243': {'gid': 4243, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.164:6835/1946746019', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6834', 'nonce': 1946746019}, {'type': 'v1', 'addr': '172.21.15.164:6835', 'nonce': 1946746019}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4243, 'qdb_cluster': [4243]} 2024-04-17T05:27:00.793 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-17T05:27:00.793 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-17T05:27:01.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.013+0000 7f584be00640 1 Processor -- start 2024-04-17T05:27:01.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.013+0000 7f584be00640 1 -- start start 2024-04-17T05:27:01.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.014+0000 7f584be00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58440b44c0 0x7f58440b4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:01.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.014+0000 7f584be00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f584409d740 con 0x7f584406dcc0 2024-04-17T05:27:01.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.014+0000 7f584be00640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f584409e120 con 0x7f58440b5a50 2024-04-17T05:27:01.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.014+0000 7f584be00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f58440b4e60 con 0x7f58440b44c0 2024-04-17T05:27:01.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.015+0000 7f5849400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f584406dcc0 0x7f584409c4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59122/0 (socket says 172.21.15.123:59122) 2024-04-17T05:27:01.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.015+0000 7f5849400640 1 -- 172.21.15.123:0/2936186039 learned_addr learned my addr 172.21.15.123:0/2936186039 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:27:01.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.015+0000 7f5849e00640 1 --2- 172.21.15.123:0/2936186039 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58440b44c0 0x7f58440b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:01.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.015+0000 7f5843e00640 1 -- 172.21.15.123:0/2936186039 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3585466410 0 0) 0x7f584409d740 con 0x7f584406dcc0 2024-04-17T05:27:01.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.015+0000 7f5843e00640 1 -- 172.21.15.123:0/2936186039 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f582c003520 con 0x7f584406dcc0 2024-04-17T05:27:01.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.015+0000 7f5843e00640 1 -- 172.21.15.123:0/2936186039 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2707520912 0 0) 0x7f582c003520 con 0x7f584406dcc0 2024-04-17T05:27:01.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.015+0000 7f5843e00640 1 -- 172.21.15.123:0/2936186039 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58440b44c0 msgr2=0x7f58440b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:01.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.015+0000 7f5843e00640 1 --2- 172.21.15.123:0/2936186039 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58440b44c0 0x7f58440b4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.015+0000 7f5843e00640 1 -- 172.21.15.123:0/2936186039 >> v1:172.21.15.164:6789/0 conn(0x7f58440b5a50 legacy=0x7f58440b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:01.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.015+0000 7f5843e00640 1 -- 172.21.15.123:0/2936186039 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f584406e0a0 con 0x7f584406dcc0 2024-04-17T05:27:01.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.015+0000 7f5843e00640 1 -- 172.21.15.123:0/2936186039 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1042962670 0 0) 0x7f5838001670 con 0x7f584406dcc0 2024-04-17T05:27:01.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.015+0000 7f5843e00640 1 -- 172.21.15.123:0/2936186039 >> v1:172.21.15.123:6789/0 conn(0x7f584406dcc0 legacy=0x7f584409c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:01.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.016+0000 7f5843e00640 1 --2- 172.21.15.123:0/2936186039 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f582c0039e0 0x7f582c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:01.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.016+0000 7f5843e00640 1 --2- 172.21.15.123:0/2936186039 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58440b44c0 0x7f582c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:01.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.016+0000 7f5843e00640 1 --2- 172.21.15.123:0/2936186039 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f582c004d40 0x7f582c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:01.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.016+0000 7f5843e00640 1 -- 172.21.15.123:0/2936186039 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f58440b4e60 con 0x7f582c004d40 2024-04-17T05:27:01.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.016+0000 7f5843e00640 1 -- 172.21.15.123:0/2936186039 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f582c00bb50 con 0x7f582c0039e0 2024-04-17T05:27:01.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.016+0000 7f5843e00640 1 -- 172.21.15.123:0/2936186039 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f582c00bd20 con 0x7f58440b44c0 2024-04-17T05:27:01.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.016+0000 7f5849e00640 1 --2- 172.21.15.123:0/2936186039 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f582c004d40 0x7f582c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:01.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.016+0000 7f5849400640 1 --2- 172.21.15.123:0/2936186039 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f582c0039e0 0x7f582c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:01.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.016+0000 7f5848a00640 1 --2- 172.21.15.123:0/2936186039 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58440b44c0 0x7f582c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:01.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.016+0000 7f5849e00640 1 -- 172.21.15.123:0/2936186039 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58440b44c0 msgr2=0x7f582c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:01.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.016+0000 7f5849e00640 1 --2- 172.21.15.123:0/2936186039 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58440b44c0 0x7f582c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.016+0000 7f5849e00640 1 -- 172.21.15.123:0/2936186039 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f582c0039e0 msgr2=0x7f582c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:01.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.016+0000 7f5849e00640 1 --2- 172.21.15.123:0/2936186039 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f582c0039e0 0x7f582c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.016+0000 7f5849e00640 1 -- 172.21.15.123:0/2936186039 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f582c003520 con 0x7f582c004d40 2024-04-17T05:27:01.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.017+0000 7f5849e00640 1 --2- 172.21.15.123:0/2936186039 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f582c004d40 0x7f582c0051c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f583c007390 tx=0x7f582c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed2f2067ad609e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:01.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.018+0000 7f5843e00640 1 -- 172.21.15.123:0/2936186039 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583c039070 con 0x7f582c004d40 2024-04-17T05:27:01.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.018+0000 7f5843e00640 1 -- 172.21.15.123:0/2936186039 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f583c02ccb0 con 0x7f582c004d40 2024-04-17T05:27:01.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.018+0000 7f5843e00640 1 -- 172.21.15.123:0/2936186039 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583c009be0 con 0x7f582c004d40 2024-04-17T05:27:01.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.018+0000 7f584be00640 1 -- 172.21.15.123:0/2936186039 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f582c004d40 msgr2=0x7f582c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:01.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.018+0000 7f584be00640 1 --2- 172.21.15.123:0/2936186039 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f582c004d40 0x7f582c0051c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f583c007390 tx=0x7f582c005830 comp rx=0 tx=0).stop 2024-04-17T05:27:01.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.018+0000 7f5849e00640 1 -- 172.21.15.123:0/2936186039 reap_dead start 2024-04-17T05:27:01.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.018+0000 7f584be00640 1 -- 172.21.15.123:0/2936186039 shutdown_connections 2024-04-17T05:27:01.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.018+0000 7f584be00640 1 -- 172.21.15.123:0/2936186039 >> 172.21.15.123:0/2936186039 conn(0x7f58440b93b0 msgr2=0x7f58440b97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:01.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.018+0000 7f584be00640 1 -- 172.21.15.123:0/2936186039 shutdown_connections 2024-04-17T05:27:01.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.018+0000 7f584be00640 1 -- 172.21.15.123:0/2936186039 wait complete. 2024-04-17T05:27:01.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.020+0000 7f584be00640 1 Processor -- start 2024-04-17T05:27:01.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.020+0000 7f584be00640 1 -- start start 2024-04-17T05:27:01.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.021+0000 7f584be00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f582c004d40 0x7f58441e1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:01.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.021+0000 7f584be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f58441e1650 0x7f584413fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:01.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.021+0000 7f584be00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58441e1ad0 0x7f5844140040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:01.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.021+0000 7f584be00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f584409d9b0 con 0x7f582c004d40 2024-04-17T05:27:01.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.021+0000 7f584be00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f58440b5130 con 0x7f58441e1650 2024-04-17T05:27:01.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.021+0000 7f584be00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f584409e3c0 con 0x7f58441e1ad0 2024-04-17T05:27:01.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.021+0000 7f5849400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f582c004d40 0x7f58441e1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:01.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.021+0000 7f5849400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f582c004d40 0x7f58441e1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50448/0 (socket says 172.21.15.123:50448) 2024-04-17T05:27:01.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.021+0000 7f5849400640 1 -- 172.21.15.123:0/1003090001 learned_addr learned my addr 172.21.15.123:0/1003090001 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:01.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.021+0000 7f5849e00640 1 --2- 172.21.15.123:0/1003090001 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58441e1ad0 0x7f5844140040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:01.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.021+0000 7f5849400640 1 -- 172.21.15.123:0/1003090001 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58441e1ad0 msgr2=0x7f5844140040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:01.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.021+0000 7f5849400640 1 --2- 172.21.15.123:0/1003090001 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58441e1ad0 0x7f5844140040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.021+0000 7f5849400640 1 -- 172.21.15.123:0/1003090001 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f58441e1650 msgr2=0x7f584413fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:01.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.021+0000 7f5849400640 1 --2- 172.21.15.123:0/1003090001 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f58441e1650 0x7f584413fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.022+0000 7f5849400640 1 -- 172.21.15.123:0/1003090001 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58440713e0 con 0x7f582c004d40 2024-04-17T05:27:01.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.022+0000 7f5849400640 1 --2- 172.21.15.123:0/1003090001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f582c004d40 0x7f58441e1110 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f583800e840 tx=0x7f583800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:01.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.022+0000 7f5841600640 1 -- 172.21.15.123:0/1003090001 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583800c8d0 con 0x7f582c004d40 2024-04-17T05:27:01.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.022+0000 7f5841600640 1 -- 172.21.15.123:0/1003090001 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5838018070 con 0x7f582c004d40 2024-04-17T05:27:01.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.022+0000 7f584be00640 1 -- 172.21.15.123:0/1003090001 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5844072710 con 0x7f582c004d40 2024-04-17T05:27:01.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.022+0000 7f5841600640 1 -- 172.21.15.123:0/1003090001 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583800ccd0 con 0x7f582c004d40 2024-04-17T05:27:01.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.022+0000 7f584be00640 1 -- 172.21.15.123:0/1003090001 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58440b24e0 con 0x7f582c004d40 2024-04-17T05:27:01.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.024+0000 7f5841600640 1 -- 172.21.15.123:0/1003090001 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f583801d460 con 0x7f582c004d40 2024-04-17T05:27:01.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.025+0000 7f5841600640 1 --2- 172.21.15.123:0/1003090001 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f582406c8f0 0x7f582406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:01.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.025+0000 7f5841600640 1 -- 172.21.15.123:0/1003090001 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f583808be80 con 0x7f582c004d40 2024-04-17T05:27:01.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.026+0000 7f584ea7e740 1 Processor -- start 2024-04-17T05:27:01.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.026+0000 7f5848a00640 1 --2- 172.21.15.123:0/1003090001 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f582406c8f0 0x7f582406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:01.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.026+0000 7f584ea7e740 1 -- start start 2024-04-17T05:27:01.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.027+0000 7f584ea7e740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5592bf507300 0x5592bf52faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:01.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.027+0000 7f584ea7e740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5592bf52ffe0 0x5592bf52b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:01.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.027+0000 7f584ea7e740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5592bf52b970 0x5592bf536650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:01.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.027+0000 7f584ea7e740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5592bf46e980 con 0x5592bf52b970 2024-04-17T05:27:01.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.027+0000 7f584ea7e740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x5592bf415220 con 0x5592bf52ffe0 2024-04-17T05:27:01.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.027+0000 7f584ea7e740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x5592bf46a940 con 0x5592bf507300 2024-04-17T05:27:01.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.027+0000 7f5848a00640 1 --2- 172.21.15.123:0/1003090001 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f582406c8f0 0x7f582406edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5830007fd0 tx=0x7f5830009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:01.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.027+0000 7f5849e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5592bf52b970 0x5592bf536650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:01.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.027+0000 7f5849e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5592bf52b970 0x5592bf536650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50450/0 (socket says 172.21.15.123:50450) 2024-04-17T05:27:01.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.027+0000 7f5849e00640 1 -- 172.21.15.123:0/2570321170 learned_addr learned my addr 172.21.15.123:0/2570321170 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:01.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.027+0000 7f5849400640 1 --2- 172.21.15.123:0/2570321170 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5592bf507300 0x5592bf52faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:01.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.027+0000 7f5848a00640 1 --2- 172.21.15.123:0/2570321170 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5592bf52ffe0 0x5592bf52b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:01.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.027+0000 7f5849e00640 1 -- 172.21.15.123:0/2570321170 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5592bf507300 msgr2=0x5592bf52faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:01.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.027+0000 7f5849e00640 1 --2- 172.21.15.123:0/2570321170 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5592bf507300 0x5592bf52faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.027+0000 7f5849e00640 1 -- 172.21.15.123:0/2570321170 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5592bf52ffe0 msgr2=0x5592bf52b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:01.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.027+0000 7f5849e00640 1 --2- 172.21.15.123:0/2570321170 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5592bf52ffe0 0x5592bf52b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.027+0000 7f5849e00640 1 -- 172.21.15.123:0/2570321170 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592bf1812d0 con 0x5592bf52b970 2024-04-17T05:27:01.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.027+0000 7f5848a00640 1 --2- 172.21.15.123:0/2570321170 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5592bf52ffe0 0x5592bf52b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:01.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.028+0000 7f5849e00640 1 --2- 172.21.15.123:0/2570321170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5592bf52b970 0x5592bf536650 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f583c0074b0 tx=0x7f583c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f708ad6cd95e1b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:01.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.028+0000 7f5835c00640 1 -- 172.21.15.123:0/2570321170 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583c039040 con 0x5592bf52b970 2024-04-17T05:27:01.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.028+0000 7f5835c00640 1 -- 172.21.15.123:0/2570321170 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f583c043070 con 0x5592bf52b970 2024-04-17T05:27:01.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.028+0000 7f5835c00640 1 -- 172.21.15.123:0/2570321170 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583c034440 con 0x5592bf52b970 2024-04-17T05:27:01.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.029+0000 7f584ea7e740 1 -- 172.21.15.123:0/2570321170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5592bf52b970 msgr2=0x5592bf536650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:01.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.029+0000 7f584ea7e740 1 --2- 172.21.15.123:0/2570321170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5592bf52b970 0x5592bf536650 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f583c0074b0 tx=0x7f583c02e000 comp rx=0 tx=0).stop 2024-04-17T05:27:01.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.029+0000 7f584ea7e740 1 -- 172.21.15.123:0/2570321170 shutdown_connections 2024-04-17T05:27:01.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.029+0000 7f584ea7e740 1 --2- 172.21.15.123:0/2570321170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5592bf52b970 0x5592bf536650 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.029+0000 7f584ea7e740 1 --2- 172.21.15.123:0/2570321170 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5592bf52ffe0 0x5592bf52b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.029+0000 7f584ea7e740 1 --2- 172.21.15.123:0/2570321170 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5592bf507300 0x5592bf52faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.029+0000 7f584ea7e740 1 -- 172.21.15.123:0/2570321170 >> 172.21.15.123:0/2570321170 conn(0x5592bf5048d0 msgr2=0x5592bf506850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:01.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.029+0000 7f584ea7e740 1 -- 172.21.15.123:0/2570321170 shutdown_connections 2024-04-17T05:27:01.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.029+0000 7f584ea7e740 1 -- 172.21.15.123:0/2570321170 wait complete. 2024-04-17T05:27:01.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.030+0000 7f584ea7e740 1 -- start start 2024-04-17T05:27:01.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.030+0000 7f584ea7e740 1 Processor -- start 2024-04-17T05:27:01.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.031+0000 7f584ea7e740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5592bf52b970 0x5592bf54a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:01.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.031+0000 7f584ea7e740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5592bf52ffe0 0x5592bf5270f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:01.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.031+0000 7f584ea7e740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5592bf53d100 0x5592bf530c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:01.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.031+0000 7f584ea7e740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5592bf530460 con 0x5592bf52ffe0 2024-04-17T05:27:01.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.031+0000 7f584ea7e740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x5592bf428590 con 0x5592bf52b970 2024-04-17T05:27:01.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.031+0000 7f584ea7e740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x5592bf536070 con 0x5592bf53d100 2024-04-17T05:27:01.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.031+0000 7f584ea7e740 10 client.0 _ll_register_callbacks cb 0x5592bf180ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-17T05:27:01.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.031+0000 7f5848a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5592bf52ffe0 0x5592bf5270f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:01.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.031+0000 7f5848a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5592bf52ffe0 0x5592bf5270f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50458/0 (socket says 172.21.15.123:50458) 2024-04-17T05:27:01.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.031+0000 7f5848a00640 1 -- 172.21.15.123:0/577528880 learned_addr learned my addr 172.21.15.123:0/577528880 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:01.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.031+0000 7f5849400640 1 --2- 172.21.15.123:0/577528880 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5592bf52b970 0x5592bf54a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:01.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.031+0000 7f5849e00640 1 --2- 172.21.15.123:0/577528880 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5592bf53d100 0x5592bf530c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:01.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.031+0000 7f5848a00640 1 -- 172.21.15.123:0/577528880 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5592bf53d100 msgr2=0x5592bf530c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:01.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.031+0000 7f5848a00640 1 --2- 172.21.15.123:0/577528880 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5592bf53d100 0x5592bf530c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.031+0000 7f5848a00640 1 -- 172.21.15.123:0/577528880 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5592bf52b970 msgr2=0x5592bf54a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:01.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.031+0000 7f5848a00640 1 --2- 172.21.15.123:0/577528880 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5592bf52b970 0x5592bf54a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.031+0000 7f5848a00640 1 -- 172.21.15.123:0/577528880 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592bf24b6b0 con 0x5592bf52ffe0 2024-04-17T05:27:01.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.031+0000 7f5849400640 1 --2- 172.21.15.123:0/577528880 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5592bf52b970 0x5592bf54a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:01.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.031+0000 7f5848a00640 1 --2- 172.21.15.123:0/577528880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5592bf52ffe0 0x5592bf5270f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5830003940 tx=0x7f5830007a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb61b6570ab39c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:01.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.031+0000 7f582a000640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-04-17T05:27:01.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.032+0000 7f582a000640 1 -- 172.21.15.123:0/577528880 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583000ebe0 con 0x5592bf52ffe0 2024-04-17T05:27:01.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.032+0000 7f582a000640 1 -- 172.21.15.123:0/577528880 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5830021dc0 con 0x5592bf52ffe0 2024-04-17T05:27:01.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.032+0000 7f584ea7e740 1 -- 172.21.15.123:0/577528880 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f583c043070 con 0x5592bf52ffe0 2024-04-17T05:27:01.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.032+0000 7f582a000640 1 -- 172.21.15.123:0/577528880 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f583000ed80 con 0x5592bf52ffe0 2024-04-17T05:27:01.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.032+0000 7f584ea7e740 10 client.4368 fetch_fsmap learned FSMap version 7 2024-04-17T05:27:01.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.032+0000 7f584ea7e740 1 -- 172.21.15.123:0/577528880 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x5592bf533850 con 0x5592bf52ffe0 2024-04-17T05:27:01.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.032+0000 7f582a000640 1 -- 172.21.15.123:0/577528880 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f583c043070 con 0x5592bf52ffe0 2024-04-17T05:27:01.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.032+0000 7f582a000640 1 -- 172.21.15.123:0/577528880 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 7) ==== 2293+0+0 (secure 0 0 0) 0x7f5830022430 con 0x5592bf52ffe0 2024-04-17T05:27:01.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.032+0000 7f584ea7e740 10 client.4368 fetch_fsmap finished waiting for FSMap version 7 2024-04-17T05:27:01.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.032+0000 7f584ea7e740 10 client.4368 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-17T05:27:01.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.032+0000 7f584ea7e740 20 client.4368 populate_metadata read hostname 'smithi123' 2024-04-17T05:27:01.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.032+0000 7f584ea7e740 1 --2- 172.21.15.123:0/577528880 >> [v2:172.21.15.164:6834/1946746019,v1:172.21.15.164:6835/1946746019] conn(0x5592bf5317b0 0x5592bf555c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:01.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.032+0000 7f584ea7e740 4 client.4368 mds_command: new command op to 4243 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-17T05:27:01.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.032+0000 7f584ea7e740 1 -- 172.21.15.123:0/577528880 --> [v2:172.21.15.164:6834/1946746019,v1:172.21.15.164:6835/1946746019] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592bf47c3a0 con 0x5592bf5317b0 2024-04-17T05:27:01.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.033+0000 7f5849400640 1 --2- 172.21.15.123:0/577528880 >> [v2:172.21.15.164:6834/1946746019,v1:172.21.15.164:6835/1946746019] conn(0x5592bf5317b0 0x5592bf555c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:01.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.034+0000 7f5849400640 1 --2- 172.21.15.123:0/577528880 >> [v2:172.21.15.164:6834/1946746019,v1:172.21.15.164:6835/1946746019] conn(0x5592bf5317b0 0x5592bf555c10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=378a883b71c28ff8 server_cookie=f61661dc969301a in_seq=0 out_seq=0 2024-04-17T05:27:01.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.034+0000 7f582a000640 10 client.4368 ms_handle_connect on v2:172.21.15.164:6834/1946746019 2024-04-17T05:27:01.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.036+0000 7f582a000640 1 -- 172.21.15.123:0/577528880 <== mds.0 v2:172.21.15.164:6834/1946746019 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5592bf47c3a0 con 0x5592bf5317b0 2024-04-17T05:27:01.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.036+0000 7f582a000640 10 client.4368 handle_command_reply: tid=0 2024-04-17T05:27:01.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.036+0000 7f584ea7e740 1 client.4368 shutdown 2024-04-17T05:27:01.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.036+0000 7f584ea7e740 1 -- 172.21.15.123:0/577528880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5592bf52ffe0 msgr2=0x5592bf5270f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:01.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.036+0000 7f584ea7e740 1 --2- 172.21.15.123:0/577528880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5592bf52ffe0 0x5592bf5270f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5830003940 tx=0x7f5830007a30 comp rx=0 tx=0).stop 2024-04-17T05:27:01.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.036+0000 7f584ea7e740 1 -- 172.21.15.123:0/577528880 shutdown_connections 2024-04-17T05:27:01.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.036+0000 7f584ea7e740 1 --2- 172.21.15.123:0/577528880 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5592bf53d100 0x5592bf530c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.036+0000 7f584ea7e740 1 --2- 172.21.15.123:0/577528880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5592bf52ffe0 0x5592bf5270f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.037+0000 7f584ea7e740 1 --2- 172.21.15.123:0/577528880 >> [v2:172.21.15.164:6834/1946746019,v1:172.21.15.164:6835/1946746019] conn(0x5592bf5317b0 0x5592bf555c10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.037+0000 7f584ea7e740 1 --2- 172.21.15.123:0/577528880 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5592bf52b970 0x5592bf54a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.037+0000 7f582a000640 0 client.4368 ms_handle_reset on v2:172.21.15.164:6834/1946746019 2024-04-17T05:27:01.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.037+0000 7f584ea7e740 1 -- 172.21.15.123:0/577528880 >> 172.21.15.123:0/577528880 conn(0x5592bf507300 msgr2=0x5592bf5076e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:01.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.037+0000 7f584ea7e740 1 -- 172.21.15.123:0/577528880 shutdown_connections 2024-04-17T05:27:01.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.037+0000 7f584ea7e740 1 -- 172.21.15.123:0/577528880 wait complete. 2024-04-17T05:27:01.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.037+0000 7f584ea7e740 20 client.4368 trim_cache size 0 max 16384 2024-04-17T05:27:01.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.058+0000 7f584ea7e740 1 Processor -- start 2024-04-17T05:27:01.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.058+0000 7f584ea7e740 1 -- start start 2024-04-17T05:27:01.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.059+0000 7f584ea7e740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5592bf52b970 0x5592bf506870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:01.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.059+0000 7f584ea7e740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5592bf52ffe0 0x5592bf5321e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:01.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.059+0000 7f584ea7e740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5592bf53d100 0x5592bf53bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:01.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.059+0000 7f584ea7e740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f58441ebb70 con 0x5592bf53d100 2024-04-17T05:27:01.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.059+0000 7f584ea7e740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f58441eacb0 con 0x5592bf52ffe0 2024-04-17T05:27:01.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.059+0000 7f584ea7e740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x5592bf52c6a0 con 0x5592bf52b970 2024-04-17T05:27:01.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.059+0000 7f5849e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5592bf53d100 0x5592bf53bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:01.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.059+0000 7f5849e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5592bf53d100 0x5592bf53bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50470/0 (socket says 172.21.15.123:50470) 2024-04-17T05:27:01.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.059+0000 7f5849e00640 1 -- 172.21.15.123:0/1441627401 learned_addr learned my addr 172.21.15.123:0/1441627401 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:01.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.059+0000 7f5849e00640 1 -- 172.21.15.123:0/1441627401 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5592bf52b970 msgr2=0x5592bf506870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:01.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.059+0000 7f5849e00640 1 --2- 172.21.15.123:0/1441627401 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5592bf52b970 0x5592bf506870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.059+0000 7f5849e00640 1 -- 172.21.15.123:0/1441627401 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5592bf52ffe0 msgr2=0x5592bf5321e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:01.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.059+0000 7f5849e00640 1 --2- 172.21.15.123:0/1441627401 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5592bf52ffe0 0x5592bf5321e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.059+0000 7f5849e00640 1 -- 172.21.15.123:0/1441627401 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592bf530f70 con 0x5592bf53d100 2024-04-17T05:27:01.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.060+0000 7f5849e00640 1 --2- 172.21.15.123:0/1441627401 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5592bf53d100 0x5592bf53bda0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f583c007330 tx=0x7f583c00b030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a947076a49b76b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:01.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.060+0000 7f5835200640 1 -- 172.21.15.123:0/1441627401 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583c039040 con 0x5592bf53d100 2024-04-17T05:27:01.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.060+0000 7f5835200640 1 -- 172.21.15.123:0/1441627401 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f583c04c070 con 0x5592bf53d100 2024-04-17T05:27:01.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.060+0000 7f5835200640 1 -- 172.21.15.123:0/1441627401 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583c003bd0 con 0x5592bf53d100 2024-04-17T05:27:01.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.061+0000 7f584ea7e740 1 -- 172.21.15.123:0/1441627401 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5592bf53d100 msgr2=0x5592bf53bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:01.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.061+0000 7f584ea7e740 1 --2- 172.21.15.123:0/1441627401 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5592bf53d100 0x5592bf53bda0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f583c007330 tx=0x7f583c00b030 comp rx=0 tx=0).stop 2024-04-17T05:27:01.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.061+0000 7f584ea7e740 1 -- 172.21.15.123:0/1441627401 shutdown_connections 2024-04-17T05:27:01.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.061+0000 7f584ea7e740 1 --2- 172.21.15.123:0/1441627401 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5592bf53d100 0x5592bf53bda0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.061+0000 7f584ea7e740 1 --2- 172.21.15.123:0/1441627401 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5592bf52ffe0 0x5592bf5321e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.061+0000 7f584ea7e740 1 --2- 172.21.15.123:0/1441627401 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5592bf52b970 0x5592bf506870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.061+0000 7f584ea7e740 1 -- 172.21.15.123:0/1441627401 >> 172.21.15.123:0/1441627401 conn(0x5592bf507300 msgr2=0x5592bf503bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:01.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.061+0000 7f584ea7e740 1 -- 172.21.15.123:0/1441627401 shutdown_connections 2024-04-17T05:27:01.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.061+0000 7f584ea7e740 1 -- 172.21.15.123:0/1441627401 wait complete. 2024-04-17T05:27:01.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.061+0000 7f584ea7e740 1 -- start start 2024-04-17T05:27:01.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.062+0000 7f584ea7e740 1 Processor -- start 2024-04-17T05:27:01.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.062+0000 7f584ea7e740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5592bf52b970 0x5592bf5b4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:01.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.062+0000 7f584ea7e740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5592bf52ffe0 0x5592bf5aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:01.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.062+0000 7f584ea7e740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5592bf53d100 0x5592bf5aafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:01.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.062+0000 7f584ea7e740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5592bf505830 con 0x5592bf53d100 2024-04-17T05:27:01.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.062+0000 7f584ea7e740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x5592bf52acb0 con 0x5592bf52b970 2024-04-17T05:27:01.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.062+0000 7f584ea7e740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x5592bf5b4f90 con 0x5592bf52ffe0 2024-04-17T05:27:01.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.063+0000 7f584ea7e740 10 client.0 _ll_register_callbacks cb 0x7f5830007c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-17T05:27:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.063+0000 7f5849e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5592bf53d100 0x5592bf5aafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.063+0000 7f5849e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5592bf53d100 0x5592bf5aafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50474/0 (socket says 172.21.15.123:50474) 2024-04-17T05:27:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.063+0000 7f5849e00640 1 -- 172.21.15.123:0/3571691038 learned_addr learned my addr 172.21.15.123:0/3571691038 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.063+0000 7f5849400640 1 --2- 172.21.15.123:0/3571691038 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5592bf52b970 0x5592bf5b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.063+0000 7f5848a00640 1 --2- 172.21.15.123:0/3571691038 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5592bf52ffe0 0x5592bf5aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.063+0000 7f5849e00640 1 -- 172.21.15.123:0/3571691038 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5592bf52ffe0 msgr2=0x5592bf5aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.063+0000 7f5849e00640 1 --2- 172.21.15.123:0/3571691038 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5592bf52ffe0 0x5592bf5aaa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.063+0000 7f5849e00640 1 -- 172.21.15.123:0/3571691038 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5592bf52b970 msgr2=0x5592bf5b4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.063+0000 7f5849e00640 1 --2- 172.21.15.123:0/3571691038 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5592bf52b970 0x5592bf5b4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.063+0000 7f5849e00640 1 -- 172.21.15.123:0/3571691038 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592bf55ab60 con 0x5592bf53d100 2024-04-17T05:27:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.063+0000 7f5849e00640 1 --2- 172.21.15.123:0/3571691038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5592bf53d100 0x5592bf5aafc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f583c049040 tx=0x7f583c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adbe4fda1be2626c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.063+0000 7f582a000640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-04-17T05:27:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.064+0000 7f582a000640 1 -- 172.21.15.123:0/3571691038 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583c039070 con 0x5592bf53d100 2024-04-17T05:27:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.064+0000 7f582a000640 1 -- 172.21.15.123:0/3571691038 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f583c009c60 con 0x5592bf53d100 2024-04-17T05:27:01.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.064+0000 7f584ea7e740 1 -- 172.21.15.123:0/3571691038 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f583c04c070 con 0x5592bf53d100 2024-04-17T05:27:01.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.064+0000 7f582a000640 1 -- 172.21.15.123:0/3571691038 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f583c05d050 con 0x5592bf53d100 2024-04-17T05:27:01.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.064+0000 7f584ea7e740 10 client.4374 fetch_fsmap learned FSMap version 7 2024-04-17T05:27:01.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.064+0000 7f584ea7e740 1 -- 172.21.15.123:0/3571691038 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x5592bf5b4d90 con 0x5592bf53d100 2024-04-17T05:27:01.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.064+0000 7f582a000640 1 -- 172.21.15.123:0/3571691038 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f583c04c070 con 0x5592bf53d100 2024-04-17T05:27:01.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.064+0000 7f582a000640 1 -- 172.21.15.123:0/3571691038 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 7) ==== 2293+0+0 (secure 0 0 0) 0x7f583c060020 con 0x5592bf53d100 2024-04-17T05:27:01.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.064+0000 7f584ea7e740 10 client.4374 fetch_fsmap finished waiting for FSMap version 7 2024-04-17T05:27:01.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.064+0000 7f584ea7e740 10 client.4374 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-17T05:27:01.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.064+0000 7f584ea7e740 20 client.4374 populate_metadata read hostname 'smithi123' 2024-04-17T05:27:01.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.064+0000 7f584ea7e740 1 --2- 172.21.15.123:0/3571691038 >> [v2:172.21.15.164:6834/1946746019,v1:172.21.15.164:6835/1946746019] conn(0x5592bf5ab660 0x5592bf5b1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:01.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.064+0000 7f584ea7e740 4 client.4374 mds_command: new command op to 4243 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-17T05:27:01.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.064+0000 7f584ea7e740 1 -- 172.21.15.123:0/3571691038 --> [v2:172.21.15.164:6834/1946746019,v1:172.21.15.164:6835/1946746019] -- command(tid 0: {"prefix": "status"}) -- 0x5592bf476210 con 0x5592bf5ab660 2024-04-17T05:27:01.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.065+0000 7f5849400640 1 --2- 172.21.15.123:0/3571691038 >> [v2:172.21.15.164:6834/1946746019,v1:172.21.15.164:6835/1946746019] conn(0x5592bf5ab660 0x5592bf5b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:01.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.066+0000 7f5849400640 1 --2- 172.21.15.123:0/3571691038 >> [v2:172.21.15.164:6834/1946746019,v1:172.21.15.164:6835/1946746019] conn(0x5592bf5ab660 0x5592bf5b1120 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a52d3a8064051f9e server_cookie=7598ac731e62731c in_seq=0 out_seq=0 2024-04-17T05:27:01.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.066+0000 7f582a000640 10 client.4374 ms_handle_connect on v2:172.21.15.164:6834/1946746019 2024-04-17T05:27:01.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.067+0000 7f582a000640 1 -- 172.21.15.123:0/3571691038 <== mds.0 v2:172.21.15.164:6834/1946746019 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x5592bf476210 con 0x5592bf5ab660 2024-04-17T05:27:01.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.067+0000 7f582a000640 10 client.4374 handle_command_reply: tid=0 2024-04-17T05:27:01.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.067+0000 7f584ea7e740 1 client.4374 shutdown 2024-04-17T05:27:01.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.067+0000 7f584ea7e740 1 -- 172.21.15.123:0/3571691038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5592bf53d100 msgr2=0x5592bf5aafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:01.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.067+0000 7f584ea7e740 1 --2- 172.21.15.123:0/3571691038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5592bf53d100 0x5592bf5aafc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f583c049040 tx=0x7f583c004a40 comp rx=0 tx=0).stop 2024-04-17T05:27:01.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.067+0000 7f584ea7e740 1 -- 172.21.15.123:0/3571691038 shutdown_connections 2024-04-17T05:27:01.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.067+0000 7f584ea7e740 1 --2- 172.21.15.123:0/3571691038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5592bf53d100 0x5592bf5aafc0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.067+0000 7f584ea7e740 1 --2- 172.21.15.123:0/3571691038 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5592bf52ffe0 0x5592bf5aaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.067+0000 7f584ea7e740 1 --2- 172.21.15.123:0/3571691038 >> [v2:172.21.15.164:6834/1946746019,v1:172.21.15.164:6835/1946746019] conn(0x5592bf5ab660 0x5592bf5b1120 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.067+0000 7f584ea7e740 1 --2- 172.21.15.123:0/3571691038 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5592bf52b970 0x5592bf5b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.067+0000 7f584ea7e740 1 -- 172.21.15.123:0/3571691038 >> 172.21.15.123:0/3571691038 conn(0x5592bf507300 msgr2=0x5592bf531d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:01.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.067+0000 7f582a000640 0 client.4374 ms_handle_reset on v2:172.21.15.164:6834/1946746019 2024-04-17T05:27:01.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.067+0000 7f584ea7e740 1 -- 172.21.15.123:0/3571691038 shutdown_connections 2024-04-17T05:27:01.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.067+0000 7f584ea7e740 1 -- 172.21.15.123:0/3571691038 wait complete. 2024-04-17T05:27:01.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.067+0000 7f584ea7e740 20 client.4374 trim_cache size 0 max 16384 2024-04-17T05:27:01.068 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-04-17T05:27:01.068 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "0787c5c0-e77a-4102-a899-30db48b19c68", 2024-04-17T05:27:01.068 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-04-17T05:27:01.068 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 4243, 2024-04-17T05:27:01.068 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-04-17T05:27:01.068 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-04-17T05:27:01.068 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-04-17T05:27:01.069 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 7.8511890989999999, 2024-04-17T05:27:01.069 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 7, 2024-04-17T05:27:01.069 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 26, 2024-04-17T05:27:01.069 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 25, 2024-04-17T05:27:01.069 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 15.501840335000001 2024-04-17T05:27:01.069 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-04-17T05:27:01.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.068+0000 7f584be00640 1 -- 172.21.15.123:0/1003090001 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f582406c8f0 msgr2=0x7f582406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:01.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.068+0000 7f584be00640 1 --2- 172.21.15.123:0/1003090001 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f582406c8f0 0x7f582406edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5830007fd0 tx=0x7f5830009040 comp rx=0 tx=0).stop 2024-04-17T05:27:01.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.068+0000 7f584be00640 1 -- 172.21.15.123:0/1003090001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f582c004d40 msgr2=0x7f58441e1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:01.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.068+0000 7f584be00640 1 --2- 172.21.15.123:0/1003090001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f582c004d40 0x7f58441e1110 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f583800e840 tx=0x7f583800ed00 comp rx=0 tx=0).stop 2024-04-17T05:27:01.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.068+0000 7f584be00640 1 -- 172.21.15.123:0/1003090001 shutdown_connections 2024-04-17T05:27:01.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.068+0000 7f584be00640 1 --2- 172.21.15.123:0/1003090001 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f582406c8f0 0x7f582406edb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.068+0000 7f584be00640 1 --2- 172.21.15.123:0/1003090001 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f58441e1ad0 0x7f5844140040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.068+0000 7f584be00640 1 --2- 172.21.15.123:0/1003090001 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f58441e1650 0x7f584413fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.068+0000 7f584be00640 1 --2- 172.21.15.123:0/1003090001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f582c004d40 0x7f58441e1110 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.068+0000 7f584be00640 1 -- 172.21.15.123:0/1003090001 >> 172.21.15.123:0/1003090001 conn(0x7f58440b93b0 msgr2=0x7f5844146630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:01.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.068+0000 7f584be00640 1 -- 172.21.15.123:0/1003090001 shutdown_connections 2024-04-17T05:27:01.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.068+0000 7f584be00640 1 -- 172.21.15.123:0/1003090001 wait complete. 2024-04-17T05:27:01.085 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-17T05:27:01.085 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-17T05:27:01.085 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-17T05:27:01.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.288+0000 7f9c06000640 1 Processor -- start 2024-04-17T05:27:01.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.288+0000 7f9c06000640 1 -- start start 2024-04-17T05:27:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.289+0000 7f9c06000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9c000b3dc0 0x7f9c00147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.289+0000 7f9c06000640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9c00148420 0x7f9c0013e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.289+0000 7f9c06000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c000b5910 con 0x7f9c0013e920 2024-04-17T05:27:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.289+0000 7f9c06000640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f9c000b2c80 con 0x7f9c000b3dc0 2024-04-17T05:27:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.289+0000 7f9c06000640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f9c000708c0 con 0x7f9c00148420 2024-04-17T05:27:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.289+0000 7f9c04c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9c000b3dc0 0x7f9c00147ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.289+0000 7f9c05600640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9c0013e920 0x7f9c000b0650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59124/0 (socket says 172.21.15.123:59124) 2024-04-17T05:27:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.289+0000 7f9c05600640 1 -- 172.21.15.123:0/1528578811 learned_addr learned my addr 172.21.15.123:0/1528578811 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:27:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.290+0000 7f9bf7e00640 1 --2- 172.21.15.123:0/1528578811 >> v2:172.21.15.164:3300/0 conn(0x7f9c00148420 0x7f9c0013e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.290+0000 7f9c04c00640 1 -- 172.21.15.123:0/1528578811 >> v2:172.21.15.164:3300/0 conn(0x7f9c00148420 msgr2=0x7f9c0013e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.290+0000 7f9c04c00640 1 --2- 172.21.15.123:0/1528578811 >> v2:172.21.15.164:3300/0 conn(0x7f9c00148420 0x7f9c0013e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.290+0000 7f9c04c00640 1 -- 172.21.15.123:0/1528578811 >> v1:172.21.15.123:6789/0 conn(0x7f9c0013e920 legacy=0x7f9c000b0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:01.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.290+0000 7f9c04c00640 1 -- 172.21.15.123:0/1528578811 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c000b1870 con 0x7f9c000b3dc0 2024-04-17T05:27:01.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.290+0000 7f9bffe00640 1 -- 172.21.15.123:0/1528578811 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3275788387 0 0) 0x7f9c000b5910 con 0x7f9c0013e920 2024-04-17T05:27:01.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.291+0000 7f9c04c00640 1 --2- 172.21.15.123:0/1528578811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c000b3dc0 0x7f9c00147ee0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9c00068680 tx=0x7f9be802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8273bc48eecfd7cf server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:01.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.291+0000 7f9bffe00640 1 -- 172.21.15.123:0/1528578811 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be80315a0 con 0x7f9c000b3dc0 2024-04-17T05:27:01.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.291+0000 7f9bffe00640 1 -- 172.21.15.123:0/1528578811 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9be8037070 con 0x7f9c000b3dc0 2024-04-17T05:27:01.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.291+0000 7f9bffe00640 1 -- 172.21.15.123:0/1528578811 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be8031960 con 0x7f9c000b3dc0 2024-04-17T05:27:01.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.292+0000 7f9c06000640 1 -- 172.21.15.123:0/1528578811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c000b3dc0 msgr2=0x7f9c00147ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:01.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.292+0000 7f9c06000640 1 --2- 172.21.15.123:0/1528578811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c000b3dc0 0x7f9c00147ee0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9c00068680 tx=0x7f9be802b840 comp rx=0 tx=0).stop 2024-04-17T05:27:01.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.292+0000 7f9c06000640 1 -- 172.21.15.123:0/1528578811 shutdown_connections 2024-04-17T05:27:01.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.292+0000 7f9c06000640 1 --2- 172.21.15.123:0/1528578811 >> v2:172.21.15.164:3300/0 conn(0x7f9c00148420 0x7f9c0013e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.292+0000 7f9c06000640 1 --2- 172.21.15.123:0/1528578811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c000b3dc0 0x7f9c00147ee0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.292+0000 7f9c06000640 1 -- 172.21.15.123:0/1528578811 >> 172.21.15.123:0/1528578811 conn(0x7f9c000b9150 msgr2=0x7f9c000b9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:01.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.292+0000 7f9c06000640 1 -- 172.21.15.123:0/1528578811 shutdown_connections 2024-04-17T05:27:01.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.292+0000 7f9c06000640 1 -- 172.21.15.123:0/1528578811 wait complete. 2024-04-17T05:27:01.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.294+0000 7f9c06000640 1 Processor -- start 2024-04-17T05:27:01.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.294+0000 7f9c06000640 1 -- start start 2024-04-17T05:27:01.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.295+0000 7f9c06000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c000b3dc0 0x7f9c000b8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:01.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.295+0000 7f9c06000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c0013e920 0x7f9c001ced80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:01.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.295+0000 7f9c06000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c00148420 0x7f9c001411c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:01.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.295+0000 7f9c06000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9c000b2ed0 con 0x7f9c000b3dc0 2024-04-17T05:27:01.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.295+0000 7f9c06000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9c00148880 con 0x7f9c0013e920 2024-04-17T05:27:01.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.295+0000 7f9c06000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f9c000b1b10 con 0x7f9c00148420 2024-04-17T05:27:01.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.295+0000 7f9c04c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c000b3dc0 0x7f9c000b8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:01.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.295+0000 7f9c04c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c000b3dc0 0x7f9c000b8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50502/0 (socket says 172.21.15.123:50502) 2024-04-17T05:27:01.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.295+0000 7f9c04c00640 1 -- 172.21.15.123:0/1400322483 learned_addr learned my addr 172.21.15.123:0/1400322483 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:01.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.296+0000 7f9c05600640 1 --2- 172.21.15.123:0/1400322483 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c00148420 0x7f9c001411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:01.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.296+0000 7f9bf7e00640 1 --2- 172.21.15.123:0/1400322483 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c0013e920 0x7f9c001ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:01.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.296+0000 7f9c04c00640 1 -- 172.21.15.123:0/1400322483 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c00148420 msgr2=0x7f9c001411c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:01.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.296+0000 7f9c04c00640 1 --2- 172.21.15.123:0/1400322483 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c00148420 0x7f9c001411c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.296+0000 7f9c04c00640 1 -- 172.21.15.123:0/1400322483 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c0013e920 msgr2=0x7f9c001ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:01.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.296+0000 7f9c04c00640 1 --2- 172.21.15.123:0/1400322483 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c0013e920 0x7f9c001ced80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.296+0000 7f9c04c00640 1 -- 172.21.15.123:0/1400322483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c00145890 con 0x7f9c000b3dc0 2024-04-17T05:27:01.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.296+0000 7f9c04c00640 1 --2- 172.21.15.123:0/1400322483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c000b3dc0 0x7f9c000b8850 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9be8009890 tx=0x7f9be80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:01.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.296+0000 7f9bfd600640 1 -- 172.21.15.123:0/1400322483 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be8032630 con 0x7f9c000b3dc0 2024-04-17T05:27:01.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.296+0000 7f9bfd600640 1 -- 172.21.15.123:0/1400322483 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9be80327d0 con 0x7f9c000b3dc0 2024-04-17T05:27:01.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.296+0000 7f9bfd600640 1 -- 172.21.15.123:0/1400322483 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be8032ba0 con 0x7f9c000b3dc0 2024-04-17T05:27:01.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.296+0000 7f9c06000640 1 -- 172.21.15.123:0/1400322483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c001cf500 con 0x7f9c000b3dc0 2024-04-17T05:27:01.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.296+0000 7f9c06000640 1 -- 172.21.15.123:0/1400322483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c001ce360 con 0x7f9c000b3dc0 2024-04-17T05:27:01.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.298+0000 7f9c06000640 1 -- 172.21.15.123:0/1400322483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c000759b0 con 0x7f9c000b3dc0 2024-04-17T05:27:01.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.298+0000 7f9bfd600640 1 -- 172.21.15.123:0/1400322483 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9be804c020 con 0x7f9c000b3dc0 2024-04-17T05:27:01.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.299+0000 7f9bfd600640 1 --2- 172.21.15.123:0/1400322483 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f9bdc06c8f0 0x7f9bdc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:01.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.300+0000 7f9bfd600640 1 -- 172.21.15.123:0/1400322483 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9be802f020 con 0x7f9c000b3dc0 2024-04-17T05:27:01.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.300+0000 7f9bf7e00640 1 --2- 172.21.15.123:0/1400322483 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f9bdc06c8f0 0x7f9bdc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:01.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.301+0000 7f9bf7e00640 1 --2- 172.21.15.123:0/1400322483 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f9bdc06c8f0 0x7f9bdc06edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9c00144960 tx=0x7f9bf0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:01.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.304+0000 7f9bfd600640 1 -- 172.21.15.123:0/1400322483 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f9be8040070 con 0x7f9c000b3dc0 2024-04-17T05:27:01.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.544+0000 7f9c06000640 1 -- 172.21.15.123:0/1400322483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9c00140320 con 0x7f9c000b3dc0 2024-04-17T05:27:01.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.545+0000 7f9bfd600640 1 -- 172.21.15.123:0/1400322483 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f9be807b650 con 0x7f9c000b3dc0 2024-04-17T05:27:01.543 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-17T05:27:01.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.547+0000 7f9c06000640 1 -- 172.21.15.123:0/1400322483 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f9bdc06c8f0 msgr2=0x7f9bdc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:01.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.547+0000 7f9c06000640 1 --2- 172.21.15.123:0/1400322483 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f9bdc06c8f0 0x7f9bdc06edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9c00144960 tx=0x7f9bf0008040 comp rx=0 tx=0).stop 2024-04-17T05:27:01.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.547+0000 7f9c06000640 1 -- 172.21.15.123:0/1400322483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c000b3dc0 msgr2=0x7f9c000b8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:01.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.547+0000 7f9c06000640 1 --2- 172.21.15.123:0/1400322483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c000b3dc0 0x7f9c000b8850 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9be8009890 tx=0x7f9be80046c0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.547+0000 7f9c06000640 1 -- 172.21.15.123:0/1400322483 shutdown_connections 2024-04-17T05:27:01.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.547+0000 7f9c06000640 1 --2- 172.21.15.123:0/1400322483 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f9bdc06c8f0 0x7f9bdc06edb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.547+0000 7f9c06000640 1 --2- 172.21.15.123:0/1400322483 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c00148420 0x7f9c001411c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.547+0000 7f9c06000640 1 --2- 172.21.15.123:0/1400322483 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c0013e920 0x7f9c001ced80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.547+0000 7f9c06000640 1 --2- 172.21.15.123:0/1400322483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c000b3dc0 0x7f9c000b8850 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:01.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.547+0000 7f9c06000640 1 -- 172.21.15.123:0/1400322483 >> 172.21.15.123:0/1400322483 conn(0x7f9c000b9150 msgr2=0x7f9c00142680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:01.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.548+0000 7f9c06000640 1 -- 172.21.15.123:0/1400322483 shutdown_connections 2024-04-17T05:27:01.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01.548+0000 7f9c06000640 1 -- 172.21.15.123:0/1400322483 wait complete. 2024-04-17T05:27:01.564 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-17T05:27:01.564 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-17T05:27:01.564 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-04-17T05:27:01.564 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-17T05:27:01.564 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-17T05:27:01.564 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-17T05:27:01.564 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-17T05:27:01.564 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-17T05:27:01.564 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-17T05:27:01.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T05:27:01.565 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-04-17T05:27:01.613 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-17T05:27:01.613 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-17T05:27:01.613 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-04-17T05:27:01.613 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-17T05:27:01.613 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-04-17T05:27:01.613 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-17T05:27:01.613 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-17T05:27:01.613 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-04-17T05:27:01.614 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2024-04-17T05:27:01.614 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-17T05:27:01.614 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-04-17T05:27:01.614 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2024-04-17T05:27:01.614 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-17T05:27:01.614 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-04-17T05:27:01.614 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-17T05:27:01.614 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-04-17T05:27:01.614 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-17T05:27:01.614 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42576sec preferred_lft 42576sec 2024-04-17T05:27:01.614 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link 2024-04-17T05:27:01.614 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-17T05:27:01.616 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-17T05:27:01.616 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T05:27:01.616 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-04-17T05:27:01.616 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add name ceph-brx type bridge 2024-04-17T05:27:01.616 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip addr flush dev ceph-brx 2024-04-17T05:27:01.616 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set ceph-brx up 2024-04-17T05:27:01.616 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-17T05:27:01.616 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-04-17T05:27:01.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T05:27:02.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T05:27:02.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T05:27:02.157 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-17T05:27:02.236 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-04-17T05:27:02.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T05:27:02.240 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-04-17T05:27:02.298 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-04-17T05:27:02.298 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-17T05:27:02.298 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-17T05:27:02.298 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-17T05:27:02.298 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-17T05:27:02.300 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T05:27:02.300 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-04-17T05:27:02.300 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-17T05:27:02.300 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-17T05:27:02.300 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-17T05:27:02.300 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-04-17T05:27:02.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T05:27:03.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T05:27:03.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T05:27:03.063 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-04-17T05:27:03.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T05:27:03.116 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list-id 2024-04-17T05:27:03.167 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T05:27:03.167 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-04-17T05:27:03.167 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-17T05:27:03.167 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-17T05:27:03.167 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-04-17T05:27:03.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T05:27:03.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T05:27:03.370 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-17T05:27:03.370 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T05:27:03.370 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-04-17T05:27:03.370 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-17T05:27:03.370 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-17T05:27:03.371 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-17T05:27:03.371 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-17T05:27:03.371 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-17T05:27:03.371 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-04-17T05:27:03.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T05:27:03.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T05:27:03.702 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T05:27:03.702 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-04-17T05:27:03.702 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-04-17T05:27:03.702 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set dev brx.0 master ceph-brx 2024-04-17T05:27:03.702 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-04-17T05:27:03.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T05:27:03.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T05:27:03.927 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-17T05:27:03.927 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-17T05:27:03.927 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-17T05:27:03.970 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-17T05:27:03.970 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-17T05:27:03.970 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-17T05:27:04.060 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2024-04-17T05:27:04.145 DEBUG:teuthology.orchestra.run.smithi123:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T05:27:04.197 INFO:teuthology.orchestra.run.smithi123.stdout:/proc 2024-04-17T05:27:04.197 INFO:teuthology.orchestra.run.smithi123.stdout:/sys 2024-04-17T05:27:04.197 INFO:teuthology.orchestra.run.smithi123.stdout:/dev 2024-04-17T05:27:04.197 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/kernel/security 2024-04-17T05:27:04.197 INFO:teuthology.orchestra.run.smithi123.stdout:/dev/shm 2024-04-17T05:27:04.197 INFO:teuthology.orchestra.run.smithi123.stdout:/dev/pts 2024-04-17T05:27:04.197 INFO:teuthology.orchestra.run.smithi123.stdout:/run 2024-04-17T05:27:04.198 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/cgroup 2024-04-17T05:27:04.198 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/pstore 2024-04-17T05:27:04.198 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/bpf 2024-04-17T05:27:04.198 INFO:teuthology.orchestra.run.smithi123.stdout:/ 2024-04-17T05:27:04.198 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/selinux 2024-04-17T05:27:04.198 INFO:teuthology.orchestra.run.smithi123.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T05:27:04.198 INFO:teuthology.orchestra.run.smithi123.stdout:/dev/hugepages 2024-04-17T05:27:04.198 INFO:teuthology.orchestra.run.smithi123.stdout:/dev/mqueue 2024-04-17T05:27:04.198 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/kernel/debug 2024-04-17T05:27:04.198 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/kernel/tracing 2024-04-17T05:27:04.198 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/fuse/connections 2024-04-17T05:27:04.198 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/kernel/config 2024-04-17T05:27:04.198 INFO:teuthology.orchestra.run.smithi123.stdout:/run/credentials/systemd-sysctl.service 2024-04-17T05:27:04.198 INFO:teuthology.orchestra.run.smithi123.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-17T05:27:04.199 INFO:teuthology.orchestra.run.smithi123.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-17T05:27:04.199 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/nfs/rpc_pipefs 2024-04-17T05:27:04.199 INFO:teuthology.orchestra.run.smithi123.stdout:/run/user/1000 2024-04-17T05:27:04.199 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/ceph 2024-04-17T05:27:04.199 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/ceph/osd/ceph-0 2024-04-17T05:27:04.199 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/ceph/osd/ceph-1 2024-04-17T05:27:04.199 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/ceph/osd/ceph-2 2024-04-17T05:27:04.199 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/ceph/osd/ceph-3 2024-04-17T05:27:04.199 INFO:teuthology.orchestra.run.smithi123.stdout:/run/netns 2024-04-17T05:27:04.199 INFO:teuthology.orchestra.run.smithi123.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-17T05:27:04.199 INFO:teuthology.orchestra.run.smithi123.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-17T05:27:04.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T05:27:04.200 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2024-04-17T05:27:04.246 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-17T05:27:04.247 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-17T05:27:04.251 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2024-04-17T05:27:04.327 DEBUG:teuthology.orchestra.run.smithi123:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T05:27:04.367 INFO:teuthology.orchestra.run.smithi123.stdout:/proc 2024-04-17T05:27:04.367 INFO:teuthology.orchestra.run.smithi123.stdout:/sys 2024-04-17T05:27:04.367 INFO:teuthology.orchestra.run.smithi123.stdout:/dev 2024-04-17T05:27:04.367 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/kernel/security 2024-04-17T05:27:04.367 INFO:teuthology.orchestra.run.smithi123.stdout:/dev/shm 2024-04-17T05:27:04.367 INFO:teuthology.orchestra.run.smithi123.stdout:/dev/pts 2024-04-17T05:27:04.367 INFO:teuthology.orchestra.run.smithi123.stdout:/run 2024-04-17T05:27:04.367 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/cgroup 2024-04-17T05:27:04.367 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/pstore 2024-04-17T05:27:04.367 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/bpf 2024-04-17T05:27:04.367 INFO:teuthology.orchestra.run.smithi123.stdout:/ 2024-04-17T05:27:04.368 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/selinux 2024-04-17T05:27:04.368 INFO:teuthology.orchestra.run.smithi123.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T05:27:04.368 INFO:teuthology.orchestra.run.smithi123.stdout:/dev/hugepages 2024-04-17T05:27:04.368 INFO:teuthology.orchestra.run.smithi123.stdout:/dev/mqueue 2024-04-17T05:27:04.368 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/kernel/debug 2024-04-17T05:27:04.368 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/kernel/tracing 2024-04-17T05:27:04.368 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/fuse/connections 2024-04-17T05:27:04.368 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/kernel/config 2024-04-17T05:27:04.368 INFO:teuthology.orchestra.run.smithi123.stdout:/run/credentials/systemd-sysctl.service 2024-04-17T05:27:04.368 INFO:teuthology.orchestra.run.smithi123.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-17T05:27:04.368 INFO:teuthology.orchestra.run.smithi123.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-17T05:27:04.368 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/nfs/rpc_pipefs 2024-04-17T05:27:04.368 INFO:teuthology.orchestra.run.smithi123.stdout:/run/user/1000 2024-04-17T05:27:04.368 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/ceph 2024-04-17T05:27:04.369 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/ceph/osd/ceph-0 2024-04-17T05:27:04.369 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/ceph/osd/ceph-1 2024-04-17T05:27:04.369 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/ceph/osd/ceph-2 2024-04-17T05:27:04.369 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/ceph/osd/ceph-3 2024-04-17T05:27:04.369 INFO:teuthology.orchestra.run.smithi123.stdout:/run/netns 2024-04-17T05:27:04.369 INFO:teuthology.orchestra.run.smithi123.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-17T05:27:04.369 INFO:teuthology.orchestra.run.smithi123.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-17T05:27:04.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T05:27:04.370 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2024-04-17T05:27:04.436 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi123.stderr:2024-04-17T05:27:04.438+0000 7f6773c38480 -1 init, newargv = 0x55ac85649240 newargc=15 2024-04-17T05:27:04.436 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi123.stderr:ceph-fuse[43441]: starting ceph client 2024-04-17T05:27:04.449 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi123.stderr:ceph-fuse[43441]: starting fuse 2024-04-17T05:27:04.456 INFO:teuthology.orchestra.run.smithi123.stdout:42 2024-04-17T05:27:04.456 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-04-17T05:27:04.457 DEBUG:teuthology.orchestra.run.smithi123:> sudo stdin-killer -- python3 -c ' 2024-04-17T05:27:04.457 DEBUG:teuthology.orchestra.run.smithi123:> import glob 2024-04-17T05:27:04.457 DEBUG:teuthology.orchestra.run.smithi123:> import re 2024-04-17T05:27:04.457 DEBUG:teuthology.orchestra.run.smithi123:> import os 2024-04-17T05:27:04.457 DEBUG:teuthology.orchestra.run.smithi123:> import subprocess 2024-04-17T05:27:04.457 DEBUG:teuthology.orchestra.run.smithi123:> 2024-04-17T05:27:04.457 DEBUG:teuthology.orchestra.run.smithi123:> def _find_admin_socket(client_name): 2024-04-17T05:27:04.457 DEBUG:teuthology.orchestra.run.smithi123:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-17T05:27:04.457 DEBUG:teuthology.orchestra.run.smithi123:> files = glob.glob(asok_path) 2024-04-17T05:27:04.457 DEBUG:teuthology.orchestra.run.smithi123:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-17T05:27:04.457 DEBUG:teuthology.orchestra.run.smithi123:> 2024-04-17T05:27:04.458 DEBUG:teuthology.orchestra.run.smithi123:> # Given a non-glob path, it better be there 2024-04-17T05:27:04.458 DEBUG:teuthology.orchestra.run.smithi123:> if "*" not in asok_path: 2024-04-17T05:27:04.458 DEBUG:teuthology.orchestra.run.smithi123:> assert(len(files) == 1) 2024-04-17T05:27:04.458 DEBUG:teuthology.orchestra.run.smithi123:> return files[0] 2024-04-17T05:27:04.458 DEBUG:teuthology.orchestra.run.smithi123:> 2024-04-17T05:27:04.458 DEBUG:teuthology.orchestra.run.smithi123:> for f in files: 2024-04-17T05:27:04.458 DEBUG:teuthology.orchestra.run.smithi123:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-17T05:27:04.458 DEBUG:teuthology.orchestra.run.smithi123:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-17T05:27:04.458 DEBUG:teuthology.orchestra.run.smithi123:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-17T05:27:04.458 DEBUG:teuthology.orchestra.run.smithi123:> contents = proc_f.read() 2024-04-17T05:27:04.458 DEBUG:teuthology.orchestra.run.smithi123:> if mountpoint in contents: 2024-04-17T05:27:04.458 DEBUG:teuthology.orchestra.run.smithi123:> return f 2024-04-17T05:27:04.458 DEBUG:teuthology.orchestra.run.smithi123:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-17T05:27:04.458 DEBUG:teuthology.orchestra.run.smithi123:> 2024-04-17T05:27:04.458 DEBUG:teuthology.orchestra.run.smithi123:> print(_find_admin_socket("client.admin")) 2024-04-17T05:27:04.458 DEBUG:teuthology.orchestra.run.smithi123:> ' 2024-04-17T05:27:04.655 INFO:teuthology.orchestra.run.smithi123.stdout:/var/run/ceph/ceph-client.admin.43441.asok 2024-04-17T05:27:04.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T05:27:04.672 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.43441.asok 2024-04-17T05:27:04.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T05:27:04.672 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.43441.asok status 2024-04-17T05:27:04.914 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-04-17T05:27:04.914 INFO:teuthology.orchestra.run.smithi123.stdout: "metadata": { 2024-04-17T05:27:04.914 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_sha1": "a8c84f5997950fd7d008204839253291d52e6eda", 2024-04-17T05:27:04.914 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_version": "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)", 2024-04-17T05:27:04.914 INFO:teuthology.orchestra.run.smithi123.stdout: "entity_id": "admin", 2024-04-17T05:27:04.914 INFO:teuthology.orchestra.run.smithi123.stdout: "hostname": "smithi123", 2024-04-17T05:27:04.914 INFO:teuthology.orchestra.run.smithi123.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-17T05:27:04.914 INFO:teuthology.orchestra.run.smithi123.stdout: "pid": "43441", 2024-04-17T05:27:04.915 INFO:teuthology.orchestra.run.smithi123.stdout: "root": "/" 2024-04-17T05:27:04.915 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-04-17T05:27:04.915 INFO:teuthology.orchestra.run.smithi123.stdout: "dentry_count": 0, 2024-04-17T05:27:04.915 INFO:teuthology.orchestra.run.smithi123.stdout: "dentry_pinned_count": 0, 2024-04-17T05:27:04.915 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 4392, 2024-04-17T05:27:04.915 INFO:teuthology.orchestra.run.smithi123.stdout: "inst": { 2024-04-17T05:27:04.915 INFO:teuthology.orchestra.run.smithi123.stdout: "name": { 2024-04-17T05:27:04.915 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "client", 2024-04-17T05:27:04.915 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 4392 2024-04-17T05:27:04.915 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-04-17T05:27:04.915 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": { 2024-04-17T05:27:04.915 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-04-17T05:27:04.915 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "192.168.0.1:0", 2024-04-17T05:27:04.916 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 3460308458 2024-04-17T05:27:04.916 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-04-17T05:27:04.916 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-04-17T05:27:04.916 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": { 2024-04-17T05:27:04.916 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-04-17T05:27:04.916 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "192.168.0.1:0", 2024-04-17T05:27:04.916 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 3460308458 2024-04-17T05:27:04.916 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-04-17T05:27:04.916 INFO:teuthology.orchestra.run.smithi123.stdout: "inst_str": "client.4392 192.168.0.1:0/3460308458", 2024-04-17T05:27:04.916 INFO:teuthology.orchestra.run.smithi123.stdout: "addr_str": "192.168.0.1:0/3460308458", 2024-04-17T05:27:04.916 INFO:teuthology.orchestra.run.smithi123.stdout: "inode_count": 1, 2024-04-17T05:27:04.916 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_epoch": 7, 2024-04-17T05:27:04.916 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_epoch": 26, 2024-04-17T05:27:04.916 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_epoch_barrier": 0, 2024-04-17T05:27:04.916 INFO:teuthology.orchestra.run.smithi123.stdout: "blocklisted": false, 2024-04-17T05:27:04.917 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs" 2024-04-17T05:27:04.917 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-04-17T05:27:04.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T05:27:04.929 DEBUG:teuthology.orchestra.run.smithi123:> stat --file-system '--printf=%T 2024-04-17T05:27:04.929 DEBUG:teuthology.orchestra.run.smithi123:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-17T05:27:04.982 INFO:teuthology.orchestra.run.smithi123.stdout:fuseblk 2024-04-17T05:27:04.982 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-17T05:27:04.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T05:27:04.982 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-17T05:27:05.075 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-17T05:27:05.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-17T05:27:05.232 INFO:teuthology.orchestra.run.smithi123.stdout:# file: . 2024-04-17T05:27:05.232 INFO:teuthology.orchestra.run.smithi123.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-17T05:27:05.232 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:27:05.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T05:27:05.242 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-17T05:27:05.243 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T05:27:05.296 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T05:27:05.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.499+0000 7fac2be00640 1 Processor -- start 2024-04-17T05:27:05.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.499+0000 7fac2be00640 1 -- start start 2024-04-17T05:27:05.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.500+0000 7fac2be00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fac2c0b2ad0 0x7fac2c148de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:05.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.500+0000 7fac2be00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fac2c070940 0x7fac2c149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:05.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.500+0000 7fac2be00640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac2c0b2eb0 con 0x7fac2c13f1f0 2024-04-17T05:27:05.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.500+0000 7fac2be00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7fac2c071cf0 con 0x7fac2c070940 2024-04-17T05:27:05.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.500+0000 7fac2be00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fac2c0b4fa0 con 0x7fac2c0b2ad0 2024-04-17T05:27:05.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.501+0000 7fac2aa00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fac2c0b2ad0 0x7fac2c148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:05.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.501+0000 7fac2a000640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fac2c070940 0x7fac2c149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:05.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.501+0000 7fac2aa00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fac2c0b2ad0 0x7fac2c148de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.123:46242/0 (socket says 172.21.15.123:46242) 2024-04-17T05:27:05.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.501+0000 7fac2aa00640 1 -- 172.21.15.123:0/3859737142 learned_addr learned my addr 172.21.15.123:0/3859737142 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:05.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.501+0000 7fac2a000640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fac2c070940 0x7fac2c149320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.123:58994/0 (socket says 172.21.15.123:58994) 2024-04-17T05:27:05.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.502+0000 7fac2aa00640 1 -- 172.21.15.123:0/3859737142 >> v2:172.21.15.164:3300/0 conn(0x7fac2c070940 msgr2=0x7fac2c149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:05.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.502+0000 7fac2aa00640 1 --2- 172.21.15.123:0/3859737142 >> v2:172.21.15.164:3300/0 conn(0x7fac2c070940 0x7fac2c149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:05.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.502+0000 7fac2aa00640 1 -- 172.21.15.123:0/3859737142 >> v1:172.21.15.164:6789/0 conn(0x7fac2c13f1f0 legacy=0x7fac2c13f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:05.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.502+0000 7fac2aa00640 1 -- 172.21.15.123:0/3859737142 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac2c0b5280 con 0x7fac2c0b2ad0 2024-04-17T05:27:05.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.502+0000 7fac2a000640 1 --2- 172.21.15.123:0/3859737142 >> v2:172.21.15.164:3300/0 conn(0x7fac2c070940 0x7fac2c149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T05:27:05.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.503+0000 7fac2aa00640 1 --2- 172.21.15.123:0/3859737142 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fac2c0b2ad0 0x7fac2c148de0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fac1c009870 tx=0x7fac1c02b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=839cdb6dcfa2c8b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:05.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.504+0000 7fac29600640 1 -- 172.21.15.123:0/3859737142 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1c0317c0 con 0x7fac2c0b2ad0 2024-04-17T05:27:05.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.504+0000 7fac29600640 1 -- 172.21.15.123:0/3859737142 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac1c037070 con 0x7fac2c0b2ad0 2024-04-17T05:27:05.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.504+0000 7fac29600640 1 -- 172.21.15.123:0/3859737142 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1c031b80 con 0x7fac2c0b2ad0 2024-04-17T05:27:05.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.505+0000 7fac2be00640 1 -- 172.21.15.123:0/3859737142 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fac2c0b2ad0 msgr2=0x7fac2c148de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:05.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.505+0000 7fac2be00640 1 --2- 172.21.15.123:0/3859737142 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fac2c0b2ad0 0x7fac2c148de0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fac1c009870 tx=0x7fac1c02b860 comp rx=0 tx=0).stop 2024-04-17T05:27:05.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.505+0000 7fac2be00640 1 -- 172.21.15.123:0/3859737142 shutdown_connections 2024-04-17T05:27:05.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.505+0000 7fac2be00640 1 --2- 172.21.15.123:0/3859737142 >> v2:172.21.15.164:3300/0 conn(0x7fac2c070940 0x7fac2c149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:05.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.505+0000 7fac2be00640 1 --2- 172.21.15.123:0/3859737142 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fac2c0b2ad0 0x7fac2c148de0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:05.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.505+0000 7fac2be00640 1 -- 172.21.15.123:0/3859737142 >> 172.21.15.123:0/3859737142 conn(0x7fac2c0b9150 msgr2=0x7fac2c0b9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:05.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.505+0000 7fac2be00640 1 -- 172.21.15.123:0/3859737142 shutdown_connections 2024-04-17T05:27:05.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.505+0000 7fac2be00640 1 -- 172.21.15.123:0/3859737142 wait complete. 2024-04-17T05:27:05.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.507+0000 7fac2be00640 1 Processor -- start 2024-04-17T05:27:05.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.507+0000 7fac2be00640 1 -- start start 2024-04-17T05:27:05.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.508+0000 7fac2be00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fac2c070940 0x7fac2c13d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:05.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.508+0000 7fac2be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac2c0b2ad0 0x7fac2c1469b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:05.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.508+0000 7fac2be00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac2c13f1f0 0x7fac2c146ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:05.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.508+0000 7fac2be00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fac2c150170 con 0x7fac2c13f1f0 2024-04-17T05:27:05.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.508+0000 7fac2be00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fac2c0b3560 con 0x7fac2c0b2ad0 2024-04-17T05:27:05.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.508+0000 7fac2be00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fac2c1502f0 con 0x7fac2c070940 2024-04-17T05:27:05.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.508+0000 7fac2b400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac2c13f1f0 0x7fac2c146ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:05.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.508+0000 7fac2b400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac2c13f1f0 0x7fac2c146ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47028/0 (socket says 172.21.15.123:47028) 2024-04-17T05:27:05.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.508+0000 7fac2b400640 1 -- 172.21.15.123:0/1507067202 learned_addr learned my addr 172.21.15.123:0/1507067202 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:05.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.509+0000 7fac2aa00640 1 --2- 172.21.15.123:0/1507067202 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fac2c070940 0x7fac2c13d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:05.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.509+0000 7fac2a000640 1 --2- 172.21.15.123:0/1507067202 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac2c0b2ad0 0x7fac2c1469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:05.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.509+0000 7fac2b400640 1 -- 172.21.15.123:0/1507067202 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fac2c070940 msgr2=0x7fac2c13d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:05.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.509+0000 7fac2b400640 1 --2- 172.21.15.123:0/1507067202 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fac2c070940 0x7fac2c13d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:05.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.509+0000 7fac2b400640 1 -- 172.21.15.123:0/1507067202 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac2c0b2ad0 msgr2=0x7fac2c1469b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:05.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.509+0000 7fac2b400640 1 --2- 172.21.15.123:0/1507067202 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac2c0b2ad0 0x7fac2c1469b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:05.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.509+0000 7fac2b400640 1 -- 172.21.15.123:0/1507067202 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac2c1409b0 con 0x7fac2c13f1f0 2024-04-17T05:27:05.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.509+0000 7fac2a000640 1 --2- 172.21.15.123:0/1507067202 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac2c0b2ad0 0x7fac2c1469b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T05:27:05.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.509+0000 7fac2b400640 1 --2- 172.21.15.123:0/1507067202 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac2c13f1f0 0x7fac2c146ef0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fac2400c730 tx=0x7fac2400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:05.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.510+0000 7fac23400640 1 -- 172.21.15.123:0/1507067202 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac24003b70 con 0x7fac2c13f1f0 2024-04-17T05:27:05.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.510+0000 7fac2be00640 1 -- 172.21.15.123:0/1507067202 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac2c140f00 con 0x7fac2c13f1f0 2024-04-17T05:27:05.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.510+0000 7fac23400640 1 -- 172.21.15.123:0/1507067202 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac24003d30 con 0x7fac2c13f1f0 2024-04-17T05:27:05.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.510+0000 7fac23400640 1 -- 172.21.15.123:0/1507067202 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac24005310 con 0x7fac2c13f1f0 2024-04-17T05:27:05.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.510+0000 7fac2be00640 1 -- 172.21.15.123:0/1507067202 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac2c140c20 con 0x7fac2c13f1f0 2024-04-17T05:27:05.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.511+0000 7fac2be00640 1 -- 172.21.15.123:0/1507067202 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac2c072270 con 0x7fac2c13f1f0 2024-04-17T05:27:05.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.512+0000 7fac23400640 1 -- 172.21.15.123:0/1507067202 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fac240054b0 con 0x7fac2c13f1f0 2024-04-17T05:27:05.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.513+0000 7fac23400640 1 --2- 172.21.15.123:0/1507067202 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fac0c06c920 0x7fac0c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:05.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.513+0000 7fac23400640 1 -- 172.21.15.123:0/1507067202 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fac2408bd70 con 0x7fac2c13f1f0 2024-04-17T05:27:05.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.514+0000 7fac2aa00640 1 --2- 172.21.15.123:0/1507067202 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fac0c06c920 0x7fac0c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:05.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.515+0000 7fac2aa00640 1 --2- 172.21.15.123:0/1507067202 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fac0c06c920 0x7fac0c06ede0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fac1c036000 tx=0x7fac1c03d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:05.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.519+0000 7fac23400640 1 -- 172.21.15.123:0/1507067202 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fac2c072270 con 0x7fac2c13f1f0 2024-04-17T05:27:05.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.718+0000 7fac2be00640 1 -- 172.21.15.123:0/1507067202 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fac2c0759b0 con 0x7fac2c13f1f0 2024-04-17T05:27:05.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.722+0000 7fac23400640 1 -- 172.21.15.123:0/1507067202 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18526 (secure 0 0 0) 0x7fac24059dc0 con 0x7fac2c13f1f0 2024-04-17T05:27:05.720 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:27:05.720 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":26,"fsid":"0787c5c0-e77a-4102-a899-30db48b19c68","created":"2024-04-17T05:26:33.031507+0000","modified":"2024-04-17T05:26:57.743352+0000","last_up_change":"2024-04-17T05:26:44.988433+0000","last_in_change":"2024-04-17T05:26:36.682131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T05:26:46.329778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T05:26:50.600195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T05:26:51.626498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T05:26:55.264044+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15c87cdb-9415-45a6-a2a6-ea6bec9daece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6801","nonce":840753170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6803","nonce":840753170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6807","nonce":840753170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6805","nonce":840753170}]},"public_addr":"172.21.15.123:6801/840753170","cluster_addr":"172.21.15.123:6803/840753170","heartbeat_back_addr":"172.21.15.123:6807/840753170","heartbeat_front_addr":"172.21.15.123:6805/840753170","state":["exists","up"]},{"osd":1,"uuid":"281751b5-486d-4845-b4aa-b308bf7cec62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6822","nonce":2231878927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6827","nonce":2231878927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6831","nonce":2231878927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6829","nonce":2231878927}]},"public_addr":"172.21.15.123:6822/2231878927","cluster_addr":"172.21.15.123:6827/2231878927","heartbeat_back_addr":"172.21.15.123:6831/2231878927","heartbeat_front_addr":"172.21.15.123:6829/2231878927","state":["exists","up"]},{"osd":2,"uuid":"b42257d3-bd20-4db5-aa37-1bf5c512d0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6817","nonce":754360844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6820","nonce":754360844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6825","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6826","nonce":754360844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6823","nonce":754360844}]},"public_addr":"172.21.15.123:6817/754360844","cluster_addr":"172.21.15.123:6820/754360844","heartbeat_back_addr":"172.21.15.123:6826/754360844","heartbeat_front_addr":"172.21.15.123:6823/754360844","state":["exists","up"]},{"osd":3,"uuid":"0f26b891-bbe6-478e-8dee-78e69bb48cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6809","nonce":2898088574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6811","nonce":2898088574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6815","nonce":2898088574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6813","nonce":2898088574}]},"public_addr":"172.21.15.123:6809/2898088574","cluster_addr":"172.21.15.123:6811/2898088574","heartbeat_back_addr":"172.21.15.123:6815/2898088574","heartbeat_front_addr":"172.21.15.123:6813/2898088574","state":["exists","up"]},{"osd":4,"uuid":"43e59318-2740-4625-9d64-eec1fd43c322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6801","nonce":606484349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6804","nonce":606484349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6812","nonce":606484349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6808","nonce":606484349}]},"public_addr":"172.21.15.164:6801/606484349","cluster_addr":"172.21.15.164:6804/606484349","heartbeat_back_addr":"172.21.15.164:6812/606484349","heartbeat_front_addr":"172.21.15.164:6808/606484349","state":["exists","up"]},{"osd":5,"uuid":"aaa3acf4-4adc-4337-aba3-363851d35310","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6805","nonce":1376989593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6809","nonce":1376989593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6815","nonce":1376989593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6813","nonce":1376989593}]},"public_addr":"172.21.15.164:6805/1376989593","cluster_addr":"172.21.15.164:6809/1376989593","heartbeat_back_addr":"172.21.15.164:6815/1376989593","heartbeat_front_addr":"172.21.15.164:6813/1376989593","state":["exists","up"]},{"osd":6,"uuid":"6f765b27-7377-4d81-9192-23a965651145","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6817","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6821","nonce":1594306924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6823","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6826","nonce":1594306924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6831","nonce":1594306924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6829","nonce":1594306924}]},"public_addr":"172.21.15.164:6821/1594306924","cluster_addr":"172.21.15.164:6826/1594306924","heartbeat_back_addr":"172.21.15.164:6831/1594306924","heartbeat_front_addr":"172.21.15.164:6829/1594306924","state":["exists","up"]},{"osd":7,"uuid":"5547394b-ec2f-4311-846d-369af4b1acf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6818","nonce":295402697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6819","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6820","nonce":295402697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6825","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6827","nonce":295402697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6824","nonce":295402697}]},"public_addr":"172.21.15.164:6818/295402697","cluster_addr":"172.21.15.164:6820/295402697","heartbeat_back_addr":"172.21.15.164:6827/295402697","heartbeat_front_addr":"172.21.15.164:6824/295402697","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.034807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.022201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.751897+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.850533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.083608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.047524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.314753+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.413586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T05:27:05.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.724+0000 7fac2be00640 1 -- 172.21.15.123:0/1507067202 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fac0c06c920 msgr2=0x7fac0c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:05.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.724+0000 7fac2be00640 1 --2- 172.21.15.123:0/1507067202 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fac0c06c920 0x7fac0c06ede0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fac1c036000 tx=0x7fac1c03d040 comp rx=0 tx=0).stop 2024-04-17T05:27:05.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.724+0000 7fac2be00640 1 -- 172.21.15.123:0/1507067202 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac2c13f1f0 msgr2=0x7fac2c146ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:05.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.724+0000 7fac2be00640 1 --2- 172.21.15.123:0/1507067202 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac2c13f1f0 0x7fac2c146ef0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fac2400c730 tx=0x7fac2400cbf0 comp rx=0 tx=0).stop 2024-04-17T05:27:05.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.724+0000 7fac2be00640 1 -- 172.21.15.123:0/1507067202 shutdown_connections 2024-04-17T05:27:05.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.724+0000 7fac2be00640 1 --2- 172.21.15.123:0/1507067202 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac2c13f1f0 0x7fac2c146ef0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:05.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.724+0000 7fac2be00640 1 --2- 172.21.15.123:0/1507067202 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac2c0b2ad0 0x7fac2c1469b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:05.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.724+0000 7fac2be00640 1 --2- 172.21.15.123:0/1507067202 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fac0c06c920 0x7fac0c06ede0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:05.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.724+0000 7fac2be00640 1 --2- 172.21.15.123:0/1507067202 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fac2c070940 0x7fac2c13d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:05.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.724+0000 7fac2be00640 1 -- 172.21.15.123:0/1507067202 >> 172.21.15.123:0/1507067202 conn(0x7fac2c0b9150 msgr2=0x7fac2c143f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:05.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.725+0000 7fac2be00640 1 -- 172.21.15.123:0/1507067202 shutdown_connections 2024-04-17T05:27:05.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.725+0000 7fac2be00640 1 -- 172.21.15.123:0/1507067202 wait complete. 2024-04-17T05:27:05.741 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T05:26:46.329778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T05:26:50.600195+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T05:26:51.626498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T05:26:55.264044+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T05:27:05.742 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T05:27:05.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.948+0000 7f85c7200640 1 Processor -- start 2024-04-17T05:27:05.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.948+0000 7f85c7200640 1 -- start start 2024-04-17T05:27:05.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.949+0000 7f85c7200640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f85c00b66c0 0x7f85c00b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:05.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.949+0000 7f85c7200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f85c00732e0 0x7f85c0073750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:05.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.950+0000 7f85c7200640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85c01400b0 con 0x7f85c00b5490 2024-04-17T05:27:05.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.950+0000 7f85c7200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f85c00b4ca0 con 0x7f85c00732e0 2024-04-17T05:27:05.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.950+0000 7f85c7200640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f85c00b6aa0 con 0x7f85c00b66c0 2024-04-17T05:27:05.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.950+0000 7f85c6800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f85c00732e0 0x7f85c0073750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:05.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.950+0000 7f85c6800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f85c00732e0 0x7f85c0073750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47044/0 (socket says 172.21.15.123:47044) 2024-04-17T05:27:05.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.950+0000 7f85c6800640 1 -- 172.21.15.123:0/3913346172 learned_addr learned my addr 172.21.15.123:0/3913346172 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:05.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.950+0000 7f85c5e00640 1 --2- 172.21.15.123:0/3913346172 >> v2:172.21.15.164:3300/0 conn(0x7f85c00b66c0 0x7f85c00b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:05.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.951+0000 7f85c6800640 1 -- 172.21.15.123:0/3913346172 >> v2:172.21.15.164:3300/0 conn(0x7f85c00b66c0 msgr2=0x7f85c00b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:05.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.951+0000 7f85c6800640 1 --2- 172.21.15.123:0/3913346172 >> v2:172.21.15.164:3300/0 conn(0x7f85c00b66c0 0x7f85c00b3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:05.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.951+0000 7f85c6800640 1 -- 172.21.15.123:0/3913346172 >> v1:172.21.15.164:6789/0 conn(0x7f85c00b5490 legacy=0x7f85c013f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:05.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.951+0000 7f85c6800640 1 -- 172.21.15.123:0/3913346172 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85c00b5af0 con 0x7f85c00732e0 2024-04-17T05:27:05.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.952+0000 7f85c6800640 1 --2- 172.21.15.123:0/3913346172 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85c00732e0 0x7f85c0073750 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f85c00b05e0 tx=0x7f85bc02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af5b8e8f0a6d2366 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:05.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.952+0000 7f85c4a00640 1 -- 172.21.15.123:0/3913346172 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc02c9f0 con 0x7f85c00732e0 2024-04-17T05:27:05.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.952+0000 7f85c4a00640 1 -- 172.21.15.123:0/3913346172 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85bc02cb90 con 0x7f85c00732e0 2024-04-17T05:27:05.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.952+0000 7f85c4a00640 1 -- 172.21.15.123:0/3913346172 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc0343f0 con 0x7f85c00732e0 2024-04-17T05:27:05.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.953+0000 7f85c7200640 1 -- 172.21.15.123:0/3913346172 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85c00732e0 msgr2=0x7f85c0073750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:05.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.953+0000 7f85c7200640 1 --2- 172.21.15.123:0/3913346172 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85c00732e0 0x7f85c0073750 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f85c00b05e0 tx=0x7f85bc02be50 comp rx=0 tx=0).stop 2024-04-17T05:27:05.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.953+0000 7f85c7200640 1 -- 172.21.15.123:0/3913346172 shutdown_connections 2024-04-17T05:27:05.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.953+0000 7f85c7200640 1 --2- 172.21.15.123:0/3913346172 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85c00732e0 0x7f85c0073750 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:05.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.953+0000 7f85c7200640 1 --2- 172.21.15.123:0/3913346172 >> v2:172.21.15.164:3300/0 conn(0x7f85c00b66c0 0x7f85c00b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:05.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.953+0000 7f85c7200640 1 -- 172.21.15.123:0/3913346172 >> 172.21.15.123:0/3913346172 conn(0x7f85c00b9a30 msgr2=0x7f85c00b5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:05.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.953+0000 7f85c7200640 1 -- 172.21.15.123:0/3913346172 shutdown_connections 2024-04-17T05:27:05.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.953+0000 7f85c7200640 1 -- 172.21.15.123:0/3913346172 wait complete. 2024-04-17T05:27:05.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.955+0000 7f85c7200640 1 Processor -- start 2024-04-17T05:27:05.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.955+0000 7f85c7200640 1 -- start start 2024-04-17T05:27:05.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.956+0000 7f85c7200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85c00732e0 0x7f85c0138fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:05.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.956+0000 7f85c7200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85c00b5490 0x7f85c0070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:05.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.956+0000 7f85c7200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85c00b66c0 0x7f85c01db9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:05.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.956+0000 7f85c7200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f85c01502a0 con 0x7f85c00b66c0 2024-04-17T05:27:05.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.956+0000 7f85c7200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f85c00b4930 con 0x7f85c00b5490 2024-04-17T05:27:05.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.956+0000 7f85c7200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f85c0150420 con 0x7f85c00732e0 2024-04-17T05:27:05.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.956+0000 7f85c6800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85c00b66c0 0x7f85c01db9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:05.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.956+0000 7f85c6800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85c00b66c0 0x7f85c01db9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47054/0 (socket says 172.21.15.123:47054) 2024-04-17T05:27:05.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.956+0000 7f85c6800640 1 -- 172.21.15.123:0/3958030074 learned_addr learned my addr 172.21.15.123:0/3958030074 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:05.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.956+0000 7f85c5e00640 1 --2- 172.21.15.123:0/3958030074 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85c00732e0 0x7f85c0138fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:05.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.956+0000 7f85c5400640 1 --2- 172.21.15.123:0/3958030074 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85c00b5490 0x7f85c0070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:05.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.956+0000 7f85c6800640 1 -- 172.21.15.123:0/3958030074 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85c00732e0 msgr2=0x7f85c0138fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:05.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.956+0000 7f85c6800640 1 --2- 172.21.15.123:0/3958030074 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85c00732e0 0x7f85c0138fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:05.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.956+0000 7f85c6800640 1 -- 172.21.15.123:0/3958030074 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85c00b5490 msgr2=0x7f85c0070bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:05.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.956+0000 7f85c6800640 1 --2- 172.21.15.123:0/3958030074 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85c00b5490 0x7f85c0070bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:05.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.957+0000 7f85c6800640 1 -- 172.21.15.123:0/3958030074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85c0140aa0 con 0x7f85c00b66c0 2024-04-17T05:27:05.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.957+0000 7f85c5400640 1 --2- 172.21.15.123:0/3958030074 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85c00b5490 0x7f85c0070bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:05.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.957+0000 7f85c6800640 1 --2- 172.21.15.123:0/3958030074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85c00b66c0 0x7f85c01db9b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f85bc036040 tx=0x7f85bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:05.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.957+0000 7f85ba000640 1 -- 172.21.15.123:0/3958030074 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc043020 con 0x7f85c00b66c0 2024-04-17T05:27:05.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.957+0000 7f85ba000640 1 -- 172.21.15.123:0/3958030074 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85bc03e450 con 0x7f85c00b66c0 2024-04-17T05:27:05.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.957+0000 7f85ba000640 1 -- 172.21.15.123:0/3958030074 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc009510 con 0x7f85c00b66c0 2024-04-17T05:27:05.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.957+0000 7f85c7200640 1 -- 172.21.15.123:0/3958030074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85c0071d20 con 0x7f85c00b66c0 2024-04-17T05:27:05.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.957+0000 7f85c7200640 1 -- 172.21.15.123:0/3958030074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85c0071980 con 0x7f85c00b66c0 2024-04-17T05:27:05.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.959+0000 7f85c7200640 1 -- 172.21.15.123:0/3958030074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85c0140820 con 0x7f85c00b66c0 2024-04-17T05:27:05.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.959+0000 7f85ba000640 1 -- 172.21.15.123:0/3958030074 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f85bc046020 con 0x7f85c00b66c0 2024-04-17T05:27:05.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.961+0000 7f85ba000640 1 --2- 172.21.15.123:0/3958030074 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f85a006c8f0 0x7f85a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:05.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.961+0000 7f85ba000640 1 -- 172.21.15.123:0/3958030074 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f85bc0ae650 con 0x7f85c00b66c0 2024-04-17T05:27:05.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.961+0000 7f85c5e00640 1 --2- 172.21.15.123:0/3958030074 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f85a006c8f0 0x7f85a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:05.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.963+0000 7f85c5e00640 1 --2- 172.21.15.123:0/3958030074 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f85a006c8f0 0x7f85a006edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f85b4006fd0 tx=0x7f85b4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:05.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:05.966+0000 7f85ba000640 1 -- 172.21.15.123:0/3958030074 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f85c0140820 con 0x7f85c00b66c0 2024-04-17T05:27:06.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.166+0000 7f85c7200640 1 -- 172.21.15.123:0/3958030074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f85c0075b30 con 0x7f85c00b66c0 2024-04-17T05:27:06.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.166+0000 7f85ba000640 1 -- 172.21.15.123:0/3958030074 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f85bc04d030 con 0x7f85c00b66c0 2024-04-17T05:27:06.165 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-04-17T05:27:06.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.169+0000 7f85c7200640 1 -- 172.21.15.123:0/3958030074 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f85a006c8f0 msgr2=0x7f85a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:06.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.169+0000 7f85c7200640 1 --2- 172.21.15.123:0/3958030074 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f85a006c8f0 0x7f85a006edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f85b4006fd0 tx=0x7f85b4008040 comp rx=0 tx=0).stop 2024-04-17T05:27:06.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.169+0000 7f85c7200640 1 -- 172.21.15.123:0/3958030074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85c00b66c0 msgr2=0x7f85c01db9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:06.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.169+0000 7f85c7200640 1 --2- 172.21.15.123:0/3958030074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85c00b66c0 0x7f85c01db9b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f85bc036040 tx=0x7f85bc004a40 comp rx=0 tx=0).stop 2024-04-17T05:27:06.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.169+0000 7f85c7200640 1 -- 172.21.15.123:0/3958030074 shutdown_connections 2024-04-17T05:27:06.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.169+0000 7f85c7200640 1 --2- 172.21.15.123:0/3958030074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85c00b66c0 0x7f85c01db9b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:06.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.169+0000 7f85c7200640 1 --2- 172.21.15.123:0/3958030074 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85c00b5490 0x7f85c0070bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:06.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.169+0000 7f85c7200640 1 --2- 172.21.15.123:0/3958030074 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f85a006c8f0 0x7f85a006edb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:06.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.169+0000 7f85c7200640 1 --2- 172.21.15.123:0/3958030074 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f85c00732e0 0x7f85c0138fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:06.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.169+0000 7f85c7200640 1 -- 172.21.15.123:0/3958030074 >> 172.21.15.123:0/3958030074 conn(0x7f85c00b9a30 msgr2=0x7f85c013ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:06.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.169+0000 7f85c7200640 1 -- 172.21.15.123:0/3958030074 shutdown_connections 2024-04-17T05:27:06.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.169+0000 7f85c7200640 1 -- 172.21.15.123:0/3958030074 wait complete. 2024-04-17T05:27:06.186 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T05:27:06.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.396+0000 7ff387c00640 1 Processor -- start 2024-04-17T05:27:06.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.396+0000 7ff387c00640 1 -- start start 2024-04-17T05:27:06.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.397+0000 7ff387c00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff3800b7e70 0x7ff3800b5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:06.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.397+0000 7ff387c00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3800b7330 con 0x7ff3800b61f0 2024-04-17T05:27:06.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.397+0000 7ff387c00640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff380147c80 con 0x7ff380141e50 2024-04-17T05:27:06.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.397+0000 7ff387c00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7ff3801422e0 con 0x7ff3800b7e70 2024-04-17T05:27:06.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.398+0000 7ff385200640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff3800b61f0 0x7ff380141740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36118/0 (socket says 172.21.15.123:36118) 2024-04-17T05:27:06.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.398+0000 7ff385200640 1 -- 172.21.15.123:0/276629142 learned_addr learned my addr 172.21.15.123:0/276629142 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:27:06.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.398+0000 7ff377e00640 1 --2- 172.21.15.123:0/276629142 >> v2:172.21.15.164:3300/0 conn(0x7ff3800b7e70 0x7ff3800b5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:06.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.398+0000 7ff37fe00640 1 -- 172.21.15.123:0/276629142 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2595583479 0 0) 0x7ff3800b7330 con 0x7ff3800b61f0 2024-04-17T05:27:06.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.398+0000 7ff37fe00640 1 -- 172.21.15.123:0/276629142 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff364003520 con 0x7ff3800b61f0 2024-04-17T05:27:06.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.398+0000 7ff37fe00640 1 -- 172.21.15.123:0/276629142 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1462040018 0 0) 0x7ff364003520 con 0x7ff3800b61f0 2024-04-17T05:27:06.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.398+0000 7ff37fe00640 1 -- 172.21.15.123:0/276629142 >> v2:172.21.15.164:3300/0 conn(0x7ff3800b7e70 msgr2=0x7ff3800b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:06.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.398+0000 7ff37fe00640 1 --2- 172.21.15.123:0/276629142 >> v2:172.21.15.164:3300/0 conn(0x7ff3800b7e70 0x7ff3800b5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:06.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.398+0000 7ff37fe00640 1 -- 172.21.15.123:0/276629142 >> v1:172.21.15.164:6789/0 conn(0x7ff380141e50 legacy=0x7ff3801524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:06.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.398+0000 7ff37fe00640 1 -- 172.21.15.123:0/276629142 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3800b65d0 con 0x7ff3800b61f0 2024-04-17T05:27:06.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.398+0000 7ff37fe00640 1 -- 172.21.15.123:0/276629142 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1042962670 0 0) 0x7ff370001670 con 0x7ff3800b61f0 2024-04-17T05:27:06.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.399+0000 7ff37fe00640 1 -- 172.21.15.123:0/276629142 >> v1:172.21.15.123:6789/0 conn(0x7ff3800b61f0 legacy=0x7ff380141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:06.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.399+0000 7ff37fe00640 1 --2- 172.21.15.123:0/276629142 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3640039b0 0x7ff364003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:06.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.399+0000 7ff37fe00640 1 --2- 172.21.15.123:0/276629142 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff364004800 0x7ff364004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:06.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.399+0000 7ff37fe00640 1 --2- 172.21.15.123:0/276629142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3640051c0 0x7ff36400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:06.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.399+0000 7ff37fe00640 1 -- 172.21.15.123:0/276629142 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff3801422e0 con 0x7ff3640051c0 2024-04-17T05:27:06.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.399+0000 7ff37fe00640 1 -- 172.21.15.123:0/276629142 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff36400c160 con 0x7ff3640039b0 2024-04-17T05:27:06.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.399+0000 7ff37fe00640 1 -- 172.21.15.123:0/276629142 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7ff36400c360 con 0x7ff364004800 2024-04-17T05:27:06.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.399+0000 7ff385c00640 1 --2- 172.21.15.123:0/276629142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3640051c0 0x7ff36400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:06.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.399+0000 7ff377e00640 1 --2- 172.21.15.123:0/276629142 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff364004800 0x7ff364004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:06.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.399+0000 7ff385200640 1 --2- 172.21.15.123:0/276629142 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3640039b0 0x7ff364003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:06.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.399+0000 7ff385c00640 1 -- 172.21.15.123:0/276629142 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff364004800 msgr2=0x7ff364004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:06.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.399+0000 7ff385c00640 1 --2- 172.21.15.123:0/276629142 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff364004800 0x7ff364004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:06.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.399+0000 7ff385c00640 1 -- 172.21.15.123:0/276629142 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3640039b0 msgr2=0x7ff364003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:06.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.399+0000 7ff385c00640 1 --2- 172.21.15.123:0/276629142 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3640039b0 0x7ff364003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:06.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.399+0000 7ff385c00640 1 -- 172.21.15.123:0/276629142 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff364003520 con 0x7ff3640051c0 2024-04-17T05:27:06.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.399+0000 7ff385200640 1 --2- 172.21.15.123:0/276629142 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3640039b0 0x7ff364003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:06.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.400+0000 7ff385c00640 1 -- 172.21.15.123:0/276629142 reap_dead start 2024-04-17T05:27:06.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.400+0000 7ff385c00640 1 --2- 172.21.15.123:0/276629142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3640051c0 0x7ff36400b9c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff378001e50 tx=0x7ff364005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee244ea16af0e57 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:06.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.401+0000 7ff37fe00640 1 -- 172.21.15.123:0/276629142 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff378001a70 con 0x7ff3640051c0 2024-04-17T05:27:06.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.401+0000 7ff37fe00640 1 -- 172.21.15.123:0/276629142 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff378003b90 con 0x7ff3640051c0 2024-04-17T05:27:06.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.401+0000 7ff37fe00640 1 -- 172.21.15.123:0/276629142 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3780050d0 con 0x7ff3640051c0 2024-04-17T05:27:06.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.401+0000 7ff387c00640 1 -- 172.21.15.123:0/276629142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3640051c0 msgr2=0x7ff36400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:06.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.401+0000 7ff387c00640 1 --2- 172.21.15.123:0/276629142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3640051c0 0x7ff36400b9c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff378001e50 tx=0x7ff364005830 comp rx=0 tx=0).stop 2024-04-17T05:27:06.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.401+0000 7ff387c00640 1 -- 172.21.15.123:0/276629142 shutdown_connections 2024-04-17T05:27:06.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.401+0000 7ff387c00640 1 --2- 172.21.15.123:0/276629142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3640051c0 0x7ff36400b9c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:06.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.401+0000 7ff387c00640 1 -- 172.21.15.123:0/276629142 >> 172.21.15.123:0/276629142 conn(0x7ff3800bd4f0 msgr2=0x7ff3800bd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:06.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.401+0000 7ff387c00640 1 -- 172.21.15.123:0/276629142 shutdown_connections 2024-04-17T05:27:06.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.401+0000 7ff387c00640 1 -- 172.21.15.123:0/276629142 wait complete. 2024-04-17T05:27:06.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.403+0000 7ff387c00640 1 Processor -- start 2024-04-17T05:27:06.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.403+0000 7ff387c00640 1 -- start start 2024-04-17T05:27:06.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.404+0000 7ff387c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3640051c0 0x7ff3801cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:06.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.404+0000 7ff387c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3801d1810 0x7ff3801d0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:06.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.404+0000 7ff387c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3800aa4e0 0x7ff38013f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:06.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.404+0000 7ff387c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff3800b75a0 con 0x7ff3640051c0 2024-04-17T05:27:06.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.404+0000 7ff387c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff380148260 con 0x7ff3800aa4e0 2024-04-17T05:27:06.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.404+0000 7ff387c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7ff3800b4dc0 con 0x7ff3801d1810 2024-04-17T05:27:06.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.404+0000 7ff385200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3640051c0 0x7ff3801cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:06.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.404+0000 7ff385200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3640051c0 0x7ff3801cdc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47074/0 (socket says 172.21.15.123:47074) 2024-04-17T05:27:06.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.404+0000 7ff385200640 1 -- 172.21.15.123:0/3131535727 learned_addr learned my addr 172.21.15.123:0/3131535727 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:06.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.405+0000 7ff385200640 1 -- 172.21.15.123:0/3131535727 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3801d1810 msgr2=0x7ff3801d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:06.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.405+0000 7ff385c00640 1 --2- 172.21.15.123:0/3131535727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3800aa4e0 0x7ff38013f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:06.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.405+0000 7ff377e00640 1 --2- 172.21.15.123:0/3131535727 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3801d1810 0x7ff3801d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:06.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.405+0000 7ff385200640 1 --2- 172.21.15.123:0/3131535727 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3801d1810 0x7ff3801d0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:06.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.405+0000 7ff385200640 1 -- 172.21.15.123:0/3131535727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3800aa4e0 msgr2=0x7ff38013f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:06.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.405+0000 7ff385200640 1 --2- 172.21.15.123:0/3131535727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3800aa4e0 0x7ff38013f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:06.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.405+0000 7ff385200640 1 -- 172.21.15.123:0/3131535727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3800aaa10 con 0x7ff3640051c0 2024-04-17T05:27:06.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.405+0000 7ff385200640 1 --2- 172.21.15.123:0/3131535727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3640051c0 0x7ff3801cdc50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff37000d860 tx=0x7ff37000dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:06.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.405+0000 7ff37d600640 1 -- 172.21.15.123:0/3131535727 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff370019070 con 0x7ff3640051c0 2024-04-17T05:27:06.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.405+0000 7ff37d600640 1 -- 172.21.15.123:0/3131535727 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3700074e0 con 0x7ff3640051c0 2024-04-17T05:27:06.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.405+0000 7ff387c00640 1 -- 172.21.15.123:0/3131535727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3800aacf0 con 0x7ff3640051c0 2024-04-17T05:27:06.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.405+0000 7ff37d600640 1 -- 172.21.15.123:0/3131535727 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3700049e0 con 0x7ff3640051c0 2024-04-17T05:27:06.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.405+0000 7ff387c00640 1 -- 172.21.15.123:0/3131535727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3800a9ae0 con 0x7ff3640051c0 2024-04-17T05:27:06.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.407+0000 7ff387c00640 1 -- 172.21.15.123:0/3131535727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff380068a40 con 0x7ff3640051c0 2024-04-17T05:27:06.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.408+0000 7ff37d600640 1 -- 172.21.15.123:0/3131535727 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff37001c070 con 0x7ff3640051c0 2024-04-17T05:27:06.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.409+0000 7ff37d600640 1 --2- 172.21.15.123:0/3131535727 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7ff35c06c920 0x7ff35c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:06.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.409+0000 7ff37d600640 1 -- 172.21.15.123:0/3131535727 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff37008b9e0 con 0x7ff3640051c0 2024-04-17T05:27:06.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.409+0000 7ff377e00640 1 --2- 172.21.15.123:0/3131535727 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7ff35c06c920 0x7ff35c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:06.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.411+0000 7ff377e00640 1 --2- 172.21.15.123:0/3131535727 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7ff35c06c920 0x7ff35c06ede0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff380145ab0 tx=0x7ff368008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:06.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.414+0000 7ff37d600640 1 -- 172.21.15.123:0/3131535727 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7ff3800aaa10 con 0x7ff3640051c0 2024-04-17T05:27:06.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.611+0000 7ff387c00640 1 -- 172.21.15.123:0/3131535727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff3800b5160 con 0x7ff3640051c0 2024-04-17T05:27:06.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.612+0000 7ff37d600640 1 -- 172.21.15.123:0/3131535727 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7ff370059b60 con 0x7ff3640051c0 2024-04-17T05:27:06.610 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-04-17T05:27:06.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.615+0000 7ff387c00640 1 -- 172.21.15.123:0/3131535727 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7ff35c06c920 msgr2=0x7ff35c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:06.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.615+0000 7ff387c00640 1 --2- 172.21.15.123:0/3131535727 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7ff35c06c920 0x7ff35c06ede0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff380145ab0 tx=0x7ff368008040 comp rx=0 tx=0).stop 2024-04-17T05:27:06.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.615+0000 7ff387c00640 1 -- 172.21.15.123:0/3131535727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3640051c0 msgr2=0x7ff3801cdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:06.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.615+0000 7ff387c00640 1 --2- 172.21.15.123:0/3131535727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3640051c0 0x7ff3801cdc50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff37000d860 tx=0x7ff37000dd20 comp rx=0 tx=0).stop 2024-04-17T05:27:06.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.615+0000 7ff387c00640 1 -- 172.21.15.123:0/3131535727 shutdown_connections 2024-04-17T05:27:06.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.615+0000 7ff387c00640 1 --2- 172.21.15.123:0/3131535727 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3800aa4e0 0x7ff38013f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:06.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.615+0000 7ff387c00640 1 --2- 172.21.15.123:0/3131535727 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7ff35c06c920 0x7ff35c06ede0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:06.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.615+0000 7ff387c00640 1 --2- 172.21.15.123:0/3131535727 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3801d1810 0x7ff3801d0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:06.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.615+0000 7ff387c00640 1 --2- 172.21.15.123:0/3131535727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3640051c0 0x7ff3801cdc50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:06.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.615+0000 7ff387c00640 1 -- 172.21.15.123:0/3131535727 >> 172.21.15.123:0/3131535727 conn(0x7ff3800bd4f0 msgr2=0x7ff380141510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:06.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.615+0000 7ff387c00640 1 -- 172.21.15.123:0/3131535727 shutdown_connections 2024-04-17T05:27:06.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.615+0000 7ff387c00640 1 -- 172.21.15.123:0/3131535727 wait complete. 2024-04-17T05:27:06.631 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T05:27:06.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.851+0000 7fb72be00640 1 Processor -- start 2024-04-17T05:27:06.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.851+0000 7fb72be00640 1 -- start start 2024-04-17T05:27:06.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.852+0000 7fb72be00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb72c0b66c0 0x7fb72c0b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:06.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.852+0000 7fb72be00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb72c0732e0 0x7fb72c073770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:06.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.852+0000 7fb72be00640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb72c1400b0 con 0x7fb72c0b5490 2024-04-17T05:27:06.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.852+0000 7fb72be00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb72c0b4ca0 con 0x7fb72c0b66c0 2024-04-17T05:27:06.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.852+0000 7fb72be00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fb72c0b6aa0 con 0x7fb72c0732e0 2024-04-17T05:27:06.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.853+0000 7fb72aa00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb72c0b66c0 0x7fb72c0b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:06.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.853+0000 7fb72aa00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb72c0b66c0 0x7fb72c0b3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47076/0 (socket says 172.21.15.123:47076) 2024-04-17T05:27:06.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.853+0000 7fb72aa00640 1 -- 172.21.15.123:0/3421637139 learned_addr learned my addr 172.21.15.123:0/3421637139 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:06.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.853+0000 7fb72b400640 1 --2- 172.21.15.123:0/3421637139 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb72c0732e0 0x7fb72c073770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:06.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.853+0000 7fb72aa00640 1 -- 172.21.15.123:0/3421637139 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb72c0732e0 msgr2=0x7fb72c073770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:06.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.853+0000 7fb72aa00640 1 --2- 172.21.15.123:0/3421637139 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb72c0732e0 0x7fb72c073770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:06.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.853+0000 7fb72aa00640 1 -- 172.21.15.123:0/3421637139 >> v1:172.21.15.164:6789/0 conn(0x7fb72c0b5490 legacy=0x7fb72c13f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:06.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.854+0000 7fb72aa00640 1 -- 172.21.15.123:0/3421637139 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb72c0b5af0 con 0x7fb72c0b66c0 2024-04-17T05:27:06.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.855+0000 7fb72aa00640 1 --2- 172.21.15.123:0/3421637139 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb72c0b66c0 0x7fb72c0b3dd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb71c009870 tx=0x7fb71c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c32e58b722e8477 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:06.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.855+0000 7fb729600640 1 -- 172.21.15.123:0/3421637139 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71c035020 con 0x7fb72c0b66c0 2024-04-17T05:27:06.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.855+0000 7fb729600640 1 -- 172.21.15.123:0/3421637139 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb71c031640 con 0x7fb72c0b66c0 2024-04-17T05:27:06.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.855+0000 7fb729600640 1 -- 172.21.15.123:0/3421637139 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71c02d040 con 0x7fb72c0b66c0 2024-04-17T05:27:06.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.856+0000 7fb72be00640 1 -- 172.21.15.123:0/3421637139 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb72c0b66c0 msgr2=0x7fb72c0b3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:06.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.856+0000 7fb72be00640 1 --2- 172.21.15.123:0/3421637139 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb72c0b66c0 0x7fb72c0b3dd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb71c009870 tx=0x7fb71c02b8f0 comp rx=0 tx=0).stop 2024-04-17T05:27:06.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.856+0000 7fb72be00640 1 -- 172.21.15.123:0/3421637139 shutdown_connections 2024-04-17T05:27:06.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.856+0000 7fb72be00640 1 --2- 172.21.15.123:0/3421637139 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb72c0732e0 0x7fb72c073770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:06.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.856+0000 7fb72be00640 1 --2- 172.21.15.123:0/3421637139 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb72c0b66c0 0x7fb72c0b3dd0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:06.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.856+0000 7fb72be00640 1 -- 172.21.15.123:0/3421637139 >> 172.21.15.123:0/3421637139 conn(0x7fb72c0b9a30 msgr2=0x7fb72c0b5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:06.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.856+0000 7fb72be00640 1 -- 172.21.15.123:0/3421637139 shutdown_connections 2024-04-17T05:27:06.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.856+0000 7fb72be00640 1 -- 172.21.15.123:0/3421637139 wait complete. 2024-04-17T05:27:06.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.858+0000 7fb72be00640 1 Processor -- start 2024-04-17T05:27:06.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.858+0000 7fb72be00640 1 -- start start 2024-04-17T05:27:06.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.859+0000 7fb72be00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb72c0732e0 0x7fb72c0af810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:06.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.859+0000 7fb72be00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb72c0b5490 0x7fb72c13e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:06.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.859+0000 7fb72be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb72c0b66c0 0x7fb72c13ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:06.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.859+0000 7fb72be00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c1502a0 con 0x7fb72c0b5490 2024-04-17T05:27:06.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.859+0000 7fb72be00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c0b4930 con 0x7fb72c0b66c0 2024-04-17T05:27:06.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.859+0000 7fb72be00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fb72c150420 con 0x7fb72c0732e0 2024-04-17T05:27:06.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.859+0000 7fb72a000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb72c0b5490 0x7fb72c13e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:06.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.859+0000 7fb72a000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb72c0b5490 0x7fb72c13e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47084/0 (socket says 172.21.15.123:47084) 2024-04-17T05:27:06.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.859+0000 7fb72a000640 1 -- 172.21.15.123:0/2727545153 learned_addr learned my addr 172.21.15.123:0/2727545153 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:06.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.859+0000 7fb72aa00640 1 --2- 172.21.15.123:0/2727545153 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb72c0732e0 0x7fb72c0af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:06.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.859+0000 7fb72b400640 1 --2- 172.21.15.123:0/2727545153 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb72c0b66c0 0x7fb72c13ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:06.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.859+0000 7fb72a000640 1 -- 172.21.15.123:0/2727545153 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb72c0732e0 msgr2=0x7fb72c0af810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:06.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.859+0000 7fb72a000640 1 --2- 172.21.15.123:0/2727545153 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb72c0732e0 0x7fb72c0af810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:06.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.859+0000 7fb72a000640 1 -- 172.21.15.123:0/2727545153 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb72c0b66c0 msgr2=0x7fb72c13ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:06.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.860+0000 7fb72a000640 1 --2- 172.21.15.123:0/2727545153 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb72c0b66c0 0x7fb72c13ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:06.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.860+0000 7fb72a000640 1 -- 172.21.15.123:0/2727545153 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb72c13d930 con 0x7fb72c0b5490 2024-04-17T05:27:06.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.860+0000 7fb72a000640 1 --2- 172.21.15.123:0/2727545153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb72c0b5490 0x7fb72c13e7f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb71800c430 tx=0x7fb71800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:06.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.860+0000 7fb723400640 1 -- 172.21.15.123:0/2727545153 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7180052d0 con 0x7fb72c0b5490 2024-04-17T05:27:06.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.860+0000 7fb723400640 1 -- 172.21.15.123:0/2727545153 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb718005490 con 0x7fb72c0b5490 2024-04-17T05:27:06.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.860+0000 7fb723400640 1 -- 172.21.15.123:0/2727545153 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb718007260 con 0x7fb72c0b5490 2024-04-17T05:27:06.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.860+0000 7fb72be00640 1 -- 172.21.15.123:0/2727545153 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb72c13dc10 con 0x7fb72c0b5490 2024-04-17T05:27:06.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.860+0000 7fb72be00640 1 -- 172.21.15.123:0/2727545153 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb72c0afd50 con 0x7fb72c0b5490 2024-04-17T05:27:06.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.862+0000 7fb72be00640 1 -- 172.21.15.123:0/2727545153 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb72c0b0290 con 0x7fb72c0b5490 2024-04-17T05:27:06.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.863+0000 7fb723400640 1 -- 172.21.15.123:0/2727545153 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb718007400 con 0x7fb72c0b5490 2024-04-17T05:27:06.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.863+0000 7fb723400640 1 --2- 172.21.15.123:0/2727545153 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fb70c06c8f0 0x7fb70c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:06.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.864+0000 7fb723400640 1 -- 172.21.15.123:0/2727545153 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb71808b360 con 0x7fb72c0b5490 2024-04-17T05:27:06.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.864+0000 7fb72aa00640 1 --2- 172.21.15.123:0/2727545153 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fb70c06c8f0 0x7fb70c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:06.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.865+0000 7fb72aa00640 1 --2- 172.21.15.123:0/2727545153 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fb70c06c8f0 0x7fb70c06edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb71c036000 tx=0x7fb71c03c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:06.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:06.868+0000 7fb723400640 1 -- 172.21.15.123:0/2727545153 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fb72c0b0290 con 0x7fb72c0b5490 2024-04-17T05:27:07.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.068+0000 7fb72be00640 1 -- 172.21.15.123:0/2727545153 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb72c09dc80 con 0x7fb72c0b5490 2024-04-17T05:27:07.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.069+0000 7fb723400640 1 -- 172.21.15.123:0/2727545153 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fb72c13d930 con 0x7fb72c0b5490 2024-04-17T05:27:07.068 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-04-17T05:27:07.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.072+0000 7fb72be00640 1 -- 172.21.15.123:0/2727545153 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fb70c06c8f0 msgr2=0x7fb70c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:07.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.072+0000 7fb72be00640 1 --2- 172.21.15.123:0/2727545153 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fb70c06c8f0 0x7fb70c06edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb71c036000 tx=0x7fb71c03c040 comp rx=0 tx=0).stop 2024-04-17T05:27:07.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.072+0000 7fb72be00640 1 -- 172.21.15.123:0/2727545153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb72c0b5490 msgr2=0x7fb72c13e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:07.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.072+0000 7fb72be00640 1 --2- 172.21.15.123:0/2727545153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb72c0b5490 0x7fb72c13e7f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb71800c430 tx=0x7fb71800c8f0 comp rx=0 tx=0).stop 2024-04-17T05:27:07.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.073+0000 7fb72be00640 1 -- 172.21.15.123:0/2727545153 shutdown_connections 2024-04-17T05:27:07.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.073+0000 7fb72be00640 1 --2- 172.21.15.123:0/2727545153 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb72c0b66c0 0x7fb72c13ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:07.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.073+0000 7fb72be00640 1 --2- 172.21.15.123:0/2727545153 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb72c0b5490 0x7fb72c13e7f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:07.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.073+0000 7fb72be00640 1 --2- 172.21.15.123:0/2727545153 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fb70c06c8f0 0x7fb70c06edb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:07.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.073+0000 7fb72be00640 1 --2- 172.21.15.123:0/2727545153 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb72c0732e0 0x7fb72c0af810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:07.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.073+0000 7fb72be00640 1 -- 172.21.15.123:0/2727545153 >> 172.21.15.123:0/2727545153 conn(0x7fb72c0b9a30 msgr2=0x7fb72c0b3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:07.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.073+0000 7fb72be00640 1 -- 172.21.15.123:0/2727545153 shutdown_connections 2024-04-17T05:27:07.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.073+0000 7fb72be00640 1 -- 172.21.15.123:0/2727545153 wait complete. 2024-04-17T05:27:07.091 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T05:27:07.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.301+0000 7f6d4be00640 1 Processor -- start 2024-04-17T05:27:07.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.301+0000 7f6d4be00640 1 -- start start 2024-04-17T05:27:07.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.302+0000 7f6d4be00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6d4c06dc70 0x7f6d4c06cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:07.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.302+0000 7f6d4be00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f6d4c0b3f90 0x7f6d4c09b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:07.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.302+0000 7f6d4be00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d4c06e050 con 0x7f6d4c0af4e0 2024-04-17T05:27:07.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.302+0000 7f6d4be00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f6d4c0af050 con 0x7f6d4c0b3f90 2024-04-17T05:27:07.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.302+0000 7f6d4be00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f6d4c0b43e0 con 0x7f6d4c06dc70 2024-04-17T05:27:07.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.303+0000 7f6d43e00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6d4c0af4e0 0x7f6d4c09aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36124/0 (socket says 172.21.15.123:36124) 2024-04-17T05:27:07.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.303+0000 7f6d43e00640 1 -- 172.21.15.123:0/821431255 learned_addr learned my addr 172.21.15.123:0/821431255 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:27:07.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.303+0000 7f6d4b400640 1 --2- 172.21.15.123:0/821431255 >> v2:172.21.15.164:3300/0 conn(0x7f6d4c0b3f90 0x7f6d4c09b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:07.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.303+0000 7f6d4aa00640 1 --2- 172.21.15.123:0/821431255 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6d4c06dc70 0x7f6d4c06cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:07.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.303+0000 7f6d4a000640 1 -- 172.21.15.123:0/821431255 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2174947147 0 0) 0x7f6d4c06e050 con 0x7f6d4c0af4e0 2024-04-17T05:27:07.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.303+0000 7f6d4a000640 1 -- 172.21.15.123:0/821431255 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d30003520 con 0x7f6d4c0af4e0 2024-04-17T05:27:07.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.303+0000 7f6d4a000640 1 -- 172.21.15.123:0/821431255 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1728134523 0 0) 0x7f6d30003520 con 0x7f6d4c0af4e0 2024-04-17T05:27:07.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.303+0000 7f6d4a000640 1 -- 172.21.15.123:0/821431255 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6d4c06dc70 msgr2=0x7f6d4c06cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:07.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.303+0000 7f6d4a000640 1 --2- 172.21.15.123:0/821431255 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6d4c06dc70 0x7f6d4c06cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:07.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.303+0000 7f6d4a000640 1 -- 172.21.15.123:0/821431255 >> v2:172.21.15.164:3300/0 conn(0x7f6d4c0b3f90 msgr2=0x7f6d4c09b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:07.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.303+0000 7f6d4a000640 1 --2- 172.21.15.123:0/821431255 >> v2:172.21.15.164:3300/0 conn(0x7f6d4c0b3f90 0x7f6d4c09b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:07.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.303+0000 7f6d4a000640 1 -- 172.21.15.123:0/821431255 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d4c0ae570 con 0x7f6d4c0af4e0 2024-04-17T05:27:07.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.303+0000 7f6d4a000640 1 -- 172.21.15.123:0/821431255 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1042962670 0 0) 0x7f6d34001670 con 0x7f6d4c0af4e0 2024-04-17T05:27:07.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.303+0000 7f6d4a000640 1 -- 172.21.15.123:0/821431255 >> v1:172.21.15.123:6789/0 conn(0x7f6d4c0af4e0 legacy=0x7f6d4c09aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:07.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.304+0000 7f6d4a000640 1 --2- 172.21.15.123:0/821431255 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6d4c06dc70 0x7f6d300039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:07.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.304+0000 7f6d4a000640 1 --2- 172.21.15.123:0/821431255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d30003f30 0x7f6d30004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:07.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.304+0000 7f6d4a000640 1 --2- 172.21.15.123:0/821431255 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d30004d40 0x7f6d300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:07.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.304+0000 7f6d4a000640 1 -- 172.21.15.123:0/821431255 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4c0af050 con 0x7f6d30003f30 2024-04-17T05:27:07.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.304+0000 7f6d4a000640 1 -- 172.21.15.123:0/821431255 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4c0b43e0 con 0x7f6d30004d40 2024-04-17T05:27:07.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.304+0000 7f6d4a000640 1 -- 172.21.15.123:0/821431255 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f6d3000baa0 con 0x7f6d4c06dc70 2024-04-17T05:27:07.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.304+0000 7f6d43e00640 1 --2- 172.21.15.123:0/821431255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d30003f30 0x7f6d30004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:07.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.304+0000 7f6d4aa00640 1 --2- 172.21.15.123:0/821431255 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6d4c06dc70 0x7f6d300039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:07.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.304+0000 7f6d4b400640 1 --2- 172.21.15.123:0/821431255 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d30004d40 0x7f6d300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:07.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.304+0000 7f6d43e00640 1 -- 172.21.15.123:0/821431255 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6d4c06dc70 msgr2=0x7f6d300039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:07.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.304+0000 7f6d43e00640 1 --2- 172.21.15.123:0/821431255 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6d4c06dc70 0x7f6d300039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:07.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.304+0000 7f6d43e00640 1 -- 172.21.15.123:0/821431255 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d30004d40 msgr2=0x7f6d300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:07.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.304+0000 7f6d43e00640 1 --2- 172.21.15.123:0/821431255 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d30004d40 0x7f6d300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:07.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.304+0000 7f6d43e00640 1 -- 172.21.15.123:0/821431255 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d30003520 con 0x7f6d30003f30 2024-04-17T05:27:07.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.304+0000 7f6d4aa00640 1 --2- 172.21.15.123:0/821431255 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6d4c06dc70 0x7f6d300039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:07.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.304+0000 7f6d4b400640 1 --2- 172.21.15.123:0/821431255 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d30004d40 0x7f6d300051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:07.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.305+0000 7f6d43e00640 1 --2- 172.21.15.123:0/821431255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d30003f30 0x7f6d30004800 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6d3400c240 tx=0x7f6d30005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74280bbe11975e50 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:07.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.306+0000 7f6d4a000640 1 -- 172.21.15.123:0/821431255 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d34007d30 con 0x7f6d30003f30 2024-04-17T05:27:07.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.306+0000 7f6d4a000640 1 -- 172.21.15.123:0/821431255 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d34030070 con 0x7f6d30003f30 2024-04-17T05:27:07.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.306+0000 7f6d4a000640 1 -- 172.21.15.123:0/821431255 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3402cda0 con 0x7f6d30003f30 2024-04-17T05:27:07.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.306+0000 7f6d4be00640 1 -- 172.21.15.123:0/821431255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d30003f30 msgr2=0x7f6d30004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:07.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.306+0000 7f6d4be00640 1 --2- 172.21.15.123:0/821431255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d30003f30 0x7f6d30004800 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6d3400c240 tx=0x7f6d30005830 comp rx=0 tx=0).stop 2024-04-17T05:27:07.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.306+0000 7f6d4b400640 1 -- 172.21.15.123:0/821431255 reap_dead start 2024-04-17T05:27:07.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.306+0000 7f6d4be00640 1 -- 172.21.15.123:0/821431255 shutdown_connections 2024-04-17T05:27:07.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.306+0000 7f6d4be00640 1 -- 172.21.15.123:0/821431255 >> 172.21.15.123:0/821431255 conn(0x7f6d4c06c430 msgr2=0x7f6d4c0b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:07.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.306+0000 7f6d4be00640 1 -- 172.21.15.123:0/821431255 shutdown_connections 2024-04-17T05:27:07.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.307+0000 7f6d4be00640 1 -- 172.21.15.123:0/821431255 wait complete. 2024-04-17T05:27:07.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.308+0000 7f6d4be00640 1 Processor -- start 2024-04-17T05:27:07.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.308+0000 7f6d4be00640 1 -- start start 2024-04-17T05:27:07.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.309+0000 7f6d4be00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6d30003f30 0x7f6d4c0b1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:07.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.309+0000 7f6d4be00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d4c071710 0x7f6d4c071b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:07.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.309+0000 7f6d4be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d4c1e4a40 0x7f6d4c1e4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:07.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.309+0000 7f6d4be00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4c0aece0 con 0x7f6d4c071710 2024-04-17T05:27:07.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.309+0000 7f6d4be00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4c06d3b0 con 0x7f6d4c1e4a40 2024-04-17T05:27:07.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.309+0000 7f6d4be00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f6d4c0ae1f0 con 0x7f6d30003f30 2024-04-17T05:27:07.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.309+0000 7f6d43e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d4c071710 0x7f6d4c071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:07.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.309+0000 7f6d43e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d4c071710 0x7f6d4c071b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47098/0 (socket says 172.21.15.123:47098) 2024-04-17T05:27:07.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.309+0000 7f6d43e00640 1 -- 172.21.15.123:0/1779253623 learned_addr learned my addr 172.21.15.123:0/1779253623 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:07.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.310+0000 7f6d4aa00640 1 --2- 172.21.15.123:0/1779253623 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6d30003f30 0x7f6d4c0b1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:07.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.310+0000 7f6d4b400640 1 --2- 172.21.15.123:0/1779253623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d4c1e4a40 0x7f6d4c1e4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:07.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.310+0000 7f6d43e00640 1 -- 172.21.15.123:0/1779253623 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6d30003f30 msgr2=0x7f6d4c0b1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:07.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.310+0000 7f6d43e00640 1 --2- 172.21.15.123:0/1779253623 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6d30003f30 0x7f6d4c0b1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:07.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.310+0000 7f6d43e00640 1 -- 172.21.15.123:0/1779253623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d4c1e4a40 msgr2=0x7f6d4c1e4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:07.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.310+0000 7f6d43e00640 1 --2- 172.21.15.123:0/1779253623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d4c1e4a40 0x7f6d4c1e4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:07.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.310+0000 7f6d43e00640 1 -- 172.21.15.123:0/1779253623 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d4c0b1c00 con 0x7f6d4c071710 2024-04-17T05:27:07.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.310+0000 7f6d43e00640 1 --2- 172.21.15.123:0/1779253623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d4c071710 0x7f6d4c071b50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6d34001970 tx=0x7f6d4c0aefc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:07.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.310+0000 7f6d42a00640 1 -- 172.21.15.123:0/1779253623 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d34001c70 con 0x7f6d4c071710 2024-04-17T05:27:07.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.311+0000 7f6d42a00640 1 -- 172.21.15.123:0/1779253623 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d340049e0 con 0x7f6d4c071710 2024-04-17T05:27:07.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.311+0000 7f6d42a00640 1 -- 172.21.15.123:0/1779253623 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d34007d30 con 0x7f6d4c071710 2024-04-17T05:27:07.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.311+0000 7f6d4be00640 1 -- 172.21.15.123:0/1779253623 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d4c072090 con 0x7f6d4c071710 2024-04-17T05:27:07.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.311+0000 7f6d4be00640 1 -- 172.21.15.123:0/1779253623 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d4c072d40 con 0x7f6d4c071710 2024-04-17T05:27:07.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.312+0000 7f6d4be00640 1 -- 172.21.15.123:0/1779253623 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d4c075b30 con 0x7f6d4c071710 2024-04-17T05:27:07.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.313+0000 7f6d42a00640 1 -- 172.21.15.123:0/1779253623 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6d34007070 con 0x7f6d4c071710 2024-04-17T05:27:07.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.314+0000 7f6d42a00640 1 --2- 172.21.15.123:0/1779253623 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f6d2806c8f0 0x7f6d2806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:07.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.314+0000 7f6d42a00640 1 -- 172.21.15.123:0/1779253623 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f6d340ad470 con 0x7f6d4c071710 2024-04-17T05:27:07.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.314+0000 7f6d4aa00640 1 --2- 172.21.15.123:0/1779253623 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f6d2806c8f0 0x7f6d2806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:07.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.315+0000 7f6d4aa00640 1 --2- 172.21.15.123:0/1779253623 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f6d2806c8f0 0x7f6d2806edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c0099c0 tx=0x7f6d3c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:07.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.318+0000 7f6d42a00640 1 -- 172.21.15.123:0/1779253623 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f6d3407b4c0 con 0x7f6d4c071710 2024-04-17T05:27:07.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.517+0000 7f6d4be00640 1 -- 172.21.15.123:0/1779253623 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f6d4c1d4d80 con 0x7f6d4c071710 2024-04-17T05:27:07.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.518+0000 7f6d42a00640 1 -- 172.21.15.123:0/1779253623 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f6d3407adc0 con 0x7f6d4c071710 2024-04-17T05:27:07.516 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-04-17T05:27:07.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.522+0000 7f6d4be00640 1 -- 172.21.15.123:0/1779253623 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f6d2806c8f0 msgr2=0x7f6d2806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:07.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.522+0000 7f6d4be00640 1 --2- 172.21.15.123:0/1779253623 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f6d2806c8f0 0x7f6d2806edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c0099c0 tx=0x7f6d3c008040 comp rx=0 tx=0).stop 2024-04-17T05:27:07.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.522+0000 7f6d4be00640 1 -- 172.21.15.123:0/1779253623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d4c071710 msgr2=0x7f6d4c071b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:07.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.522+0000 7f6d4be00640 1 --2- 172.21.15.123:0/1779253623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d4c071710 0x7f6d4c071b50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6d34001970 tx=0x7f6d4c0aefc0 comp rx=0 tx=0).stop 2024-04-17T05:27:07.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.522+0000 7f6d4be00640 1 -- 172.21.15.123:0/1779253623 shutdown_connections 2024-04-17T05:27:07.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.522+0000 7f6d4be00640 1 --2- 172.21.15.123:0/1779253623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6d4c1e4a40 0x7f6d4c1e4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:07.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.522+0000 7f6d4be00640 1 --2- 172.21.15.123:0/1779253623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d4c071710 0x7f6d4c071b50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:07.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.522+0000 7f6d4be00640 1 --2- 172.21.15.123:0/1779253623 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f6d2806c8f0 0x7f6d2806edb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:07.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.522+0000 7f6d4be00640 1 --2- 172.21.15.123:0/1779253623 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6d30003f30 0x7f6d4c0b1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:07.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.522+0000 7f6d4be00640 1 -- 172.21.15.123:0/1779253623 >> 172.21.15.123:0/1779253623 conn(0x7f6d4c06c430 msgr2=0x7f6d4c09e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:07.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.522+0000 7f6d4be00640 1 -- 172.21.15.123:0/1779253623 shutdown_connections 2024-04-17T05:27:07.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.522+0000 7f6d4be00640 1 -- 172.21.15.123:0/1779253623 wait complete. 2024-04-17T05:27:07.542 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-17T05:27:07.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.748+0000 7f4176800640 1 Processor -- start 2024-04-17T05:27:07.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.748+0000 7f4176800640 1 -- start start 2024-04-17T05:27:07.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.750+0000 7f4176800640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f41700b58f0 0x7f41701482f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:07.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.750+0000 7f4176800640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41700b65d0 con 0x7f41700b61f0 2024-04-17T05:27:07.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.750+0000 7f4176800640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41700b75a0 con 0x7f4170147ed0 2024-04-17T05:27:07.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.750+0000 7f4176800640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f41700b4d50 con 0x7f41700b58f0 2024-04-17T05:27:07.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.750+0000 7f4175400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f41700b61f0 0x7f41700b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36138/0 (socket says 172.21.15.123:36138) 2024-04-17T05:27:07.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.750+0000 7f4175400640 1 -- 172.21.15.123:0/461075821 learned_addr learned my addr 172.21.15.123:0/461075821 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:27:07.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.750+0000 7f4175e00640 1 --2- 172.21.15.123:0/461075821 >> v2:172.21.15.164:3300/0 conn(0x7f41700b58f0 0x7f41701482f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:07.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.750+0000 7f416fe00640 1 -- 172.21.15.123:0/461075821 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2230049573 0 0) 0x7f41700b65d0 con 0x7f41700b61f0 2024-04-17T05:27:07.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.750+0000 7f416fe00640 1 -- 172.21.15.123:0/461075821 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4154003520 con 0x7f41700b61f0 2024-04-17T05:27:07.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.751+0000 7f416fe00640 1 -- 172.21.15.123:0/461075821 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3320561067 0 0) 0x7f4154003520 con 0x7f41700b61f0 2024-04-17T05:27:07.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.751+0000 7f416fe00640 1 -- 172.21.15.123:0/461075821 >> v2:172.21.15.164:3300/0 conn(0x7f41700b58f0 msgr2=0x7f41701482f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:07.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.751+0000 7f416fe00640 1 --2- 172.21.15.123:0/461075821 >> v2:172.21.15.164:3300/0 conn(0x7f41700b58f0 0x7f41701482f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:07.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.751+0000 7f416fe00640 1 -- 172.21.15.123:0/461075821 >> v1:172.21.15.164:6789/0 conn(0x7f4170147ed0 legacy=0x7f41700b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:07.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.751+0000 7f416fe00640 1 -- 172.21.15.123:0/461075821 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41700b49e0 con 0x7f41700b61f0 2024-04-17T05:27:07.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.751+0000 7f416fe00640 1 -- 172.21.15.123:0/461075821 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1042962670 0 0) 0x7f4160001670 con 0x7f41700b61f0 2024-04-17T05:27:07.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.751+0000 7f416fe00640 1 -- 172.21.15.123:0/461075821 >> v1:172.21.15.123:6789/0 conn(0x7f41700b61f0 legacy=0x7f41700b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:07.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.751+0000 7f416fe00640 1 --2- 172.21.15.123:0/461075821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4154003a00 0x7f4154003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:07.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.751+0000 7f416fe00640 1 --2- 172.21.15.123:0/461075821 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4154004800 0x7f4154004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:07.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.751+0000 7f416fe00640 1 --2- 172.21.15.123:0/461075821 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41540051c0 0x7f415400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:07.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.751+0000 7f416fe00640 1 -- 172.21.15.123:0/461075821 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f41700b4d50 con 0x7f4154003a00 2024-04-17T05:27:07.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.751+0000 7f416fe00640 1 -- 172.21.15.123:0/461075821 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f415400c0c0 con 0x7f41540051c0 2024-04-17T05:27:07.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.751+0000 7f416fe00640 1 -- 172.21.15.123:0/461075821 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f415400c2c0 con 0x7f4154004800 2024-04-17T05:27:07.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.751+0000 7f4175400640 1 --2- 172.21.15.123:0/461075821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4154003a00 0x7f4154003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:07.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.752+0000 7f4174a00640 1 --2- 172.21.15.123:0/461075821 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4154004800 0x7f4154004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:07.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.752+0000 7f4175e00640 1 --2- 172.21.15.123:0/461075821 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41540051c0 0x7f415400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:07.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.752+0000 7f4175400640 1 -- 172.21.15.123:0/461075821 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4154004800 msgr2=0x7f4154004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:07.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.752+0000 7f4175400640 1 --2- 172.21.15.123:0/461075821 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4154004800 0x7f4154004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:07.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.752+0000 7f4175400640 1 -- 172.21.15.123:0/461075821 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41540051c0 msgr2=0x7f415400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:07.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.752+0000 7f4175400640 1 --2- 172.21.15.123:0/461075821 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f41540051c0 0x7f415400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:07.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.752+0000 7f4175400640 1 -- 172.21.15.123:0/461075821 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4154003520 con 0x7f4154003a00 2024-04-17T05:27:07.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.752+0000 7f4175e00640 1 -- 172.21.15.123:0/461075821 reap_dead start 2024-04-17T05:27:07.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.753+0000 7f4175400640 1 --2- 172.21.15.123:0/461075821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4154003a00 0x7f4154003e20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f416000c0e0 tx=0x7f4154005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcde4b9458f2abf1 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:07.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.753+0000 7f416fe00640 1 -- 172.21.15.123:0/461075821 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4160007c20 con 0x7f4154003a00 2024-04-17T05:27:07.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.753+0000 7f416fe00640 1 -- 172.21.15.123:0/461075821 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4160030070 con 0x7f4154003a00 2024-04-17T05:27:07.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.753+0000 7f416fe00640 1 -- 172.21.15.123:0/461075821 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4160005d70 con 0x7f4154003a00 2024-04-17T05:27:07.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.754+0000 7f4176800640 1 -- 172.21.15.123:0/461075821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4154003a00 msgr2=0x7f4154003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:07.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.754+0000 7f4176800640 1 --2- 172.21.15.123:0/461075821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4154003a00 0x7f4154003e20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f416000c0e0 tx=0x7f4154005830 comp rx=0 tx=0).stop 2024-04-17T05:27:07.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.754+0000 7f4176800640 1 -- 172.21.15.123:0/461075821 shutdown_connections 2024-04-17T05:27:07.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.754+0000 7f4176800640 1 --2- 172.21.15.123:0/461075821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4154003a00 0x7f4154003e20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:07.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.754+0000 7f4176800640 1 -- 172.21.15.123:0/461075821 >> 172.21.15.123:0/461075821 conn(0x7f417006c260 msgr2=0x7f41700b9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:07.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.754+0000 7f4176800640 1 -- 172.21.15.123:0/461075821 shutdown_connections 2024-04-17T05:27:07.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.754+0000 7f4176800640 1 -- 172.21.15.123:0/461075821 wait complete. 2024-04-17T05:27:07.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.756+0000 7f4176800640 1 Processor -- start 2024-04-17T05:27:07.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.756+0000 7f4176800640 1 -- start start 2024-04-17T05:27:07.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.757+0000 7f4176800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4154003a00 0x7f4170125770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:07.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.757+0000 7f4176800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f417012cf90 0x7f417012d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:07.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.757+0000 7f4176800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41701dd410 0x7f41701dd890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:07.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.757+0000 7f4176800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4170148680 con 0x7f41701dd410 2024-04-17T05:27:07.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.757+0000 7f4176800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4170148500 con 0x7f417012cf90 2024-04-17T05:27:07.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.757+0000 7f4176800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f41700b51e0 con 0x7f4154003a00 2024-04-17T05:27:07.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.757+0000 7f4175e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41701dd410 0x7f41701dd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:07.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.757+0000 7f4175e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41701dd410 0x7f41701dd890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47122/0 (socket says 172.21.15.123:47122) 2024-04-17T05:27:07.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.757+0000 7f4175e00640 1 -- 172.21.15.123:0/988218889 learned_addr learned my addr 172.21.15.123:0/988218889 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:07.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.757+0000 7f4175400640 1 --2- 172.21.15.123:0/988218889 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4154003a00 0x7f4170125770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:07.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.757+0000 7f4174a00640 1 --2- 172.21.15.123:0/988218889 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f417012cf90 0x7f417012d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:07.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.758+0000 7f4175e00640 1 -- 172.21.15.123:0/988218889 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4154003a00 msgr2=0x7f4170125770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:07.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.758+0000 7f4175e00640 1 --2- 172.21.15.123:0/988218889 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4154003a00 0x7f4170125770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:07.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.758+0000 7f4175e00640 1 -- 172.21.15.123:0/988218889 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f417012cf90 msgr2=0x7f417012d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:07.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.758+0000 7f4175e00640 1 --2- 172.21.15.123:0/988218889 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f417012cf90 0x7f417012d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:07.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.758+0000 7f4175e00640 1 -- 172.21.15.123:0/988218889 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4170126060 con 0x7f41701dd410 2024-04-17T05:27:07.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.758+0000 7f4175e00640 1 --2- 172.21.15.123:0/988218889 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41701dd410 0x7f41701dd890 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f41700b79c0 tx=0x7f41680115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:07.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.758+0000 7f416d600640 1 -- 172.21.15.123:0/988218889 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4168011db0 con 0x7f41701dd410 2024-04-17T05:27:07.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.758+0000 7f416d600640 1 -- 172.21.15.123:0/988218889 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f416801b070 con 0x7f41701dd410 2024-04-17T05:27:07.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.758+0000 7f416d600640 1 -- 172.21.15.123:0/988218889 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4168003990 con 0x7f41701dd410 2024-04-17T05:27:07.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.758+0000 7f4176800640 1 -- 172.21.15.123:0/988218889 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41701262d0 con 0x7f41701dd410 2024-04-17T05:27:07.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.758+0000 7f4176800640 1 -- 172.21.15.123:0/988218889 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4170141a50 con 0x7f41701dd410 2024-04-17T05:27:07.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.759+0000 7f4176800640 1 -- 172.21.15.123:0/988218889 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4170075b30 con 0x7f41701dd410 2024-04-17T05:27:07.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.760+0000 7f416d600640 1 -- 172.21.15.123:0/988218889 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4168003b30 con 0x7f41701dd410 2024-04-17T05:27:07.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.761+0000 7f416d600640 1 --2- 172.21.15.123:0/988218889 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f415006c8f0 0x7f415006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:07.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.761+0000 7f416d600640 1 -- 172.21.15.123:0/988218889 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f416808c740 con 0x7f41701dd410 2024-04-17T05:27:07.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.762+0000 7f4175400640 1 --2- 172.21.15.123:0/988218889 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f415006c8f0 0x7f415006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:07.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.763+0000 7f4175400640 1 --2- 172.21.15.123:0/988218889 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f415006c8f0 0x7f415006edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4160034000 tx=0x7f4160007000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:07.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.766+0000 7f416d600640 1 -- 172.21.15.123:0/988218889 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f4168003e20 con 0x7f41701dd410 2024-04-17T05:27:07.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.979+0000 7f4176800640 1 -- 172.21.15.123:0/988218889 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f41701264a0 con 0x7f41701dd410 2024-04-17T05:27:07.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.980+0000 7f416d600640 1 -- 172.21.15.123:0/988218889 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f416805a820 con 0x7f41701dd410 2024-04-17T05:27:07.978 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-04-17T05:27:07.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.982+0000 7f4176800640 1 -- 172.21.15.123:0/988218889 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f415006c8f0 msgr2=0x7f415006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:07.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.982+0000 7f4176800640 1 --2- 172.21.15.123:0/988218889 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f415006c8f0 0x7f415006edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4160034000 tx=0x7f4160007000 comp rx=0 tx=0).stop 2024-04-17T05:27:07.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.982+0000 7f4176800640 1 -- 172.21.15.123:0/988218889 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41701dd410 msgr2=0x7f41701dd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:07.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.982+0000 7f4176800640 1 --2- 172.21.15.123:0/988218889 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41701dd410 0x7f41701dd890 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f41700b79c0 tx=0x7f41680115a0 comp rx=0 tx=0).stop 2024-04-17T05:27:07.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.983+0000 7f4176800640 1 -- 172.21.15.123:0/988218889 shutdown_connections 2024-04-17T05:27:07.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.983+0000 7f4176800640 1 --2- 172.21.15.123:0/988218889 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41701dd410 0x7f41701dd890 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:07.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.983+0000 7f4176800640 1 --2- 172.21.15.123:0/988218889 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f417012cf90 0x7f417012d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:07.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.983+0000 7f4176800640 1 --2- 172.21.15.123:0/988218889 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f415006c8f0 0x7f415006edb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:07.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.983+0000 7f4176800640 1 --2- 172.21.15.123:0/988218889 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4154003a00 0x7f4170125770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:07.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.983+0000 7f4176800640 1 -- 172.21.15.123:0/988218889 >> 172.21.15.123:0/988218889 conn(0x7f417006c260 msgr2=0x7f41700bd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:07.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.983+0000 7f4176800640 1 -- 172.21.15.123:0/988218889 shutdown_connections 2024-04-17T05:27:07.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:07.983+0000 7f4176800640 1 -- 172.21.15.123:0/988218889 wait complete. 2024-04-17T05:27:08.000 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-17T05:27:08.000 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T05:27:08.051 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T05:27:08.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.264+0000 7f86e1600640 1 Processor -- start 2024-04-17T05:27:08.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.264+0000 7f86e1600640 1 -- start start 2024-04-17T05:27:08.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.265+0000 7f86e1600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f86dc0b5780 0x7f86dc13df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:08.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.265+0000 7f86e1600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f86dc13e460 0x7f86dc0b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:08.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.265+0000 7f86e1600640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86dc073c10 con 0x7f86dc0b1ab0 2024-04-17T05:27:08.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.265+0000 7f86e1600640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f86dc0b2b60 con 0x7f86dc13e460 2024-04-17T05:27:08.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.265+0000 7f86e1600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f86dc0b2880 con 0x7f86dc0b5780 2024-04-17T05:27:08.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.266+0000 7f86e0c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f86dc13e460 0x7f86dc0b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:08.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.266+0000 7f86e0c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f86dc13e460 0x7f86dc0b3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47128/0 (socket says 172.21.15.123:47128) 2024-04-17T05:27:08.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.266+0000 7f86e0c00640 1 -- 172.21.15.123:0/471271759 learned_addr learned my addr 172.21.15.123:0/471271759 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:08.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.266+0000 7f86d3400640 1 --2- 172.21.15.123:0/471271759 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f86dc0b5780 0x7f86dc13df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:08.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.266+0000 7f86e0c00640 1 -- 172.21.15.123:0/471271759 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f86dc0b5780 msgr2=0x7f86dc13df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:08.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.266+0000 7f86e0c00640 1 --2- 172.21.15.123:0/471271759 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f86dc0b5780 0x7f86dc13df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:08.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.266+0000 7f86e0c00640 1 -- 172.21.15.123:0/471271759 >> v1:172.21.15.164:6789/0 conn(0x7f86dc0b1ab0 legacy=0x7f86dc143ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:08.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.266+0000 7f86e0c00640 1 -- 172.21.15.123:0/471271759 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86dc0b5260 con 0x7f86dc13e460 2024-04-17T05:27:08.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.267+0000 7f86e0c00640 1 --2- 172.21.15.123:0/471271759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86dc13e460 0x7f86dc0b3b50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f86d4009e50 tx=0x7f86d402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=715d5ff80d1b6237 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:08.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.267+0000 7f86db400640 1 -- 172.21.15.123:0/471271759 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d402ca70 con 0x7f86dc13e460 2024-04-17T05:27:08.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.268+0000 7f86db400640 1 -- 172.21.15.123:0/471271759 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86d402cc10 con 0x7f86dc13e460 2024-04-17T05:27:08.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.268+0000 7f86db400640 1 -- 172.21.15.123:0/471271759 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d40343f0 con 0x7f86dc13e460 2024-04-17T05:27:08.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.268+0000 7f86e1600640 1 -- 172.21.15.123:0/471271759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86dc13e460 msgr2=0x7f86dc0b3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:08.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.268+0000 7f86e1600640 1 --2- 172.21.15.123:0/471271759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86dc13e460 0x7f86dc0b3b50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f86d4009e50 tx=0x7f86d402bed0 comp rx=0 tx=0).stop 2024-04-17T05:27:08.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.268+0000 7f86e1600640 1 -- 172.21.15.123:0/471271759 shutdown_connections 2024-04-17T05:27:08.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.268+0000 7f86e1600640 1 --2- 172.21.15.123:0/471271759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86dc13e460 0x7f86dc0b3b50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:08.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.268+0000 7f86e1600640 1 --2- 172.21.15.123:0/471271759 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f86dc0b5780 0x7f86dc13df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:08.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.268+0000 7f86e1600640 1 -- 172.21.15.123:0/471271759 >> 172.21.15.123:0/471271759 conn(0x7f86dc0b9150 msgr2=0x7f86dc0b9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:08.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.268+0000 7f86e1600640 1 -- 172.21.15.123:0/471271759 shutdown_connections 2024-04-17T05:27:08.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.268+0000 7f86e1600640 1 -- 172.21.15.123:0/471271759 wait complete. 2024-04-17T05:27:08.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.270+0000 7f86e1600640 1 Processor -- start 2024-04-17T05:27:08.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.270+0000 7f86e1600640 1 -- start start 2024-04-17T05:27:08.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.271+0000 7f86e1600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86dc0b1ab0 0x7f86dc140530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:08.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.271+0000 7f86e1600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f86dc0b5780 0x7f86dc1dd610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:08.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.271+0000 7f86e1600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86dc0ade70 0x7f86dc1436c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:08.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.271+0000 7f86e1600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f86dc0b25b0 con 0x7f86dc0b1ab0 2024-04-17T05:27:08.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.271+0000 7f86e1600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f86dc0b2430 con 0x7f86dc0ade70 2024-04-17T05:27:08.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.271+0000 7f86e1600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f86dc0b4090 con 0x7f86dc0b5780 2024-04-17T05:27:08.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.272+0000 7f86dbe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86dc0b1ab0 0x7f86dc140530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:08.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.272+0000 7f86dbe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86dc0b1ab0 0x7f86dc140530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47130/0 (socket says 172.21.15.123:47130) 2024-04-17T05:27:08.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.272+0000 7f86dbe00640 1 -- 172.21.15.123:0/3746418001 learned_addr learned my addr 172.21.15.123:0/3746418001 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:08.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.272+0000 7f86d3400640 1 --2- 172.21.15.123:0/3746418001 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f86dc0b5780 0x7f86dc1dd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:08.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.272+0000 7f86dbe00640 1 -- 172.21.15.123:0/3746418001 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f86dc0b5780 msgr2=0x7f86dc1dd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:08.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.272+0000 7f86dbe00640 1 --2- 172.21.15.123:0/3746418001 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f86dc0b5780 0x7f86dc1dd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:08.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.272+0000 7f86e0c00640 1 --2- 172.21.15.123:0/3746418001 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86dc0ade70 0x7f86dc1436c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:08.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.272+0000 7f86dbe00640 1 -- 172.21.15.123:0/3746418001 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86dc0ade70 msgr2=0x7f86dc1436c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:08.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.272+0000 7f86dbe00640 1 --2- 172.21.15.123:0/3746418001 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86dc0ade70 0x7f86dc1436c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:08.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.272+0000 7f86dbe00640 1 -- 172.21.15.123:0/3746418001 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86dc13d540 con 0x7f86dc0b1ab0 2024-04-17T05:27:08.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.272+0000 7f86d3400640 1 --2- 172.21.15.123:0/3746418001 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f86dc0b5780 0x7f86dc1dd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:08.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.273+0000 7f86dbe00640 1 --2- 172.21.15.123:0/3746418001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86dc0b1ab0 0x7f86dc140530 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f86cc00c3f0 tx=0x7f86cc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:08.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.273+0000 7f86d8c00640 1 -- 172.21.15.123:0/3746418001 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86cc0052d0 con 0x7f86dc0b1ab0 2024-04-17T05:27:08.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.273+0000 7f86d8c00640 1 -- 172.21.15.123:0/3746418001 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86cc005490 con 0x7f86dc0b1ab0 2024-04-17T05:27:08.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.273+0000 7f86d8c00640 1 -- 172.21.15.123:0/3746418001 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86cc007260 con 0x7f86dc0b1ab0 2024-04-17T05:27:08.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.273+0000 7f86e1600640 1 -- 172.21.15.123:0/3746418001 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86dc0af980 con 0x7f86dc0b1ab0 2024-04-17T05:27:08.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.273+0000 7f86e1600640 1 -- 172.21.15.123:0/3746418001 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86dc0ae700 con 0x7f86dc0b1ab0 2024-04-17T05:27:08.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.274+0000 7f86e1600640 1 -- 172.21.15.123:0/3746418001 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86dc0759b0 con 0x7f86dc0b1ab0 2024-04-17T05:27:08.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.275+0000 7f86d8c00640 1 -- 172.21.15.123:0/3746418001 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f86cc007400 con 0x7f86dc0b1ab0 2024-04-17T05:27:08.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.276+0000 7f86d8c00640 1 --2- 172.21.15.123:0/3746418001 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f86b806c920 0x7f86b806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:08.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.276+0000 7f86d8c00640 1 -- 172.21.15.123:0/3746418001 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f86cc08b300 con 0x7f86dc0b1ab0 2024-04-17T05:27:08.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.277+0000 7f86d3400640 1 --2- 172.21.15.123:0/3746418001 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f86b806c920 0x7f86b806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:08.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.278+0000 7f86d3400640 1 --2- 172.21.15.123:0/3746418001 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f86b806c920 0x7f86b806ede0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f86dc141ae0 tx=0x7f86c4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:08.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.281+0000 7f86d8c00640 1 -- 172.21.15.123:0/3746418001 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f86cc059480 con 0x7f86dc0b1ab0 2024-04-17T05:27:08.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.486+0000 7f86e1600640 1 -- 172.21.15.123:0/3746418001 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f86dc0af6a0 con 0x7f86dc0b1ab0 2024-04-17T05:27:08.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.489+0000 7f86d8c00640 1 -- 172.21.15.123:0/3746418001 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18526 (secure 0 0 0) 0x7f86cc058d80 con 0x7f86dc0b1ab0 2024-04-17T05:27:08.487 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:27:08.488 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":26,"fsid":"0787c5c0-e77a-4102-a899-30db48b19c68","created":"2024-04-17T05:26:33.031507+0000","modified":"2024-04-17T05:26:57.743352+0000","last_up_change":"2024-04-17T05:26:44.988433+0000","last_in_change":"2024-04-17T05:26:36.682131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T05:26:46.329778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T05:26:50.600195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T05:26:51.626498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T05:26:55.264044+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15c87cdb-9415-45a6-a2a6-ea6bec9daece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6801","nonce":840753170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6803","nonce":840753170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6807","nonce":840753170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6805","nonce":840753170}]},"public_addr":"172.21.15.123:6801/840753170","cluster_addr":"172.21.15.123:6803/840753170","heartbeat_back_addr":"172.21.15.123:6807/840753170","heartbeat_front_addr":"172.21.15.123:6805/840753170","state":["exists","up"]},{"osd":1,"uuid":"281751b5-486d-4845-b4aa-b308bf7cec62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6822","nonce":2231878927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6827","nonce":2231878927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6831","nonce":2231878927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6829","nonce":2231878927}]},"public_addr":"172.21.15.123:6822/2231878927","cluster_addr":"172.21.15.123:6827/2231878927","heartbeat_back_addr":"172.21.15.123:6831/2231878927","heartbeat_front_addr":"172.21.15.123:6829/2231878927","state":["exists","up"]},{"osd":2,"uuid":"b42257d3-bd20-4db5-aa37-1bf5c512d0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6817","nonce":754360844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6820","nonce":754360844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6825","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6826","nonce":754360844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6823","nonce":754360844}]},"public_addr":"172.21.15.123:6817/754360844","cluster_addr":"172.21.15.123:6820/754360844","heartbeat_back_addr":"172.21.15.123:6826/754360844","heartbeat_front_addr":"172.21.15.123:6823/754360844","state":["exists","up"]},{"osd":3,"uuid":"0f26b891-bbe6-478e-8dee-78e69bb48cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6809","nonce":2898088574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6811","nonce":2898088574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6815","nonce":2898088574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6813","nonce":2898088574}]},"public_addr":"172.21.15.123:6809/2898088574","cluster_addr":"172.21.15.123:6811/2898088574","heartbeat_back_addr":"172.21.15.123:6815/2898088574","heartbeat_front_addr":"172.21.15.123:6813/2898088574","state":["exists","up"]},{"osd":4,"uuid":"43e59318-2740-4625-9d64-eec1fd43c322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6801","nonce":606484349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6804","nonce":606484349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6812","nonce":606484349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6808","nonce":606484349}]},"public_addr":"172.21.15.164:6801/606484349","cluster_addr":"172.21.15.164:6804/606484349","heartbeat_back_addr":"172.21.15.164:6812/606484349","heartbeat_front_addr":"172.21.15.164:6808/606484349","state":["exists","up"]},{"osd":5,"uuid":"aaa3acf4-4adc-4337-aba3-363851d35310","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6805","nonce":1376989593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6809","nonce":1376989593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6815","nonce":1376989593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6813","nonce":1376989593}]},"public_addr":"172.21.15.164:6805/1376989593","cluster_addr":"172.21.15.164:6809/1376989593","heartbeat_back_addr":"172.21.15.164:6815/1376989593","heartbeat_front_addr":"172.21.15.164:6813/1376989593","state":["exists","up"]},{"osd":6,"uuid":"6f765b27-7377-4d81-9192-23a965651145","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6817","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6821","nonce":1594306924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6823","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6826","nonce":1594306924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6831","nonce":1594306924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6829","nonce":1594306924}]},"public_addr":"172.21.15.164:6821/1594306924","cluster_addr":"172.21.15.164:6826/1594306924","heartbeat_back_addr":"172.21.15.164:6831/1594306924","heartbeat_front_addr":"172.21.15.164:6829/1594306924","state":["exists","up"]},{"osd":7,"uuid":"5547394b-ec2f-4311-846d-369af4b1acf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6818","nonce":295402697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6819","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6820","nonce":295402697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6825","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6827","nonce":295402697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6824","nonce":295402697}]},"public_addr":"172.21.15.164:6818/295402697","cluster_addr":"172.21.15.164:6820/295402697","heartbeat_back_addr":"172.21.15.164:6827/295402697","heartbeat_front_addr":"172.21.15.164:6824/295402697","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.034807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.022201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.751897+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.850533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.083608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.047524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.314753+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.413586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T05:27:08.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.492+0000 7f86e1600640 1 -- 172.21.15.123:0/3746418001 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f86b806c920 msgr2=0x7f86b806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:08.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.492+0000 7f86e1600640 1 --2- 172.21.15.123:0/3746418001 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f86b806c920 0x7f86b806ede0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f86dc141ae0 tx=0x7f86c4008040 comp rx=0 tx=0).stop 2024-04-17T05:27:08.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.492+0000 7f86e1600640 1 -- 172.21.15.123:0/3746418001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86dc0b1ab0 msgr2=0x7f86dc140530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:08.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.492+0000 7f86e1600640 1 --2- 172.21.15.123:0/3746418001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86dc0b1ab0 0x7f86dc140530 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f86cc00c3f0 tx=0x7f86cc00c8b0 comp rx=0 tx=0).stop 2024-04-17T05:27:08.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.492+0000 7f86e1600640 1 -- 172.21.15.123:0/3746418001 shutdown_connections 2024-04-17T05:27:08.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.492+0000 7f86e1600640 1 --2- 172.21.15.123:0/3746418001 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86dc0ade70 0x7f86dc1436c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:08.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.492+0000 7f86e1600640 1 --2- 172.21.15.123:0/3746418001 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f86b806c920 0x7f86b806ede0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:08.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.492+0000 7f86e1600640 1 --2- 172.21.15.123:0/3746418001 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f86dc0b5780 0x7f86dc1dd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:08.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.492+0000 7f86e1600640 1 --2- 172.21.15.123:0/3746418001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86dc0b1ab0 0x7f86dc140530 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:08.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.492+0000 7f86e1600640 1 -- 172.21.15.123:0/3746418001 >> 172.21.15.123:0/3746418001 conn(0x7f86dc0b9150 msgr2=0x7f86dc0676c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:08.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.492+0000 7f86e1600640 1 -- 172.21.15.123:0/3746418001 shutdown_connections 2024-04-17T05:27:08.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.492+0000 7f86e1600640 1 -- 172.21.15.123:0/3746418001 wait complete. 2024-04-17T05:27:08.510 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T05:26:46.329778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T05:26:50.600195+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T05:26:51.626498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T05:26:55.264044+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T05:27:08.510 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T05:27:08.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.713+0000 7f1368600640 1 Processor -- start 2024-04-17T05:27:08.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.713+0000 7f1368600640 1 -- start start 2024-04-17T05:27:08.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.714+0000 7f1368600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f13600b9b20 0x7f13600b7c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:08.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.714+0000 7f1368600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13600b5ca0 0x7f13600b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:08.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.714+0000 7f1368600640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13600b92a0 con 0x7f13600b4dd0 2024-04-17T05:27:08.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.714+0000 7f1368600640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f1360073fe0 con 0x7f13600b9b20 2024-04-17T05:27:08.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.714+0000 7f1368600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f13600b9f00 con 0x7f13600b5ca0 2024-04-17T05:27:08.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.715+0000 7f1365c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f13600b9b20 0x7f13600b7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:08.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.715+0000 7f1365200640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f13600b4dd0 0x7f13600b5200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36152/0 (socket says 172.21.15.123:36152) 2024-04-17T05:27:08.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.715+0000 7f1365200640 1 -- 172.21.15.123:0/1063440858 learned_addr learned my addr 172.21.15.123:0/1063440858 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:27:08.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.715+0000 7f1365c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f13600b9b20 0x7f13600b7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47144/0 (socket says 172.21.15.123:47144) 2024-04-17T05:27:08.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.715+0000 7f1366600640 1 --2- 172.21.15.123:0/1063440858 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13600b5ca0 0x7f13600b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:08.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.715+0000 7f1365c00640 1 -- 172.21.15.123:0/1063440858 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13600b5ca0 msgr2=0x7f13600b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:08.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.715+0000 7f1365c00640 1 --2- 172.21.15.123:0/1063440858 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13600b5ca0 0x7f13600b60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:08.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.715+0000 7f1365c00640 1 -- 172.21.15.123:0/1063440858 >> v1:172.21.15.123:6789/0 conn(0x7f13600b4dd0 legacy=0x7f13600b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:08.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.715+0000 7f1365c00640 1 -- 172.21.15.123:0/1063440858 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13600b8140 con 0x7f13600b9b20 2024-04-17T05:27:08.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.715+0000 7f135fe00640 1 -- 172.21.15.123:0/1063440858 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1014306191 0 0) 0x7f13600b92a0 con 0x7f13600b4dd0 2024-04-17T05:27:08.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.716+0000 7f1365c00640 1 --2- 172.21.15.123:0/1063440858 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13600b9b20 0x7f13600b7c00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f13540097a0 tx=0x7f135402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4578d42e69822d27 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:08.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.717+0000 7f135fe00640 1 -- 172.21.15.123:0/1063440858 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1354035020 con 0x7f13600b9b20 2024-04-17T05:27:08.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.717+0000 7f135fe00640 1 -- 172.21.15.123:0/1063440858 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1354031810 con 0x7f13600b9b20 2024-04-17T05:27:08.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.717+0000 7f135fe00640 1 -- 172.21.15.123:0/1063440858 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1354031be0 con 0x7f13600b9b20 2024-04-17T05:27:08.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.717+0000 7f1368600640 1 -- 172.21.15.123:0/1063440858 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13600b9b20 msgr2=0x7f13600b7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:08.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.717+0000 7f1368600640 1 --2- 172.21.15.123:0/1063440858 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13600b9b20 0x7f13600b7c00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f13540097a0 tx=0x7f135402b8b0 comp rx=0 tx=0).stop 2024-04-17T05:27:08.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.717+0000 7f1368600640 1 -- 172.21.15.123:0/1063440858 shutdown_connections 2024-04-17T05:27:08.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.717+0000 7f1368600640 1 --2- 172.21.15.123:0/1063440858 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13600b5ca0 0x7f13600b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:08.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.717+0000 7f1368600640 1 --2- 172.21.15.123:0/1063440858 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13600b9b20 0x7f13600b7c00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:08.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.717+0000 7f1368600640 1 -- 172.21.15.123:0/1063440858 >> 172.21.15.123:0/1063440858 conn(0x7f136006bda0 msgr2=0x7f136006c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:08.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.717+0000 7f1368600640 1 -- 172.21.15.123:0/1063440858 shutdown_connections 2024-04-17T05:27:08.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.718+0000 7f1368600640 1 -- 172.21.15.123:0/1063440858 wait complete. 2024-04-17T05:27:08.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.719+0000 7f1368600640 1 Processor -- start 2024-04-17T05:27:08.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.719+0000 7f1368600640 1 -- start start 2024-04-17T05:27:08.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.720+0000 7f1368600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13600b4dd0 0x7f13600b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:08.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.720+0000 7f1368600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13600b5ca0 0x7f13601d4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:08.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.720+0000 7f1368600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13600b9b20 0x7f13601d1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:08.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.720+0000 7f1368600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f13600b8400 con 0x7f13600b9b20 2024-04-17T05:27:08.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.720+0000 7f1368600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f13600b48b0 con 0x7f13600b4dd0 2024-04-17T05:27:08.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.720+0000 7f1368600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f13600b6630 con 0x7f13600b5ca0 2024-04-17T05:27:08.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.720+0000 7f1366600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13600b9b20 0x7f13601d1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:08.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.720+0000 7f1366600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13600b9b20 0x7f13601d1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47146/0 (socket says 172.21.15.123:47146) 2024-04-17T05:27:08.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.720+0000 7f1366600640 1 -- 172.21.15.123:0/3362912300 learned_addr learned my addr 172.21.15.123:0/3362912300 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:08.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.721+0000 7f1365c00640 1 --2- 172.21.15.123:0/3362912300 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13600b4dd0 0x7f13600b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:08.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.721+0000 7f1365200640 1 --2- 172.21.15.123:0/3362912300 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13600b5ca0 0x7f13601d4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:08.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.721+0000 7f1366600640 1 -- 172.21.15.123:0/3362912300 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13600b5ca0 msgr2=0x7f13601d4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:08.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.721+0000 7f1366600640 1 --2- 172.21.15.123:0/3362912300 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13600b5ca0 0x7f13601d4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:08.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.721+0000 7f1366600640 1 -- 172.21.15.123:0/3362912300 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13600b4dd0 msgr2=0x7f13600b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:08.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.721+0000 7f1366600640 1 --2- 172.21.15.123:0/3362912300 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13600b4dd0 0x7f13600b2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:08.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.721+0000 7f1366600640 1 -- 172.21.15.123:0/3362912300 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f136009a2c0 con 0x7f13600b9b20 2024-04-17T05:27:08.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.721+0000 7f1365c00640 1 --2- 172.21.15.123:0/3362912300 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13600b4dd0 0x7f13600b2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:08.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.721+0000 7f1365200640 1 --2- 172.21.15.123:0/3362912300 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13600b5ca0 0x7f13601d4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:08.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.721+0000 7f1366600640 1 --2- 172.21.15.123:0/3362912300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13600b9b20 0x7f13601d1d10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f135800cd20 tx=0x7f135800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:08.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.721+0000 7f135d600640 1 -- 172.21.15.123:0/3362912300 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1358003b90 con 0x7f13600b9b20 2024-04-17T05:27:08.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.722+0000 7f135d600640 1 -- 172.21.15.123:0/3362912300 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1358003d30 con 0x7f13600b9b20 2024-04-17T05:27:08.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.722+0000 7f135d600640 1 -- 172.21.15.123:0/3362912300 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1358004240 con 0x7f13600b9b20 2024-04-17T05:27:08.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.722+0000 7f1368600640 1 -- 172.21.15.123:0/3362912300 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13601d6bc0 con 0x7f13600b9b20 2024-04-17T05:27:08.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.722+0000 7f1368600640 1 -- 172.21.15.123:0/3362912300 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1360099400 con 0x7f13600b9b20 2024-04-17T05:27:08.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.723+0000 7f1368600640 1 -- 172.21.15.123:0/3362912300 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1360075bd0 con 0x7f13600b9b20 2024-04-17T05:27:08.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.724+0000 7f135d600640 1 -- 172.21.15.123:0/3362912300 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f13580043e0 con 0x7f13600b9b20 2024-04-17T05:27:08.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.725+0000 7f135d600640 1 --2- 172.21.15.123:0/3362912300 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f134006c920 0x7f134006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:08.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.725+0000 7f135d600640 1 -- 172.21.15.123:0/3362912300 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f135808c990 con 0x7f13600b9b20 2024-04-17T05:27:08.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.725+0000 7f1365c00640 1 --2- 172.21.15.123:0/3362912300 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f134006c920 0x7f134006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:08.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.727+0000 7f1365c00640 1 --2- 172.21.15.123:0/3362912300 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f134006c920 0x7f134006ede0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1354036000 tx=0x7f1354008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:08.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.729+0000 7f135d600640 1 -- 172.21.15.123:0/3362912300 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f135805a9e0 con 0x7f13600b9b20 2024-04-17T05:27:08.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.928+0000 7f1368600640 1 -- 172.21.15.123:0/3362912300 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f136009d6f0 con 0x7f13600b9b20 2024-04-17T05:27:08.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.929+0000 7f135d600640 1 -- 172.21.15.123:0/3362912300 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f135805a2e0 con 0x7f13600b9b20 2024-04-17T05:27:08.927 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-04-17T05:27:08.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.932+0000 7f1368600640 1 -- 172.21.15.123:0/3362912300 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f134006c920 msgr2=0x7f134006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:08.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.932+0000 7f1368600640 1 --2- 172.21.15.123:0/3362912300 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f134006c920 0x7f134006ede0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1354036000 tx=0x7f1354008030 comp rx=0 tx=0).stop 2024-04-17T05:27:08.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.932+0000 7f1368600640 1 -- 172.21.15.123:0/3362912300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13600b9b20 msgr2=0x7f13601d1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:08.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.932+0000 7f1368600640 1 --2- 172.21.15.123:0/3362912300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13600b9b20 0x7f13601d1d10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f135800cd20 tx=0x7f135800a660 comp rx=0 tx=0).stop 2024-04-17T05:27:08.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.932+0000 7f1368600640 1 -- 172.21.15.123:0/3362912300 shutdown_connections 2024-04-17T05:27:08.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.932+0000 7f1368600640 1 --2- 172.21.15.123:0/3362912300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13600b9b20 0x7f13601d1d10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:08.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.932+0000 7f1368600640 1 --2- 172.21.15.123:0/3362912300 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f134006c920 0x7f134006ede0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:08.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.932+0000 7f1368600640 1 --2- 172.21.15.123:0/3362912300 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13600b5ca0 0x7f13601d4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:08.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.932+0000 7f1368600640 1 --2- 172.21.15.123:0/3362912300 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13600b4dd0 0x7f13600b2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:08.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.932+0000 7f1368600640 1 -- 172.21.15.123:0/3362912300 >> 172.21.15.123:0/3362912300 conn(0x7f136006bda0 msgr2=0x7f13600676c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:08.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.933+0000 7f1368600640 1 -- 172.21.15.123:0/3362912300 shutdown_connections 2024-04-17T05:27:08.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:08.933+0000 7f1368600640 1 -- 172.21.15.123:0/3362912300 wait complete. 2024-04-17T05:27:08.948 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T05:27:09.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.168+0000 7fe8f7200640 1 Processor -- start 2024-04-17T05:27:09.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.168+0000 7fe8f7200640 1 -- start start 2024-04-17T05:27:09.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.169+0000 7fe8f7200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe8f009d630 0x7fe8f009da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:09.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.170+0000 7fe8f7200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8f01492e0 0x7fe8f0149740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:09.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.170+0000 7fe8f7200640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8f009cc30 con 0x7fe8f006d060 2024-04-17T05:27:09.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.170+0000 7fe8f7200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe8f009bcf0 con 0x7fe8f009d630 2024-04-17T05:27:09.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.170+0000 7fe8f7200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fe8f009cea0 con 0x7fe8f01492e0 2024-04-17T05:27:09.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.170+0000 7fe8efe00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe8f009d630 0x7fe8f009da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:09.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.170+0000 7fe8efe00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe8f009d630 0x7fe8f009da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47148/0 (socket says 172.21.15.123:47148) 2024-04-17T05:27:09.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.170+0000 7fe8efe00640 1 -- 172.21.15.123:0/3235993485 learned_addr learned my addr 172.21.15.123:0/3235993485 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:09.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.170+0000 7fe8efe00640 1 -- 172.21.15.123:0/3235993485 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8f01492e0 msgr2=0x7fe8f0149740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:09.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.170+0000 7fe8ef400640 1 --2- 172.21.15.123:0/3235993485 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8f01492e0 0x7fe8f0149740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:09.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.170+0000 7fe8efe00640 1 --2- 172.21.15.123:0/3235993485 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8f01492e0 0x7fe8f0149740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:09.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.170+0000 7fe8efe00640 1 -- 172.21.15.123:0/3235993485 >> v1:172.21.15.164:6789/0 conn(0x7fe8f006d060 legacy=0x7fe8f006d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:09.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.170+0000 7fe8efe00640 1 -- 172.21.15.123:0/3235993485 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f0149c80 con 0x7fe8f009d630 2024-04-17T05:27:09.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.171+0000 7fe8efe00640 1 --2- 172.21.15.123:0/3235993485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8f009d630 0x7fe8f009da10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0009870 tx=0x7fe8e002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb06de7913ef63a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:09.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.172+0000 7fe8eea00640 1 -- 172.21.15.123:0/3235993485 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e00317c0 con 0x7fe8f009d630 2024-04-17T05:27:09.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.172+0000 7fe8eea00640 1 -- 172.21.15.123:0/3235993485 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8e0037070 con 0x7fe8f009d630 2024-04-17T05:27:09.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.172+0000 7fe8eea00640 1 -- 172.21.15.123:0/3235993485 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0031b80 con 0x7fe8f009d630 2024-04-17T05:27:09.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.172+0000 7fe8f7200640 1 -- 172.21.15.123:0/3235993485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8f009d630 msgr2=0x7fe8f009da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:09.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.172+0000 7fe8f7200640 1 --2- 172.21.15.123:0/3235993485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8f009d630 0x7fe8f009da10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0009870 tx=0x7fe8e002b860 comp rx=0 tx=0).stop 2024-04-17T05:27:09.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.172+0000 7fe8f7200640 1 -- 172.21.15.123:0/3235993485 shutdown_connections 2024-04-17T05:27:09.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.172+0000 7fe8f7200640 1 --2- 172.21.15.123:0/3235993485 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8f01492e0 0x7fe8f0149740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:09.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.172+0000 7fe8f7200640 1 --2- 172.21.15.123:0/3235993485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8f009d630 0x7fe8f009da10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:09.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.172+0000 7fe8f7200640 1 -- 172.21.15.123:0/3235993485 >> 172.21.15.123:0/3235993485 conn(0x7fe8f00b93b0 msgr2=0x7fe8f00b97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:09.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.173+0000 7fe8f7200640 1 -- 172.21.15.123:0/3235993485 shutdown_connections 2024-04-17T05:27:09.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.173+0000 7fe8f7200640 1 -- 172.21.15.123:0/3235993485 wait complete. 2024-04-17T05:27:09.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.174+0000 7fe8f7200640 1 Processor -- start 2024-04-17T05:27:09.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.174+0000 7fe8f7200640 1 -- start start 2024-04-17T05:27:09.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.175+0000 7fe8f7200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8f006d060 0x7fe8f0072c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:09.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.175+0000 7fe8f7200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8f009d630 0x7fe8f0071a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:09.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.175+0000 7fe8f7200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8f01492e0 0x7fe8f0070aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:09.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.175+0000 7fe8f7200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f009b980 con 0x7fe8f01492e0 2024-04-17T05:27:09.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.175+0000 7fe8f7200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f009b6a0 con 0x7fe8f006d060 2024-04-17T05:27:09.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.175+0000 7fe8f7200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fe8f00b5b10 con 0x7fe8f009d630 2024-04-17T05:27:09.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.175+0000 7fe8f5200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8f01492e0 0x7fe8f0070aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:09.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.175+0000 7fe8f5200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8f01492e0 0x7fe8f0070aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47156/0 (socket says 172.21.15.123:47156) 2024-04-17T05:27:09.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.175+0000 7fe8f5200640 1 -- 172.21.15.123:0/688958912 learned_addr learned my addr 172.21.15.123:0/688958912 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:09.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.176+0000 7fe8ef400640 1 --2- 172.21.15.123:0/688958912 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8f009d630 0x7fe8f0071a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:09.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.176+0000 7fe8efe00640 1 --2- 172.21.15.123:0/688958912 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8f006d060 0x7fe8f0072c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:09.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.176+0000 7fe8f5200640 1 -- 172.21.15.123:0/688958912 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8f009d630 msgr2=0x7fe8f0071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:09.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.176+0000 7fe8f5200640 1 --2- 172.21.15.123:0/688958912 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8f009d630 0x7fe8f0071a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:09.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.176+0000 7fe8f5200640 1 -- 172.21.15.123:0/688958912 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8f006d060 msgr2=0x7fe8f0072c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:09.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.176+0000 7fe8f5200640 1 --2- 172.21.15.123:0/688958912 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8f006d060 0x7fe8f0072c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:09.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.176+0000 7fe8f5200640 1 -- 172.21.15.123:0/688958912 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f0071f50 con 0x7fe8f01492e0 2024-04-17T05:27:09.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.176+0000 7fe8f5200640 1 --2- 172.21.15.123:0/688958912 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8f01492e0 0x7fe8f0070aa0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe8e800c7b0 tx=0x7fe8e800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:09.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.176+0000 7fe8e7e00640 1 -- 172.21.15.123:0/688958912 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e8004b60 con 0x7fe8f01492e0 2024-04-17T05:27:09.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.176+0000 7fe8e7e00640 1 -- 172.21.15.123:0/688958912 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8e8004d00 con 0x7fe8f01492e0 2024-04-17T05:27:09.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.176+0000 7fe8e7e00640 1 -- 172.21.15.123:0/688958912 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e800aa90 con 0x7fe8f01492e0 2024-04-17T05:27:09.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.177+0000 7fe8f7200640 1 -- 172.21.15.123:0/688958912 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8f00704e0 con 0x7fe8f01492e0 2024-04-17T05:27:09.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.177+0000 7fe8f7200640 1 -- 172.21.15.123:0/688958912 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8f00724b0 con 0x7fe8f01492e0 2024-04-17T05:27:09.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.178+0000 7fe8f7200640 1 -- 172.21.15.123:0/688958912 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8f0068a40 con 0x7fe8f01492e0 2024-04-17T05:27:09.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.179+0000 7fe8e7e00640 1 -- 172.21.15.123:0/688958912 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe8e800ac30 con 0x7fe8f01492e0 2024-04-17T05:27:09.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.179+0000 7fe8e7e00640 1 --2- 172.21.15.123:0/688958912 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe8d006c920 0x7fe8d006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:09.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.180+0000 7fe8e7e00640 1 -- 172.21.15.123:0/688958912 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe8e808c140 con 0x7fe8f01492e0 2024-04-17T05:27:09.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.180+0000 7fe8efe00640 1 --2- 172.21.15.123:0/688958912 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe8d006c920 0x7fe8d006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:09.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.181+0000 7fe8efe00640 1 --2- 172.21.15.123:0/688958912 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe8d006c920 0x7fe8d006ede0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0036000 tx=0x7fe8e003d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:09.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.184+0000 7fe8e7e00640 1 -- 172.21.15.123:0/688958912 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fe8e8020070 con 0x7fe8f01492e0 2024-04-17T05:27:09.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.388+0000 7fe8f7200640 1 -- 172.21.15.123:0/688958912 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe8f00afe30 con 0x7fe8f01492e0 2024-04-17T05:27:09.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.389+0000 7fe8e7e00640 1 -- 172.21.15.123:0/688958912 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7fe8f0071f50 con 0x7fe8f01492e0 2024-04-17T05:27:09.388 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-04-17T05:27:09.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.392+0000 7fe8f7200640 1 -- 172.21.15.123:0/688958912 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe8d006c920 msgr2=0x7fe8d006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:09.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.392+0000 7fe8f7200640 1 --2- 172.21.15.123:0/688958912 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe8d006c920 0x7fe8d006ede0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0036000 tx=0x7fe8e003d040 comp rx=0 tx=0).stop 2024-04-17T05:27:09.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.392+0000 7fe8f7200640 1 -- 172.21.15.123:0/688958912 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8f01492e0 msgr2=0x7fe8f0070aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:09.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.392+0000 7fe8f7200640 1 --2- 172.21.15.123:0/688958912 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8f01492e0 0x7fe8f0070aa0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe8e800c7b0 tx=0x7fe8e800cc70 comp rx=0 tx=0).stop 2024-04-17T05:27:09.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.392+0000 7fe8f7200640 1 -- 172.21.15.123:0/688958912 shutdown_connections 2024-04-17T05:27:09.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.392+0000 7fe8f7200640 1 --2- 172.21.15.123:0/688958912 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8f01492e0 0x7fe8f0070aa0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:09.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.392+0000 7fe8f7200640 1 --2- 172.21.15.123:0/688958912 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe8d006c920 0x7fe8d006ede0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:09.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.392+0000 7fe8f7200640 1 --2- 172.21.15.123:0/688958912 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8f009d630 0x7fe8f0071a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:09.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.392+0000 7fe8f7200640 1 --2- 172.21.15.123:0/688958912 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe8f006d060 0x7fe8f0072c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:09.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.392+0000 7fe8f7200640 1 -- 172.21.15.123:0/688958912 >> 172.21.15.123:0/688958912 conn(0x7fe8f00b93b0 msgr2=0x7fe8f00b9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:09.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.392+0000 7fe8f7200640 1 -- 172.21.15.123:0/688958912 shutdown_connections 2024-04-17T05:27:09.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.392+0000 7fe8f7200640 1 -- 172.21.15.123:0/688958912 wait complete. 2024-04-17T05:27:09.409 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T05:27:09.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.619+0000 7fd231400640 1 Processor -- start 2024-04-17T05:27:09.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.619+0000 7fd231400640 1 -- start start 2024-04-17T05:27:09.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.621+0000 7fd231400640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd22c0b5090 0x7fd22c1414d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:09.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.621+0000 7fd231400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd22c141a10 0x7fd22c152410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:09.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.621+0000 7fd231400640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd22c0b6800 con 0x7fd22c0b6420 2024-04-17T05:27:09.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.621+0000 7fd231400640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7fd22c147a90 con 0x7fd22c0b5090 2024-04-17T05:27:09.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.621+0000 7fd231400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fd22c147d70 con 0x7fd22c141a10 2024-04-17T05:27:09.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.622+0000 7fd22b400640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd22c0b5090 0x7fd22c1414d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:09.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.622+0000 7fd230a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd22c141a10 0x7fd22c152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:09.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.622+0000 7fd230a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd22c141a10 0x7fd22c152410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.123:46400/0 (socket says 172.21.15.123:46400) 2024-04-17T05:27:09.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.622+0000 7fd230a00640 1 -- 172.21.15.123:0/1285970154 learned_addr learned my addr 172.21.15.123:0/1285970154 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:09.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.622+0000 7fd22b400640 1 -- 172.21.15.123:0/1285970154 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd22c141a10 msgr2=0x7fd22c152410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:09.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.622+0000 7fd22b400640 1 --2- 172.21.15.123:0/1285970154 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd22c141a10 0x7fd22c152410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:09.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.622+0000 7fd22b400640 1 -- 172.21.15.123:0/1285970154 >> v1:172.21.15.164:6789/0 conn(0x7fd22c0b6420 legacy=0x7fd22c148200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:09.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.623+0000 7fd22b400640 1 -- 172.21.15.123:0/1285970154 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd22c0b7740 con 0x7fd22c0b5090 2024-04-17T05:27:09.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.623+0000 7fd230a00640 1 --2- 172.21.15.123:0/1285970154 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd22c141a10 0x7fd22c152410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T05:27:09.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.624+0000 7fd22b400640 1 --2- 172.21.15.123:0/1285970154 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd22c0b5090 0x7fd22c1414d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd214009d90 tx=0x7fd21402bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccc308fbfdfcef5e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:09.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.624+0000 7fd22aa00640 1 -- 172.21.15.123:0/1285970154 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd214039070 con 0x7fd22c0b5090 2024-04-17T05:27:09.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.624+0000 7fd22aa00640 1 -- 172.21.15.123:0/1285970154 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd21402cb30 con 0x7fd22c0b5090 2024-04-17T05:27:09.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.624+0000 7fd22aa00640 1 -- 172.21.15.123:0/1285970154 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd214034440 con 0x7fd22c0b5090 2024-04-17T05:27:09.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.625+0000 7fd231400640 1 -- 172.21.15.123:0/1285970154 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd22c0b5090 msgr2=0x7fd22c1414d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:09.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.625+0000 7fd231400640 1 --2- 172.21.15.123:0/1285970154 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd22c0b5090 0x7fd22c1414d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd214009d90 tx=0x7fd21402bd80 comp rx=0 tx=0).stop 2024-04-17T05:27:09.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.625+0000 7fd231400640 1 -- 172.21.15.123:0/1285970154 shutdown_connections 2024-04-17T05:27:09.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.625+0000 7fd231400640 1 --2- 172.21.15.123:0/1285970154 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd22c141a10 0x7fd22c152410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:09.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.625+0000 7fd231400640 1 --2- 172.21.15.123:0/1285970154 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd22c0b5090 0x7fd22c1414d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:09.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.625+0000 7fd231400640 1 -- 172.21.15.123:0/1285970154 >> 172.21.15.123:0/1285970154 conn(0x7fd22c06c260 msgr2=0x7fd22c0bd370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:09.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.625+0000 7fd231400640 1 -- 172.21.15.123:0/1285970154 shutdown_connections 2024-04-17T05:27:09.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.625+0000 7fd231400640 1 -- 172.21.15.123:0/1285970154 wait complete. 2024-04-17T05:27:09.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.627+0000 7fd231400640 1 Processor -- start 2024-04-17T05:27:09.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.628+0000 7fd231400640 1 -- start start 2024-04-17T05:27:09.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.629+0000 7fd231400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd22c0b5090 0x7fd22c13bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:09.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.629+0000 7fd231400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd22c0b6420 0x7fd22c1373a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:09.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.629+0000 7fd231400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd22c141a10 0x7fd22c1363b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:09.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.629+0000 7fd231400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd22c0b73c0 con 0x7fd22c0b6420 2024-04-17T05:27:09.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.629+0000 7fd231400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd22c141ec0 con 0x7fd22c141a10 2024-04-17T05:27:09.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.629+0000 7fd231400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fd22c148910 con 0x7fd22c0b5090 2024-04-17T05:27:09.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.629+0000 7fd22b400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd22c0b6420 0x7fd22c1373a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:09.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.629+0000 7fd22b400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd22c0b6420 0x7fd22c1373a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47162/0 (socket says 172.21.15.123:47162) 2024-04-17T05:27:09.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.629+0000 7fd22b400640 1 -- 172.21.15.123:0/2176280215 learned_addr learned my addr 172.21.15.123:0/2176280215 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:09.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.629+0000 7fd22be00640 1 --2- 172.21.15.123:0/2176280215 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd22c0b5090 0x7fd22c13bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:09.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.629+0000 7fd230a00640 1 --2- 172.21.15.123:0/2176280215 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd22c141a10 0x7fd22c1363b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:09.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.630+0000 7fd22b400640 1 -- 172.21.15.123:0/2176280215 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd22c0b5090 msgr2=0x7fd22c13bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:09.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.630+0000 7fd22b400640 1 --2- 172.21.15.123:0/2176280215 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd22c0b5090 0x7fd22c13bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:09.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.630+0000 7fd22b400640 1 -- 172.21.15.123:0/2176280215 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd22c141a10 msgr2=0x7fd22c1363b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:09.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.630+0000 7fd22b400640 1 --2- 172.21.15.123:0/2176280215 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd22c141a10 0x7fd22c1363b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:09.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.630+0000 7fd22b400640 1 -- 172.21.15.123:0/2176280215 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd22c13a340 con 0x7fd22c0b6420 2024-04-17T05:27:09.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.630+0000 7fd22b400640 1 --2- 172.21.15.123:0/2176280215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd22c0b6420 0x7fd22c1373a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd214037040 tx=0x7fd214004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:09.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.630+0000 7fd223e00640 1 -- 172.21.15.123:0/2176280215 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd214039050 con 0x7fd22c0b6420 2024-04-17T05:27:09.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.630+0000 7fd223e00640 1 -- 172.21.15.123:0/2176280215 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd214045070 con 0x7fd22c0b6420 2024-04-17T05:27:09.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.630+0000 7fd223e00640 1 -- 172.21.15.123:0/2176280215 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21403e850 con 0x7fd22c0b6420 2024-04-17T05:27:09.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.630+0000 7fd231400640 1 -- 172.21.15.123:0/2176280215 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd22c14a1b0 con 0x7fd22c0b6420 2024-04-17T05:27:09.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.630+0000 7fd231400640 1 -- 172.21.15.123:0/2176280215 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd22c139e20 con 0x7fd22c0b6420 2024-04-17T05:27:09.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.632+0000 7fd231400640 1 -- 172.21.15.123:0/2176280215 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd22c075b30 con 0x7fd22c0b6420 2024-04-17T05:27:09.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.632+0000 7fd223e00640 1 -- 172.21.15.123:0/2176280215 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd21403e9f0 con 0x7fd22c0b6420 2024-04-17T05:27:09.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.633+0000 7fd223e00640 1 --2- 172.21.15.123:0/2176280215 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fd20806c8f0 0x7fd20806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:09.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.633+0000 7fd223e00640 1 -- 172.21.15.123:0/2176280215 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd2140aebd0 con 0x7fd22c0b6420 2024-04-17T05:27:09.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.634+0000 7fd22be00640 1 --2- 172.21.15.123:0/2176280215 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fd20806c8f0 0x7fd20806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:09.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.635+0000 7fd22be00640 1 --2- 172.21.15.123:0/2176280215 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fd20806c8f0 0x7fd20806edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd21c007fd0 tx=0x7fd21c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:09.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.638+0000 7fd223e00640 1 -- 172.21.15.123:0/2176280215 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fd214032e20 con 0x7fd22c0b6420 2024-04-17T05:27:09.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.835+0000 7fd231400640 1 -- 172.21.15.123:0/2176280215 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd22c149ed0 con 0x7fd22c0b6420 2024-04-17T05:27:09.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.836+0000 7fd223e00640 1 -- 172.21.15.123:0/2176280215 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fd21407cd30 con 0x7fd22c0b6420 2024-04-17T05:27:09.835 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-04-17T05:27:09.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.838+0000 7fd231400640 1 -- 172.21.15.123:0/2176280215 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fd20806c8f0 msgr2=0x7fd20806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:09.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.839+0000 7fd231400640 1 --2- 172.21.15.123:0/2176280215 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fd20806c8f0 0x7fd20806edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd21c007fd0 tx=0x7fd21c009040 comp rx=0 tx=0).stop 2024-04-17T05:27:09.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.839+0000 7fd231400640 1 -- 172.21.15.123:0/2176280215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd22c0b6420 msgr2=0x7fd22c1373a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:09.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.839+0000 7fd231400640 1 --2- 172.21.15.123:0/2176280215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd22c0b6420 0x7fd22c1373a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd214037040 tx=0x7fd214004a40 comp rx=0 tx=0).stop 2024-04-17T05:27:09.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.839+0000 7fd231400640 1 -- 172.21.15.123:0/2176280215 shutdown_connections 2024-04-17T05:27:09.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.839+0000 7fd231400640 1 --2- 172.21.15.123:0/2176280215 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd22c141a10 0x7fd22c1363b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:09.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.839+0000 7fd231400640 1 --2- 172.21.15.123:0/2176280215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd22c0b6420 0x7fd22c1373a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:09.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.839+0000 7fd231400640 1 --2- 172.21.15.123:0/2176280215 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fd20806c8f0 0x7fd20806edb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:09.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.839+0000 7fd231400640 1 --2- 172.21.15.123:0/2176280215 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd22c0b5090 0x7fd22c13bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:09.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.839+0000 7fd231400640 1 -- 172.21.15.123:0/2176280215 >> 172.21.15.123:0/2176280215 conn(0x7fd22c06c260 msgr2=0x7fd22c146e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:09.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.839+0000 7fd231400640 1 -- 172.21.15.123:0/2176280215 shutdown_connections 2024-04-17T05:27:09.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:09.839+0000 7fd231400640 1 -- 172.21.15.123:0/2176280215 wait complete. 2024-04-17T05:27:09.856 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T05:27:10.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.065+0000 7fdff0c00640 1 Processor -- start 2024-04-17T05:27:10.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.066+0000 7fdff0c00640 1 -- start start 2024-04-17T05:27:10.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.067+0000 7fdff0c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdfec1499f0 0x7fdfec09da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:10.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.067+0000 7fdff0c00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fdfec142b30 0x7fdfec142f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:10.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.067+0000 7fdff0c00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfec09cc30 con 0x7fdfec09d630 2024-04-17T05:27:10.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.067+0000 7fdff0c00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fdfec09bcf0 con 0x7fdfec1499f0 2024-04-17T05:27:10.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.067+0000 7fdff0c00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7fdfec09cea0 con 0x7fdfec142b30 2024-04-17T05:27:10.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.067+0000 7fdfe9e00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fdfec09d630 0x7fdfec1492e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36156/0 (socket says 172.21.15.123:36156) 2024-04-17T05:27:10.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.067+0000 7fdfe9e00640 1 -- 172.21.15.123:0/3137154605 learned_addr learned my addr 172.21.15.123:0/3137154605 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:27:10.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.067+0000 7fdfe9400640 1 --2- 172.21.15.123:0/3137154605 >> v2:172.21.15.123:3300/0 conn(0x7fdfec1499f0 0x7fdfec09da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:10.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.067+0000 7fdfea800640 1 --2- 172.21.15.123:0/3137154605 >> v2:172.21.15.164:3300/0 conn(0x7fdfec142b30 0x7fdfec142f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:10.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.068+0000 7fdfe8a00640 1 -- 172.21.15.123:0/3137154605 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 324684173 0 0) 0x7fdfec09cc30 con 0x7fdfec09d630 2024-04-17T05:27:10.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.068+0000 7fdfe8a00640 1 -- 172.21.15.123:0/3137154605 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfd0003520 con 0x7fdfec09d630 2024-04-17T05:27:10.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.068+0000 7fdfe9400640 1 -- 172.21.15.123:0/3137154605 >> v2:172.21.15.164:3300/0 conn(0x7fdfec142b30 msgr2=0x7fdfec142f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:10.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.068+0000 7fdfe9400640 1 --2- 172.21.15.123:0/3137154605 >> v2:172.21.15.164:3300/0 conn(0x7fdfec142b30 0x7fdfec142f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:10.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.068+0000 7fdfe9400640 1 -- 172.21.15.123:0/3137154605 >> v1:172.21.15.123:6789/0 conn(0x7fdfec09d630 legacy=0x7fdfec1492e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:10.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.068+0000 7fdfe9400640 1 -- 172.21.15.123:0/3137154605 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfec09b3c0 con 0x7fdfec1499f0 2024-04-17T05:27:10.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.069+0000 7fdfe9400640 1 --2- 172.21.15.123:0/3137154605 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfec1499f0 0x7fdfec09da10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdfec0ba440 tx=0x7fdfd802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3267b87aa562b9e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:10.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.069+0000 7fdfe8a00640 1 -- 172.21.15.123:0/3137154605 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd80315a0 con 0x7fdfec1499f0 2024-04-17T05:27:10.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.069+0000 7fdfe8a00640 1 -- 172.21.15.123:0/3137154605 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfd8037070 con 0x7fdfec1499f0 2024-04-17T05:27:10.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.069+0000 7fdfe8a00640 1 -- 172.21.15.123:0/3137154605 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd8031960 con 0x7fdfec1499f0 2024-04-17T05:27:10.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.069+0000 7fdff0c00640 1 -- 172.21.15.123:0/3137154605 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfec1499f0 msgr2=0x7fdfec09da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:10.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.070+0000 7fdff0c00640 1 --2- 172.21.15.123:0/3137154605 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfec1499f0 0x7fdfec09da10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdfec0ba440 tx=0x7fdfd802b840 comp rx=0 tx=0).stop 2024-04-17T05:27:10.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.070+0000 7fdff0c00640 1 -- 172.21.15.123:0/3137154605 shutdown_connections 2024-04-17T05:27:10.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.070+0000 7fdff0c00640 1 --2- 172.21.15.123:0/3137154605 >> v2:172.21.15.164:3300/0 conn(0x7fdfec142b30 0x7fdfec142f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:10.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.070+0000 7fdff0c00640 1 --2- 172.21.15.123:0/3137154605 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfec1499f0 0x7fdfec09da10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:10.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.070+0000 7fdff0c00640 1 -- 172.21.15.123:0/3137154605 >> 172.21.15.123:0/3137154605 conn(0x7fdfec0b93b0 msgr2=0x7fdfec0b97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:10.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.070+0000 7fdff0c00640 1 -- 172.21.15.123:0/3137154605 shutdown_connections 2024-04-17T05:27:10.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.070+0000 7fdff0c00640 1 -- 172.21.15.123:0/3137154605 wait complete. 2024-04-17T05:27:10.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.071+0000 7fdff0c00640 1 Processor -- start 2024-04-17T05:27:10.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.071+0000 7fdff0c00640 1 -- start start 2024-04-17T05:27:10.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.072+0000 7fdff0c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfec09d630 0x7fdfec0704b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:10.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.072+0000 7fdff0c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdfec142b30 0x7fdfec0b8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:10.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.072+0000 7fdff0c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfec1499f0 0x7fdfec0b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:10.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.072+0000 7fdff0c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec0b5b10 con 0x7fdfec09d630 2024-04-17T05:27:10.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.072+0000 7fdff0c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec09b980 con 0x7fdfec142b30 2024-04-17T05:27:10.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.072+0000 7fdff0c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fdfec0b5c90 con 0x7fdfec1499f0 2024-04-17T05:27:10.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.072+0000 7fdfe9e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfec09d630 0x7fdfec0704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:10.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.072+0000 7fdfe9e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfec09d630 0x7fdfec0704b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47178/0 (socket says 172.21.15.123:47178) 2024-04-17T05:27:10.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.072+0000 7fdfe9e00640 1 -- 172.21.15.123:0/1091314019 learned_addr learned my addr 172.21.15.123:0/1091314019 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:10.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.073+0000 7fdfea800640 1 --2- 172.21.15.123:0/1091314019 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfec1499f0 0x7fdfec0b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:10.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.073+0000 7fdfe9e00640 1 -- 172.21.15.123:0/1091314019 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfec1499f0 msgr2=0x7fdfec0b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:10.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.073+0000 7fdfe9400640 1 --2- 172.21.15.123:0/1091314019 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdfec142b30 0x7fdfec0b8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:10.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.073+0000 7fdfe9e00640 1 --2- 172.21.15.123:0/1091314019 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfec1499f0 0x7fdfec0b31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:10.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.073+0000 7fdfe9e00640 1 -- 172.21.15.123:0/1091314019 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdfec142b30 msgr2=0x7fdfec0b8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:10.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.073+0000 7fdfe9e00640 1 --2- 172.21.15.123:0/1091314019 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdfec142b30 0x7fdfec0b8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:10.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.073+0000 7fdfe9e00640 1 -- 172.21.15.123:0/1091314019 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfec0b3730 con 0x7fdfec09d630 2024-04-17T05:27:10.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.073+0000 7fdfea800640 1 --2- 172.21.15.123:0/1091314019 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfec1499f0 0x7fdfec0b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:10.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.073+0000 7fdfe9e00640 1 --2- 172.21.15.123:0/1091314019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfec09d630 0x7fdfec0704b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc00c460 tx=0x7fdfdc00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:10.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.073+0000 7fdfe2000640 1 -- 172.21.15.123:0/1091314019 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc017070 con 0x7fdfec09d630 2024-04-17T05:27:10.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.073+0000 7fdfe2000640 1 -- 172.21.15.123:0/1091314019 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfdc005ce0 con 0x7fdfec09d630 2024-04-17T05:27:10.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.073+0000 7fdfe2000640 1 -- 172.21.15.123:0/1091314019 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc007290 con 0x7fdfec09d630 2024-04-17T05:27:10.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.074+0000 7fdff0c00640 1 -- 172.21.15.123:0/1091314019 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfec0b27d0 con 0x7fdfec09d630 2024-04-17T05:27:10.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.074+0000 7fdff0c00640 1 -- 172.21.15.123:0/1091314019 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfec0b1b90 con 0x7fdfec09d630 2024-04-17T05:27:10.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.075+0000 7fdff0c00640 1 -- 172.21.15.123:0/1091314019 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfec068a40 con 0x7fdfec09d630 2024-04-17T05:27:10.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.076+0000 7fdfe2000640 1 -- 172.21.15.123:0/1091314019 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdfdc01a070 con 0x7fdfec09d630 2024-04-17T05:27:10.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.076+0000 7fdfe2000640 1 --2- 172.21.15.123:0/1091314019 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fdfcc06c8f0 0x7fdfcc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:10.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.077+0000 7fdfe2000640 1 -- 172.21.15.123:0/1091314019 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fdfdc08b240 con 0x7fdfec09d630 2024-04-17T05:27:10.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.077+0000 7fdfe9400640 1 --2- 172.21.15.123:0/1091314019 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fdfcc06c8f0 0x7fdfcc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:10.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.078+0000 7fdfe9400640 1 --2- 172.21.15.123:0/1091314019 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fdfcc06c8f0 0x7fdfcc06edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8036000 tx=0x7fdfd8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:10.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.081+0000 7fdfe2000640 1 -- 172.21.15.123:0/1091314019 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fdfec0b3730 con 0x7fdfec09d630 2024-04-17T05:27:10.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.263+0000 7fdff0c00640 1 -- 172.21.15.123:0/1091314019 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fdfec09e490 con 0x7fdfec09d630 2024-04-17T05:27:10.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.264+0000 7fdfe2000640 1 -- 172.21.15.123:0/1091314019 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7fdfdc059320 con 0x7fdfec09d630 2024-04-17T05:27:10.262 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-04-17T05:27:10.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.266+0000 7fdff0c00640 1 -- 172.21.15.123:0/1091314019 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fdfcc06c8f0 msgr2=0x7fdfcc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:10.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.266+0000 7fdff0c00640 1 --2- 172.21.15.123:0/1091314019 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fdfcc06c8f0 0x7fdfcc06edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8036000 tx=0x7fdfd8008030 comp rx=0 tx=0).stop 2024-04-17T05:27:10.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.266+0000 7fdff0c00640 1 -- 172.21.15.123:0/1091314019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfec09d630 msgr2=0x7fdfec0704b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:10.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.266+0000 7fdff0c00640 1 --2- 172.21.15.123:0/1091314019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfec09d630 0x7fdfec0704b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc00c460 tx=0x7fdfdc00c920 comp rx=0 tx=0).stop 2024-04-17T05:27:10.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.266+0000 7fdff0c00640 1 -- 172.21.15.123:0/1091314019 shutdown_connections 2024-04-17T05:27:10.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.266+0000 7fdff0c00640 1 --2- 172.21.15.123:0/1091314019 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fdfcc06c8f0 0x7fdfcc06edb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:10.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.266+0000 7fdff0c00640 1 --2- 172.21.15.123:0/1091314019 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdfec1499f0 0x7fdfec0b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:10.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.266+0000 7fdff0c00640 1 --2- 172.21.15.123:0/1091314019 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdfec142b30 0x7fdfec0b8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:10.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.266+0000 7fdff0c00640 1 --2- 172.21.15.123:0/1091314019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfec09d630 0x7fdfec0704b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:10.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.266+0000 7fdff0c00640 1 -- 172.21.15.123:0/1091314019 >> 172.21.15.123:0/1091314019 conn(0x7fdfec0b93b0 msgr2=0x7fdfec0afa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:10.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.267+0000 7fdff0c00640 1 -- 172.21.15.123:0/1091314019 shutdown_connections 2024-04-17T05:27:10.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.267+0000 7fdff0c00640 1 -- 172.21.15.123:0/1091314019 wait complete. 2024-04-17T05:27:10.283 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-17T05:27:10.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.487+0000 7f50e6000640 1 Processor -- start 2024-04-17T05:27:10.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.488+0000 7f50e6000640 1 -- start start 2024-04-17T05:27:10.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.489+0000 7f50e6000640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f50e00b4bd0 0x7f50e00b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:10.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.489+0000 7f50e6000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f50e0149840 0x7f50e0150440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:10.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.489+0000 7f50e6000640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50e00b4fb0 con 0x7f50e00730d0 2024-04-17T05:27:10.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.489+0000 7f50e6000640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f50e00ba130 con 0x7f50e0149840 2024-04-17T05:27:10.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.489+0000 7f50e6000640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f50e0140360 con 0x7f50e00b4bd0 2024-04-17T05:27:10.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.489+0000 7f50e5600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f50e0149840 0x7f50e0150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:10.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.489+0000 7f50e5600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f50e0149840 0x7f50e0150440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47190/0 (socket says 172.21.15.123:47190) 2024-04-17T05:27:10.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.489+0000 7f50e5600640 1 -- 172.21.15.123:0/2965679757 learned_addr learned my addr 172.21.15.123:0/2965679757 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:10.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.490+0000 7f50e4c00640 1 --2- 172.21.15.123:0/2965679757 >> v2:172.21.15.164:3300/0 conn(0x7f50e00b4bd0 0x7f50e00b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:10.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.490+0000 7f50e5600640 1 -- 172.21.15.123:0/2965679757 >> v2:172.21.15.164:3300/0 conn(0x7f50e00b4bd0 msgr2=0x7f50e00b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:10.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.490+0000 7f50e5600640 1 --2- 172.21.15.123:0/2965679757 >> v2:172.21.15.164:3300/0 conn(0x7f50e00b4bd0 0x7f50e00b3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:10.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.490+0000 7f50e5600640 1 -- 172.21.15.123:0/2965679757 >> v1:172.21.15.164:6789/0 conn(0x7f50e00730d0 legacy=0x7f50e006da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:10.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.490+0000 7f50e5600640 1 -- 172.21.15.123:0/2965679757 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e006cf00 con 0x7f50e0149840 2024-04-17T05:27:10.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.491+0000 7f50e5600640 1 --2- 172.21.15.123:0/2965679757 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50e0149840 0x7f50e0150440 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f50e009bbc0 tx=0x7f50d802bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ebaf2d40c4e56b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:10.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.491+0000 7f50dfe00640 1 -- 172.21.15.123:0/2965679757 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d802c960 con 0x7f50e0149840 2024-04-17T05:27:10.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.491+0000 7f50dfe00640 1 -- 172.21.15.123:0/2965679757 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50d802cb00 con 0x7f50e0149840 2024-04-17T05:27:10.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.491+0000 7f50dfe00640 1 -- 172.21.15.123:0/2965679757 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d80343f0 con 0x7f50e0149840 2024-04-17T05:27:10.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.492+0000 7f50e6000640 1 -- 172.21.15.123:0/2965679757 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50e0149840 msgr2=0x7f50e0150440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:10.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.492+0000 7f50e6000640 1 --2- 172.21.15.123:0/2965679757 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50e0149840 0x7f50e0150440 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f50e009bbc0 tx=0x7f50d802bdc0 comp rx=0 tx=0).stop 2024-04-17T05:27:10.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.492+0000 7f50e6000640 1 -- 172.21.15.123:0/2965679757 shutdown_connections 2024-04-17T05:27:10.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.492+0000 7f50e6000640 1 --2- 172.21.15.123:0/2965679757 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50e0149840 0x7f50e0150440 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:10.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.492+0000 7f50e6000640 1 --2- 172.21.15.123:0/2965679757 >> v2:172.21.15.164:3300/0 conn(0x7f50e00b4bd0 0x7f50e00b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:10.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.492+0000 7f50e6000640 1 -- 172.21.15.123:0/2965679757 >> 172.21.15.123:0/2965679757 conn(0x7f50e006c430 msgr2=0x7f50e00b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:10.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.492+0000 7f50e6000640 1 -- 172.21.15.123:0/2965679757 shutdown_connections 2024-04-17T05:27:10.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.492+0000 7f50e6000640 1 -- 172.21.15.123:0/2965679757 wait complete. 2024-04-17T05:27:10.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.494+0000 7f50e6000640 1 Processor -- start 2024-04-17T05:27:10.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.494+0000 7f50e6000640 1 -- start start 2024-04-17T05:27:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.495+0000 7f50e6000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50e00730d0 0x7f50e01e0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.495+0000 7f50e6000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f50e00b4bd0 0x7f50e0140a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.495+0000 7f50e6000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50e0149840 0x7f50e0147d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.495+0000 7f50e6000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f50e006e130 con 0x7f50e0149840 2024-04-17T05:27:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.495+0000 7f50e6000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f50e006d550 con 0x7f50e00730d0 2024-04-17T05:27:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.495+0000 7f50e6000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f50e0149110 con 0x7f50e00b4bd0 2024-04-17T05:27:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.495+0000 7f50e5600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50e0149840 0x7f50e0147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.495+0000 7f50e5600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50e0149840 0x7f50e0147d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47194/0 (socket says 172.21.15.123:47194) 2024-04-17T05:27:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.495+0000 7f50e5600640 1 -- 172.21.15.123:0/532595233 learned_addr learned my addr 172.21.15.123:0/532595233 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.495+0000 7f50e4c00640 1 --2- 172.21.15.123:0/532595233 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50e00730d0 0x7f50e01e0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.496+0000 7f50d7e00640 1 --2- 172.21.15.123:0/532595233 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f50e00b4bd0 0x7f50e0140a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:10.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.496+0000 7f50e5600640 1 -- 172.21.15.123:0/532595233 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f50e00b4bd0 msgr2=0x7f50e0140a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:10.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.496+0000 7f50e5600640 1 --2- 172.21.15.123:0/532595233 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f50e00b4bd0 0x7f50e0140a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:10.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.496+0000 7f50e5600640 1 -- 172.21.15.123:0/532595233 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50e00730d0 msgr2=0x7f50e01e0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:10.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.496+0000 7f50e5600640 1 --2- 172.21.15.123:0/532595233 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50e00730d0 0x7f50e01e0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:10.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.496+0000 7f50e5600640 1 -- 172.21.15.123:0/532595233 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e01428d0 con 0x7f50e0149840 2024-04-17T05:27:10.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.496+0000 7f50e5600640 1 --2- 172.21.15.123:0/532595233 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50e0149840 0x7f50e0147d10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f50d8036040 tx=0x7f50d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:10.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.496+0000 7f50dd600640 1 -- 172.21.15.123:0/532595233 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d8043020 con 0x7f50e0149840 2024-04-17T05:27:10.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.496+0000 7f50dd600640 1 -- 172.21.15.123:0/532595233 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50d803e450 con 0x7f50e0149840 2024-04-17T05:27:10.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.496+0000 7f50dd600640 1 -- 172.21.15.123:0/532595233 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d803e820 con 0x7f50e0149840 2024-04-17T05:27:10.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.496+0000 7f50e6000640 1 -- 172.21.15.123:0/532595233 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50e0142310 con 0x7f50e0149840 2024-04-17T05:27:10.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.497+0000 7f50e6000640 1 -- 172.21.15.123:0/532595233 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50e01cf000 con 0x7f50e0149840 2024-04-17T05:27:10.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.498+0000 7f50e6000640 1 -- 172.21.15.123:0/532595233 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50e0075b30 con 0x7f50e0149840 2024-04-17T05:27:10.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.499+0000 7f50dd600640 1 -- 172.21.15.123:0/532595233 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f50d8046020 con 0x7f50e0149840 2024-04-17T05:27:10.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.499+0000 7f50dd600640 1 --2- 172.21.15.123:0/532595233 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f50bc06c8f0 0x7f50bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:10.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.500+0000 7f50dd600640 1 -- 172.21.15.123:0/532595233 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f50d80ae740 con 0x7f50e0149840 2024-04-17T05:27:10.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.500+0000 7f50e4c00640 1 --2- 172.21.15.123:0/532595233 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f50bc06c8f0 0x7f50bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:10.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.501+0000 7f50e4c00640 1 --2- 172.21.15.123:0/532595233 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f50bc06c8f0 0x7f50bc06edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f50d0006fd0 tx=0x7f50d0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:10.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.506+0000 7f50dd600640 1 -- 172.21.15.123:0/532595233 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f50d804d030 con 0x7f50e0149840 2024-04-17T05:27:10.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.702+0000 7f50e6000640 1 -- 172.21.15.123:0/532595233 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f50e0143540 con 0x7f50e0149840 2024-04-17T05:27:10.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.703+0000 7f50dd600640 1 -- 172.21.15.123:0/532595233 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f50d807c8c0 con 0x7f50e0149840 2024-04-17T05:27:10.702 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-04-17T05:27:10.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.706+0000 7f50e6000640 1 -- 172.21.15.123:0/532595233 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f50bc06c8f0 msgr2=0x7f50bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:10.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.706+0000 7f50e6000640 1 --2- 172.21.15.123:0/532595233 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f50bc06c8f0 0x7f50bc06edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f50d0006fd0 tx=0x7f50d0008040 comp rx=0 tx=0).stop 2024-04-17T05:27:10.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.706+0000 7f50e6000640 1 -- 172.21.15.123:0/532595233 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50e0149840 msgr2=0x7f50e0147d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:10.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.706+0000 7f50e6000640 1 --2- 172.21.15.123:0/532595233 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50e0149840 0x7f50e0147d10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f50d8036040 tx=0x7f50d8004a40 comp rx=0 tx=0).stop 2024-04-17T05:27:10.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.706+0000 7f50e6000640 1 -- 172.21.15.123:0/532595233 shutdown_connections 2024-04-17T05:27:10.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.706+0000 7f50e6000640 1 --2- 172.21.15.123:0/532595233 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50e0149840 0x7f50e0147d10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:10.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.706+0000 7f50e6000640 1 --2- 172.21.15.123:0/532595233 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f50bc06c8f0 0x7f50bc06edb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:10.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.706+0000 7f50e6000640 1 --2- 172.21.15.123:0/532595233 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f50e00b4bd0 0x7f50e0140a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:10.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.706+0000 7f50e6000640 1 --2- 172.21.15.123:0/532595233 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f50e00730d0 0x7f50e01e0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:10.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.706+0000 7f50e6000640 1 -- 172.21.15.123:0/532595233 >> 172.21.15.123:0/532595233 conn(0x7f50e006c430 msgr2=0x7f50e013e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:10.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.706+0000 7f50e6000640 1 -- 172.21.15.123:0/532595233 shutdown_connections 2024-04-17T05:27:10.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:10.706+0000 7f50e6000640 1 -- 172.21.15.123:0/532595233 wait complete. 2024-04-17T05:27:10.723 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi123.front.sepia.ceph.com... 2024-04-17T05:27:10.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T05:27:10.723 DEBUG:teuthology.orchestra.run.smithi123:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-17T05:27:10.807 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi123.stderr:ceph-fuse[43441]: fuse finished with error 0 and tester_r 0 2024-04-17T05:27:10.812 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T05:27:15.426 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:27:15.434 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:27:16.915 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-04-17T05:27:16.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T05:27:16.915 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-17T05:27:16.980 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T05:27:17.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.195+0000 7ff2f9e00640 1 Processor -- start 2024-04-17T05:27:17.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.195+0000 7ff2f9e00640 1 -- start start 2024-04-17T05:27:17.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.197+0000 7ff2f9e00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff2f40ba6a0 0x7ff2f40b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:17.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.197+0000 7ff2f9e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff2f4141a00 0x7ff2f4141e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:17.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.197+0000 7ff2f9e00640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2f4148240 con 0x7ff2f40b9a80 2024-04-17T05:27:17.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.197+0000 7ff2f9e00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7ff2f40b5e10 con 0x7ff2f40ba6a0 2024-04-17T05:27:17.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.197+0000 7ff2f9e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7ff2f40b71d0 con 0x7ff2f4141a00 2024-04-17T05:27:17.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.197+0000 7ff2f8a00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff2f40ba6a0 0x7ff2f40b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:17.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.197+0000 7ff2f9400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff2f4141a00 0x7ff2f4141e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:17.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.197+0000 7ff2f8a00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff2f40ba6a0 0x7ff2f40b48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.123:44290/0 (socket says 172.21.15.123:44290) 2024-04-17T05:27:17.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.197+0000 7ff2f8a00640 1 -- 172.21.15.123:0/1117060235 learned_addr learned my addr 172.21.15.123:0/1117060235 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:17.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.198+0000 7ff2f9400640 1 -- 172.21.15.123:0/1117060235 >> v2:172.21.15.164:3300/0 conn(0x7ff2f40ba6a0 msgr2=0x7ff2f40b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:17.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.198+0000 7ff2f9400640 1 --2- 172.21.15.123:0/1117060235 >> v2:172.21.15.164:3300/0 conn(0x7ff2f40ba6a0 0x7ff2f40b48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:17.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.198+0000 7ff2f9400640 1 -- 172.21.15.123:0/1117060235 >> v1:172.21.15.164:6789/0 conn(0x7ff2f40b9a80 legacy=0x7ff2f4147b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:17.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.198+0000 7ff2f9400640 1 -- 172.21.15.123:0/1117060235 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f40b57e0 con 0x7ff2f4141a00 2024-04-17T05:27:17.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.199+0000 7ff2f9400640 1 --2- 172.21.15.123:0/1117060235 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff2f4141a00 0x7ff2f4141e70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec0097a0 tx=0x7ff2ec02b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22c418c2655b1509 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:17.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.200+0000 7ff2f3e00640 1 -- 172.21.15.123:0/1117060235 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec031780 con 0x7ff2f4141a00 2024-04-17T05:27:17.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.200+0000 7ff2f3e00640 1 -- 172.21.15.123:0/1117060235 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2ec037070 con 0x7ff2f4141a00 2024-04-17T05:27:17.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.200+0000 7ff2f3e00640 1 -- 172.21.15.123:0/1117060235 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec031b40 con 0x7ff2f4141a00 2024-04-17T05:27:17.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.201+0000 7ff2f9e00640 1 -- 172.21.15.123:0/1117060235 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff2f4141a00 msgr2=0x7ff2f4141e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:17.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.201+0000 7ff2f9e00640 1 --2- 172.21.15.123:0/1117060235 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff2f4141a00 0x7ff2f4141e70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec0097a0 tx=0x7ff2ec02b820 comp rx=0 tx=0).stop 2024-04-17T05:27:17.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.201+0000 7ff2f9e00640 1 -- 172.21.15.123:0/1117060235 shutdown_connections 2024-04-17T05:27:17.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.201+0000 7ff2f9e00640 1 --2- 172.21.15.123:0/1117060235 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff2f4141a00 0x7ff2f4141e70 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:17.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.201+0000 7ff2f9e00640 1 --2- 172.21.15.123:0/1117060235 >> v2:172.21.15.164:3300/0 conn(0x7ff2f40ba6a0 0x7ff2f40b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:17.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.201+0000 7ff2f9e00640 1 -- 172.21.15.123:0/1117060235 >> 172.21.15.123:0/1117060235 conn(0x7ff2f406bda0 msgr2=0x7ff2f406c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:17.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.201+0000 7ff2f9e00640 1 -- 172.21.15.123:0/1117060235 shutdown_connections 2024-04-17T05:27:17.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.202+0000 7ff2f9e00640 1 -- 172.21.15.123:0/1117060235 wait complete. 2024-04-17T05:27:17.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.203+0000 7ff2f9e00640 1 Processor -- start 2024-04-17T05:27:17.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.203+0000 7ff2f9e00640 1 -- start start 2024-04-17T05:27:17.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.204+0000 7ff2f9e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2f40b9a80 0x7ff2f40b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:17.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.204+0000 7ff2f9e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2f40ba6a0 0x7ff2f41dd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:17.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.204+0000 7ff2f9e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff2f4141a00 0x7ff2f41ddf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:17.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.204+0000 7ff2f9e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f40b62a0 con 0x7ff2f40ba6a0 2024-04-17T05:27:17.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.204+0000 7ff2f9e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f40b5a80 con 0x7ff2f40b9a80 2024-04-17T05:27:17.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.204+0000 7ff2f9e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7ff2f40b6420 con 0x7ff2f4141a00 2024-04-17T05:27:17.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.204+0000 7ff2ebe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2f40ba6a0 0x7ff2f41dd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:17.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.205+0000 7ff2ebe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2f40ba6a0 0x7ff2f41dd9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37954/0 (socket says 172.21.15.123:37954) 2024-04-17T05:27:17.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.205+0000 7ff2ebe00640 1 -- 172.21.15.123:0/954244456 learned_addr learned my addr 172.21.15.123:0/954244456 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:17.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.205+0000 7ff2f9400640 1 --2- 172.21.15.123:0/954244456 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff2f4141a00 0x7ff2f41ddf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:17.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.205+0000 7ff2f8a00640 1 --2- 172.21.15.123:0/954244456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2f40b9a80 0x7ff2f40b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:17.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.205+0000 7ff2ebe00640 1 -- 172.21.15.123:0/954244456 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff2f4141a00 msgr2=0x7ff2f41ddf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:17.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.205+0000 7ff2ebe00640 1 --2- 172.21.15.123:0/954244456 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff2f4141a00 0x7ff2f41ddf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:17.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.205+0000 7ff2ebe00640 1 -- 172.21.15.123:0/954244456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2f40b9a80 msgr2=0x7ff2f40b1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:17.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.205+0000 7ff2ebe00640 1 --2- 172.21.15.123:0/954244456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2f40b9a80 0x7ff2f40b1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:17.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.205+0000 7ff2ebe00640 1 -- 172.21.15.123:0/954244456 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f40b3080 con 0x7ff2f40ba6a0 2024-04-17T05:27:17.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.205+0000 7ff2f8a00640 1 --2- 172.21.15.123:0/954244456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2f40b9a80 0x7ff2f40b1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T05:27:17.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.205+0000 7ff2f9400640 1 --2- 172.21.15.123:0/954244456 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff2f4141a00 0x7ff2f41ddf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T05:27:17.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.205+0000 7ff2ebe00640 1 --2- 172.21.15.123:0/954244456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2f40ba6a0 0x7ff2f41dd9c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00c400 tx=0x7ff2dc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:17.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.206+0000 7ff2f1600640 1 -- 172.21.15.123:0/954244456 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc0052d0 con 0x7ff2f40ba6a0 2024-04-17T05:27:17.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.206+0000 7ff2f1600640 1 -- 172.21.15.123:0/954244456 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2dc005490 con 0x7ff2f40ba6a0 2024-04-17T05:27:17.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.206+0000 7ff2f1600640 1 -- 172.21.15.123:0/954244456 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc007260 con 0x7ff2f40ba6a0 2024-04-17T05:27:17.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.206+0000 7ff2f9e00640 1 -- 172.21.15.123:0/954244456 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2f4142ad0 con 0x7ff2f40ba6a0 2024-04-17T05:27:17.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.206+0000 7ff2f9e00640 1 -- 172.21.15.123:0/954244456 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2f41453d0 con 0x7ff2f40ba6a0 2024-04-17T05:27:17.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.207+0000 7ff2f9e00640 1 -- 172.21.15.123:0/954244456 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2f40b21f0 con 0x7ff2f40ba6a0 2024-04-17T05:27:17.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.208+0000 7ff2f1600640 1 -- 172.21.15.123:0/954244456 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff2dc007400 con 0x7ff2f40ba6a0 2024-04-17T05:27:17.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.209+0000 7ff2f1600640 1 --2- 172.21.15.123:0/954244456 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7ff2d006c8f0 0x7ff2d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:17.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.209+0000 7ff2f1600640 1 -- 172.21.15.123:0/954244456 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff2dc08b390 con 0x7ff2f40ba6a0 2024-04-17T05:27:17.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.210+0000 7ff2f8a00640 1 --2- 172.21.15.123:0/954244456 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7ff2d006c8f0 0x7ff2d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:17.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.211+0000 7ff2f8a00640 1 --2- 172.21.15.123:0/954244456 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7ff2d006c8f0 0x7ff2d006edb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4009dc0 tx=0x7ff2e400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:17.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.214+0000 7ff2f1600640 1 -- 172.21.15.123:0/954244456 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7ff2f40b21f0 con 0x7ff2f40ba6a0 2024-04-17T05:27:17.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.418+0000 7ff2f9e00640 1 -- 172.21.15.123:0/954244456 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2f40759b0 con 0x7ff2f40ba6a0 2024-04-17T05:27:17.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.421+0000 7ff2f1600640 1 -- 172.21.15.123:0/954244456 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18526 (secure 0 0 0) 0x7ff2f4142ad0 con 0x7ff2f40ba6a0 2024-04-17T05:27:17.419 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:27:17.420 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":26,"fsid":"0787c5c0-e77a-4102-a899-30db48b19c68","created":"2024-04-17T05:26:33.031507+0000","modified":"2024-04-17T05:26:57.743352+0000","last_up_change":"2024-04-17T05:26:44.988433+0000","last_in_change":"2024-04-17T05:26:36.682131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T05:26:46.329778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T05:26:50.600195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T05:26:51.626498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T05:26:55.264044+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15c87cdb-9415-45a6-a2a6-ea6bec9daece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6801","nonce":840753170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6803","nonce":840753170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6807","nonce":840753170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6805","nonce":840753170}]},"public_addr":"172.21.15.123:6801/840753170","cluster_addr":"172.21.15.123:6803/840753170","heartbeat_back_addr":"172.21.15.123:6807/840753170","heartbeat_front_addr":"172.21.15.123:6805/840753170","state":["exists","up"]},{"osd":1,"uuid":"281751b5-486d-4845-b4aa-b308bf7cec62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6822","nonce":2231878927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6827","nonce":2231878927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6831","nonce":2231878927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6829","nonce":2231878927}]},"public_addr":"172.21.15.123:6822/2231878927","cluster_addr":"172.21.15.123:6827/2231878927","heartbeat_back_addr":"172.21.15.123:6831/2231878927","heartbeat_front_addr":"172.21.15.123:6829/2231878927","state":["exists","up"]},{"osd":2,"uuid":"b42257d3-bd20-4db5-aa37-1bf5c512d0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6817","nonce":754360844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6820","nonce":754360844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6825","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6826","nonce":754360844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6823","nonce":754360844}]},"public_addr":"172.21.15.123:6817/754360844","cluster_addr":"172.21.15.123:6820/754360844","heartbeat_back_addr":"172.21.15.123:6826/754360844","heartbeat_front_addr":"172.21.15.123:6823/754360844","state":["exists","up"]},{"osd":3,"uuid":"0f26b891-bbe6-478e-8dee-78e69bb48cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6809","nonce":2898088574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6811","nonce":2898088574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6815","nonce":2898088574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6813","nonce":2898088574}]},"public_addr":"172.21.15.123:6809/2898088574","cluster_addr":"172.21.15.123:6811/2898088574","heartbeat_back_addr":"172.21.15.123:6815/2898088574","heartbeat_front_addr":"172.21.15.123:6813/2898088574","state":["exists","up"]},{"osd":4,"uuid":"43e59318-2740-4625-9d64-eec1fd43c322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6801","nonce":606484349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6804","nonce":606484349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6812","nonce":606484349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6808","nonce":606484349}]},"public_addr":"172.21.15.164:6801/606484349","cluster_addr":"172.21.15.164:6804/606484349","heartbeat_back_addr":"172.21.15.164:6812/606484349","heartbeat_front_addr":"172.21.15.164:6808/606484349","state":["exists","up"]},{"osd":5,"uuid":"aaa3acf4-4adc-4337-aba3-363851d35310","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6805","nonce":1376989593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6809","nonce":1376989593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6815","nonce":1376989593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6813","nonce":1376989593}]},"public_addr":"172.21.15.164:6805/1376989593","cluster_addr":"172.21.15.164:6809/1376989593","heartbeat_back_addr":"172.21.15.164:6815/1376989593","heartbeat_front_addr":"172.21.15.164:6813/1376989593","state":["exists","up"]},{"osd":6,"uuid":"6f765b27-7377-4d81-9192-23a965651145","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6817","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6821","nonce":1594306924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6823","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6826","nonce":1594306924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6831","nonce":1594306924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6829","nonce":1594306924}]},"public_addr":"172.21.15.164:6821/1594306924","cluster_addr":"172.21.15.164:6826/1594306924","heartbeat_back_addr":"172.21.15.164:6831/1594306924","heartbeat_front_addr":"172.21.15.164:6829/1594306924","state":["exists","up"]},{"osd":7,"uuid":"5547394b-ec2f-4311-846d-369af4b1acf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6818","nonce":295402697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6819","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6820","nonce":295402697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6825","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6827","nonce":295402697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6824","nonce":295402697}]},"public_addr":"172.21.15.164:6818/295402697","cluster_addr":"172.21.15.164:6820/295402697","heartbeat_back_addr":"172.21.15.164:6827/295402697","heartbeat_front_addr":"172.21.15.164:6824/295402697","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.034807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.022201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.751897+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.850533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.083608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.047524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.314753+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.413586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T05:27:17.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.423+0000 7ff2f9e00640 1 -- 172.21.15.123:0/954244456 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7ff2d006c8f0 msgr2=0x7ff2d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:17.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.423+0000 7ff2f9e00640 1 --2- 172.21.15.123:0/954244456 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7ff2d006c8f0 0x7ff2d006edb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4009dc0 tx=0x7ff2e400b040 comp rx=0 tx=0).stop 2024-04-17T05:27:17.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.423+0000 7ff2f9e00640 1 -- 172.21.15.123:0/954244456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2f40ba6a0 msgr2=0x7ff2f41dd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:17.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.423+0000 7ff2f9e00640 1 --2- 172.21.15.123:0/954244456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2f40ba6a0 0x7ff2f41dd9c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00c400 tx=0x7ff2dc00c8c0 comp rx=0 tx=0).stop 2024-04-17T05:27:17.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.423+0000 7ff2f9e00640 1 -- 172.21.15.123:0/954244456 shutdown_connections 2024-04-17T05:27:17.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.423+0000 7ff2f9e00640 1 --2- 172.21.15.123:0/954244456 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7ff2d006c8f0 0x7ff2d006edb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:17.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.423+0000 7ff2f9e00640 1 --2- 172.21.15.123:0/954244456 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff2f4141a00 0x7ff2f41ddf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:17.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.423+0000 7ff2f9e00640 1 --2- 172.21.15.123:0/954244456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2f40ba6a0 0x7ff2f41dd9c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:17.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.423+0000 7ff2f9e00640 1 --2- 172.21.15.123:0/954244456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2f40b9a80 0x7ff2f40b1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:17.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.423+0000 7ff2f9e00640 1 -- 172.21.15.123:0/954244456 >> 172.21.15.123:0/954244456 conn(0x7ff2f406bda0 msgr2=0x7ff2f406c180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:17.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.424+0000 7ff2f9e00640 1 -- 172.21.15.123:0/954244456 shutdown_connections 2024-04-17T05:27:17.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.424+0000 7ff2f9e00640 1 -- 172.21.15.123:0/954244456 wait complete. 2024-04-17T05:27:17.441 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T05:27:17.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.648+0000 7f666d400640 1 Processor -- start 2024-04-17T05:27:17.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.648+0000 7f666d400640 1 -- start start 2024-04-17T05:27:17.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.649+0000 7f666d400640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f66681485f0 0x7f666813e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:17.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.650+0000 7f666d400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66680b5910 con 0x7f66680b3dc0 2024-04-17T05:27:17.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.650+0000 7f666d400640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66680b1870 con 0x7f666813e920 2024-04-17T05:27:17.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.650+0000 7f666d400640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f66680b2c80 con 0x7f66681485f0 2024-04-17T05:27:17.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.650+0000 7f6667e00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f66680b3dc0 0x7f6668147ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54874/0 (socket says 172.21.15.123:54874) 2024-04-17T05:27:17.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.650+0000 7f6667e00640 1 -- 172.21.15.123:0/3675516129 learned_addr learned my addr 172.21.15.123:0/3675516129 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:27:17.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.650+0000 7f665f400640 1 --2- 172.21.15.123:0/3675516129 >> v2:172.21.15.164:3300/0 conn(0x7f66681485f0 0x7f666813e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:17.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.650+0000 7f6667400640 1 -- 172.21.15.123:0/3675516129 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 285298539 0 0) 0x7f66680b5910 con 0x7f66680b3dc0 2024-04-17T05:27:17.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.650+0000 7f6667400640 1 -- 172.21.15.123:0/3675516129 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f664c005730 con 0x7f66680b3dc0 2024-04-17T05:27:17.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.651+0000 7f6667400640 1 -- 172.21.15.123:0/3675516129 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 298725614 0 0) 0x7f664c005730 con 0x7f66680b3dc0 2024-04-17T05:27:17.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.651+0000 7f6667400640 1 -- 172.21.15.123:0/3675516129 >> v2:172.21.15.164:3300/0 conn(0x7f66681485f0 msgr2=0x7f666813e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:17.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.651+0000 7f6667400640 1 --2- 172.21.15.123:0/3675516129 >> v2:172.21.15.164:3300/0 conn(0x7f66681485f0 0x7f666813e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:17.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.651+0000 7f6667400640 1 -- 172.21.15.123:0/3675516129 >> v1:172.21.15.164:6789/0 conn(0x7f666813e920 legacy=0x7f666814f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:17.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.651+0000 7f6667400640 1 -- 172.21.15.123:0/3675516129 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66680b41a0 con 0x7f66680b3dc0 2024-04-17T05:27:17.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.651+0000 7f6667400640 1 -- 172.21.15.123:0/3675516129 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1042962670 0 0) 0x7f6658001a10 con 0x7f66680b3dc0 2024-04-17T05:27:17.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.651+0000 7f6667400640 1 -- 172.21.15.123:0/3675516129 >> v1:172.21.15.123:6789/0 conn(0x7f66680b3dc0 legacy=0x7f6668147ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:17.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.651+0000 7f6667400640 1 --2- 172.21.15.123:0/3675516129 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f664c005bc0 0x7f664c005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:17.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.651+0000 7f6667400640 1 --2- 172.21.15.123:0/3675516129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f664c006a10 0x7f664c006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:17.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.651+0000 7f6667400640 1 --2- 172.21.15.123:0/3675516129 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f664c0073d0 0x7f664c00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:17.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.651+0000 7f6667400640 1 -- 172.21.15.123:0/3675516129 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f66680b2c80 con 0x7f664c006a10 2024-04-17T05:27:17.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.651+0000 7f6667400640 1 -- 172.21.15.123:0/3675516129 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f664c00e370 con 0x7f664c005bc0 2024-04-17T05:27:17.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.651+0000 7f6667400640 1 -- 172.21.15.123:0/3675516129 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f664c00e570 con 0x7f664c0073d0 2024-04-17T05:27:17.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.651+0000 7f665f400640 1 --2- 172.21.15.123:0/3675516129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f664c006a10 0x7f664c006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:17.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.652+0000 7f6667e00640 1 --2- 172.21.15.123:0/3675516129 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f664c005bc0 0x7f664c005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:17.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.652+0000 7f665f400640 1 -- 172.21.15.123:0/3675516129 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f664c0073d0 msgr2=0x7f664c00dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:17.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.652+0000 7f665f400640 1 --2- 172.21.15.123:0/3675516129 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f664c0073d0 0x7f664c00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:17.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.652+0000 7f665f400640 1 -- 172.21.15.123:0/3675516129 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f664c005bc0 msgr2=0x7f664c005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:17.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.652+0000 7f665f400640 1 --2- 172.21.15.123:0/3675516129 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f664c005bc0 0x7f664c005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:17.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.652+0000 7f665f400640 1 -- 172.21.15.123:0/3675516129 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f664c005730 con 0x7f664c006a10 2024-04-17T05:27:17.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.652+0000 7f6667e00640 1 --2- 172.21.15.123:0/3675516129 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f664c005bc0 0x7f664c005fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:17.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.652+0000 7f666ca00640 1 -- 172.21.15.123:0/3675516129 reap_dead start 2024-04-17T05:27:17.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.653+0000 7f665f400640 1 --2- 172.21.15.123:0/3675516129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f664c006a10 0x7f664c006e90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6650009ac0 tx=0x7f664c007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47b8a1f0b63e312f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:17.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.653+0000 7f6667400640 1 -- 172.21.15.123:0/3675516129 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6650039070 con 0x7f664c006a10 2024-04-17T05:27:17.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.653+0000 7f6667400640 1 -- 172.21.15.123:0/3675516129 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f665002c710 con 0x7f664c006a10 2024-04-17T05:27:17.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.653+0000 7f6667400640 1 -- 172.21.15.123:0/3675516129 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6650009690 con 0x7f664c006a10 2024-04-17T05:27:17.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.654+0000 7f666d400640 1 -- 172.21.15.123:0/3675516129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f664c006a10 msgr2=0x7f664c006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:17.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.654+0000 7f666d400640 1 --2- 172.21.15.123:0/3675516129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f664c006a10 0x7f664c006e90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6650009ac0 tx=0x7f664c007a40 comp rx=0 tx=0).stop 2024-04-17T05:27:17.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.654+0000 7f666d400640 1 -- 172.21.15.123:0/3675516129 shutdown_connections 2024-04-17T05:27:17.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.654+0000 7f666d400640 1 --2- 172.21.15.123:0/3675516129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f664c006a10 0x7f664c006e90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:17.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.654+0000 7f666d400640 1 -- 172.21.15.123:0/3675516129 >> 172.21.15.123:0/3675516129 conn(0x7f66680b9150 msgr2=0x7f66680b9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:17.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.654+0000 7f666d400640 1 -- 172.21.15.123:0/3675516129 shutdown_connections 2024-04-17T05:27:17.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.654+0000 7f666d400640 1 -- 172.21.15.123:0/3675516129 wait complete. 2024-04-17T05:27:17.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.655+0000 7f666d400640 1 Processor -- start 2024-04-17T05:27:17.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.656+0000 7f666d400640 1 -- start start 2024-04-17T05:27:17.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.656+0000 7f666d400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f664c006a10 0x7f6668146d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:17.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.656+0000 7f666d400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66681418f0 0x7f66681e1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:17.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.656+0000 7f666d400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66681e1880 0x7f666813a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:17.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.656+0000 7f666d400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f66680b1b10 con 0x7f664c006a10 2024-04-17T05:27:17.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.656+0000 7f666d400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f66680708c0 con 0x7f66681418f0 2024-04-17T05:27:17.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.656+0000 7f666d400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f66680b2a00 con 0x7f66681e1880 2024-04-17T05:27:17.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.657+0000 7f6667e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f664c006a10 0x7f6668146d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:17.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.657+0000 7f6667e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f664c006a10 0x7f6668146d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37970/0 (socket says 172.21.15.123:37970) 2024-04-17T05:27:17.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.657+0000 7f6667e00640 1 -- 172.21.15.123:0/1233574239 learned_addr learned my addr 172.21.15.123:0/1233574239 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:17.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.657+0000 7f6667e00640 1 -- 172.21.15.123:0/1233574239 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66681e1880 msgr2=0x7f666813a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:17.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.657+0000 7f6667e00640 1 --2- 172.21.15.123:0/1233574239 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66681e1880 0x7f666813a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:17.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.657+0000 7f6667e00640 1 -- 172.21.15.123:0/1233574239 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66681418f0 msgr2=0x7f66681e1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:17.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.657+0000 7f6667e00640 1 --2- 172.21.15.123:0/1233574239 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66681418f0 0x7f66681e1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:17.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.657+0000 7f6667e00640 1 -- 172.21.15.123:0/1233574239 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66681cdfa0 con 0x7f664c006a10 2024-04-17T05:27:17.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.657+0000 7f6667e00640 1 --2- 172.21.15.123:0/1233574239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f664c006a10 0x7f6668146d90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6658001ac0 tx=0x7f665800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:17.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.658+0000 7f6664c00640 1 -- 172.21.15.123:0/1233574239 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6658019070 con 0x7f664c006a10 2024-04-17T05:27:17.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.658+0000 7f6664c00640 1 -- 172.21.15.123:0/1233574239 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6658004d60 con 0x7f664c006a10 2024-04-17T05:27:17.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.658+0000 7f6664c00640 1 -- 172.21.15.123:0/1233574239 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66580072f0 con 0x7f664c006a10 2024-04-17T05:27:17.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.658+0000 7f666d400640 1 -- 172.21.15.123:0/1233574239 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66681472d0 con 0x7f664c006a10 2024-04-17T05:27:17.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.658+0000 7f666d400640 1 -- 172.21.15.123:0/1233574239 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66681cdbd0 con 0x7f664c006a10 2024-04-17T05:27:17.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.659+0000 7f666d400640 1 -- 172.21.15.123:0/1233574239 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6668147b80 con 0x7f664c006a10 2024-04-17T05:27:17.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.660+0000 7f6664c00640 1 -- 172.21.15.123:0/1233574239 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6658007490 con 0x7f664c006a10 2024-04-17T05:27:17.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.661+0000 7f6664c00640 1 --2- 172.21.15.123:0/1233574239 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f664406c920 0x7f664406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:17.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.661+0000 7f6664c00640 1 -- 172.21.15.123:0/1233574239 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f665808bf70 con 0x7f664c006a10 2024-04-17T05:27:17.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.661+0000 7f665f400640 1 --2- 172.21.15.123:0/1233574239 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f664406c920 0x7f664406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:17.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.662+0000 7f665f400640 1 --2- 172.21.15.123:0/1233574239 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f664406c920 0x7f664406ede0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6650036000 tx=0x7f665002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:17.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.665+0000 7f6664c00640 1 -- 172.21.15.123:0/1233574239 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f665805a050 con 0x7f664c006a10 2024-04-17T05:27:17.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.867+0000 7f666d400640 1 -- 172.21.15.123:0/1233574239 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f66680759b0 con 0x7f664c006a10 2024-04-17T05:27:17.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.870+0000 7f6664c00640 1 -- 172.21.15.123:0/1233574239 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18526 (secure 0 0 0) 0x7f6658059950 con 0x7f664c006a10 2024-04-17T05:27:17.869 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:27:17.869 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":26,"fsid":"0787c5c0-e77a-4102-a899-30db48b19c68","created":"2024-04-17T05:26:33.031507+0000","modified":"2024-04-17T05:26:57.743352+0000","last_up_change":"2024-04-17T05:26:44.988433+0000","last_in_change":"2024-04-17T05:26:36.682131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T05:26:46.329778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T05:26:50.600195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T05:26:51.626498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T05:26:55.264044+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15c87cdb-9415-45a6-a2a6-ea6bec9daece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6801","nonce":840753170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6803","nonce":840753170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6807","nonce":840753170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6805","nonce":840753170}]},"public_addr":"172.21.15.123:6801/840753170","cluster_addr":"172.21.15.123:6803/840753170","heartbeat_back_addr":"172.21.15.123:6807/840753170","heartbeat_front_addr":"172.21.15.123:6805/840753170","state":["exists","up"]},{"osd":1,"uuid":"281751b5-486d-4845-b4aa-b308bf7cec62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6822","nonce":2231878927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6827","nonce":2231878927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6831","nonce":2231878927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6829","nonce":2231878927}]},"public_addr":"172.21.15.123:6822/2231878927","cluster_addr":"172.21.15.123:6827/2231878927","heartbeat_back_addr":"172.21.15.123:6831/2231878927","heartbeat_front_addr":"172.21.15.123:6829/2231878927","state":["exists","up"]},{"osd":2,"uuid":"b42257d3-bd20-4db5-aa37-1bf5c512d0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6817","nonce":754360844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6820","nonce":754360844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6825","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6826","nonce":754360844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6823","nonce":754360844}]},"public_addr":"172.21.15.123:6817/754360844","cluster_addr":"172.21.15.123:6820/754360844","heartbeat_back_addr":"172.21.15.123:6826/754360844","heartbeat_front_addr":"172.21.15.123:6823/754360844","state":["exists","up"]},{"osd":3,"uuid":"0f26b891-bbe6-478e-8dee-78e69bb48cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6809","nonce":2898088574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6811","nonce":2898088574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6815","nonce":2898088574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6813","nonce":2898088574}]},"public_addr":"172.21.15.123:6809/2898088574","cluster_addr":"172.21.15.123:6811/2898088574","heartbeat_back_addr":"172.21.15.123:6815/2898088574","heartbeat_front_addr":"172.21.15.123:6813/2898088574","state":["exists","up"]},{"osd":4,"uuid":"43e59318-2740-4625-9d64-eec1fd43c322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6801","nonce":606484349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6804","nonce":606484349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6812","nonce":606484349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6808","nonce":606484349}]},"public_addr":"172.21.15.164:6801/606484349","cluster_addr":"172.21.15.164:6804/606484349","heartbeat_back_addr":"172.21.15.164:6812/606484349","heartbeat_front_addr":"172.21.15.164:6808/606484349","state":["exists","up"]},{"osd":5,"uuid":"aaa3acf4-4adc-4337-aba3-363851d35310","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6805","nonce":1376989593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6809","nonce":1376989593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6815","nonce":1376989593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6813","nonce":1376989593}]},"public_addr":"172.21.15.164:6805/1376989593","cluster_addr":"172.21.15.164:6809/1376989593","heartbeat_back_addr":"172.21.15.164:6815/1376989593","heartbeat_front_addr":"172.21.15.164:6813/1376989593","state":["exists","up"]},{"osd":6,"uuid":"6f765b27-7377-4d81-9192-23a965651145","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6817","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6821","nonce":1594306924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6823","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6826","nonce":1594306924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6831","nonce":1594306924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6829","nonce":1594306924}]},"public_addr":"172.21.15.164:6821/1594306924","cluster_addr":"172.21.15.164:6826/1594306924","heartbeat_back_addr":"172.21.15.164:6831/1594306924","heartbeat_front_addr":"172.21.15.164:6829/1594306924","state":["exists","up"]},{"osd":7,"uuid":"5547394b-ec2f-4311-846d-369af4b1acf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6818","nonce":295402697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6819","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6820","nonce":295402697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6825","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6827","nonce":295402697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6824","nonce":295402697}]},"public_addr":"172.21.15.164:6818/295402697","cluster_addr":"172.21.15.164:6820/295402697","heartbeat_back_addr":"172.21.15.164:6827/295402697","heartbeat_front_addr":"172.21.15.164:6824/295402697","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.034807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.022201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.751897+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.850533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.083608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.047524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.314753+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.413586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T05:27:17.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.873+0000 7f666d400640 1 -- 172.21.15.123:0/1233574239 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f664406c920 msgr2=0x7f664406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:17.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.873+0000 7f666d400640 1 --2- 172.21.15.123:0/1233574239 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f664406c920 0x7f664406ede0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6650036000 tx=0x7f665002e000 comp rx=0 tx=0).stop 2024-04-17T05:27:17.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.873+0000 7f666d400640 1 -- 172.21.15.123:0/1233574239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f664c006a10 msgr2=0x7f6668146d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:17.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.873+0000 7f666d400640 1 --2- 172.21.15.123:0/1233574239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f664c006a10 0x7f6668146d90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6658001ac0 tx=0x7f665800b4a0 comp rx=0 tx=0).stop 2024-04-17T05:27:17.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.873+0000 7f666d400640 1 -- 172.21.15.123:0/1233574239 shutdown_connections 2024-04-17T05:27:17.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.873+0000 7f666d400640 1 --2- 172.21.15.123:0/1233574239 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f664406c920 0x7f664406ede0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:17.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.873+0000 7f666d400640 1 --2- 172.21.15.123:0/1233574239 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f66681e1880 0x7f666813a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:17.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.873+0000 7f666d400640 1 --2- 172.21.15.123:0/1233574239 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f66681418f0 0x7f66681e1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:17.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.873+0000 7f666d400640 1 --2- 172.21.15.123:0/1233574239 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f664c006a10 0x7f6668146d90 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:17.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.873+0000 7f666d400640 1 -- 172.21.15.123:0/1233574239 >> 172.21.15.123:0/1233574239 conn(0x7f66680b9150 msgr2=0x7f66680676c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:17.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.873+0000 7f666d400640 1 -- 172.21.15.123:0/1233574239 shutdown_connections 2024-04-17T05:27:17.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:17.873+0000 7f666d400640 1 -- 172.21.15.123:0/1233574239 wait complete. 2024-04-17T05:27:17.890 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-17T05:27:18.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.098+0000 7f2f63e00640 1 Processor -- start 2024-04-17T05:27:18.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.098+0000 7f2f63e00640 1 -- start start 2024-04-17T05:27:18.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.099+0000 7f2f63e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2f6406d040 0x7f2f6409c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:18.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.099+0000 7f2f63e00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2f640ae7b0 0x7f2f6409ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:18.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.099+0000 7f2f63e00640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f6406d420 con 0x7f2f6409d3d0 2024-04-17T05:27:18.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.099+0000 7f2f63e00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f2f640afe90 con 0x7f2f640ae7b0 2024-04-17T05:27:18.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.099+0000 7f2f63e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f2f640b03a0 con 0x7f2f6406d040 2024-04-17T05:27:18.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.100+0000 7f2f62a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2f6406d040 0x7f2f6409c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:18.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.100+0000 7f2f5a000640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2f640ae7b0 0x7f2f6409ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:18.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.100+0000 7f2f62a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2f6406d040 0x7f2f6409c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.123:59174/0 (socket says 172.21.15.123:59174) 2024-04-17T05:27:18.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.100+0000 7f2f62a00640 1 -- 172.21.15.123:0/311278738 learned_addr learned my addr 172.21.15.123:0/311278738 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:18.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.101+0000 7f2f62a00640 1 -- 172.21.15.123:0/311278738 >> v2:172.21.15.164:3300/0 conn(0x7f2f640ae7b0 msgr2=0x7f2f6409ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:18.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.101+0000 7f2f62a00640 1 --2- 172.21.15.123:0/311278738 >> v2:172.21.15.164:3300/0 conn(0x7f2f640ae7b0 0x7f2f6409ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:18.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.101+0000 7f2f62a00640 1 -- 172.21.15.123:0/311278738 >> v1:172.21.15.164:6789/0 conn(0x7f2f6409d3d0 legacy=0x7f2f64148090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:18.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.101+0000 7f2f62a00640 1 -- 172.21.15.123:0/311278738 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f640af720 con 0x7f2f6406d040 2024-04-17T05:27:18.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.102+0000 7f2f62a00640 1 --2- 172.21.15.123:0/311278738 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2f6406d040 0x7f2f6409c2f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009870 tx=0x7f2f5402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf83feee879f21ca server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:18.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.102+0000 7f2f62000640 1 -- 172.21.15.123:0/311278738 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f54035020 con 0x7f2f6406d040 2024-04-17T05:27:18.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.102+0000 7f2f62000640 1 -- 172.21.15.123:0/311278738 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f54031640 con 0x7f2f6406d040 2024-04-17T05:27:18.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.102+0000 7f2f62000640 1 -- 172.21.15.123:0/311278738 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5402d040 con 0x7f2f6406d040 2024-04-17T05:27:18.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.103+0000 7f2f63e00640 1 -- 172.21.15.123:0/311278738 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2f6406d040 msgr2=0x7f2f6409c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:18.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.103+0000 7f2f63e00640 1 --2- 172.21.15.123:0/311278738 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2f6406d040 0x7f2f6409c2f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009870 tx=0x7f2f5402b8f0 comp rx=0 tx=0).stop 2024-04-17T05:27:18.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.103+0000 7f2f63e00640 1 -- 172.21.15.123:0/311278738 shutdown_connections 2024-04-17T05:27:18.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.103+0000 7f2f63e00640 1 --2- 172.21.15.123:0/311278738 >> v2:172.21.15.164:3300/0 conn(0x7f2f640ae7b0 0x7f2f6409ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:18.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.103+0000 7f2f63e00640 1 --2- 172.21.15.123:0/311278738 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2f6406d040 0x7f2f6409c2f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:18.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.103+0000 7f2f63e00640 1 -- 172.21.15.123:0/311278738 >> 172.21.15.123:0/311278738 conn(0x7f2f6406c430 msgr2=0x7f2f640b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:18.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.103+0000 7f2f63e00640 1 -- 172.21.15.123:0/311278738 shutdown_connections 2024-04-17T05:27:18.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.103+0000 7f2f63e00640 1 -- 172.21.15.123:0/311278738 wait complete. 2024-04-17T05:27:18.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.105+0000 7f2f63e00640 1 Processor -- start 2024-04-17T05:27:18.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.105+0000 7f2f63e00640 1 -- start start 2024-04-17T05:27:18.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.106+0000 7f2f63e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2f6406d040 0x7f2f64072450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:18.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.106+0000 7f2f63e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2f6409d3d0 0x7f2f641e0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:18.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.106+0000 7f2f63e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f641ce310 0x7f2f641e0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:18.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.106+0000 7f2f63e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2f6409d840 con 0x7f2f641ce310 2024-04-17T05:27:18.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.106+0000 7f2f63e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2f640ae290 con 0x7f2f6406d040 2024-04-17T05:27:18.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.106+0000 7f2f63e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f2f6409c830 con 0x7f2f6409d3d0 2024-04-17T05:27:18.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.106+0000 7f2f63400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f641ce310 0x7f2f641e0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:18.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.106+0000 7f2f63400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f641ce310 0x7f2f641e0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37976/0 (socket says 172.21.15.123:37976) 2024-04-17T05:27:18.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.106+0000 7f2f63400640 1 -- 172.21.15.123:0/3452601143 learned_addr learned my addr 172.21.15.123:0/3452601143 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:18.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.106+0000 7f2f62a00640 1 --2- 172.21.15.123:0/3452601143 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2f6406d040 0x7f2f64072450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:18.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.106+0000 7f2f5a000640 1 --2- 172.21.15.123:0/3452601143 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2f6409d3d0 0x7f2f641e0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:18.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.106+0000 7f2f63400640 1 -- 172.21.15.123:0/3452601143 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2f6409d3d0 msgr2=0x7f2f641e0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:18.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.107+0000 7f2f63400640 1 --2- 172.21.15.123:0/3452601143 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2f6409d3d0 0x7f2f641e0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:18.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.107+0000 7f2f63400640 1 -- 172.21.15.123:0/3452601143 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2f6406d040 msgr2=0x7f2f64072450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:18.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.107+0000 7f2f63400640 1 --2- 172.21.15.123:0/3452601143 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2f6406d040 0x7f2f64072450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:18.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.107+0000 7f2f63400640 1 -- 172.21.15.123:0/3452601143 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f641ce840 con 0x7f2f641ce310 2024-04-17T05:27:18.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.107+0000 7f2f5a000640 1 --2- 172.21.15.123:0/3452601143 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2f6409d3d0 0x7f2f641e0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:18.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.107+0000 7f2f63400640 1 --2- 172.21.15.123:0/3452601143 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f641ce310 0x7f2f641e0e60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c00c7a0 tx=0x7f2f5c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:18.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.107+0000 7f2f5b400640 1 -- 172.21.15.123:0/3452601143 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c003b70 con 0x7f2f641ce310 2024-04-17T05:27:18.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.107+0000 7f2f5b400640 1 -- 172.21.15.123:0/3452601143 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f5c003d30 con 0x7f2f641ce310 2024-04-17T05:27:18.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.107+0000 7f2f5b400640 1 -- 172.21.15.123:0/3452601143 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c00aa30 con 0x7f2f641ce310 2024-04-17T05:27:18.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.107+0000 7f2f63e00640 1 -- 172.21.15.123:0/3452601143 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f641ceb20 con 0x7f2f641ce310 2024-04-17T05:27:18.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.107+0000 7f2f63e00640 1 -- 172.21.15.123:0/3452601143 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f640b2fd0 con 0x7f2f641ce310 2024-04-17T05:27:18.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.109+0000 7f2f63e00640 1 -- 172.21.15.123:0/3452601143 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f64075b30 con 0x7f2f641ce310 2024-04-17T05:27:18.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.109+0000 7f2f5b400640 1 -- 172.21.15.123:0/3452601143 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2f5c00abd0 con 0x7f2f641ce310 2024-04-17T05:27:18.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.110+0000 7f2f5b400640 1 --2- 172.21.15.123:0/3452601143 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f2f4006c8f0 0x7f2f4006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:18.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.110+0000 7f2f5b400640 1 -- 172.21.15.123:0/3452601143 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2f5c08bdb0 con 0x7f2f641ce310 2024-04-17T05:27:18.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.111+0000 7f2f62a00640 1 --2- 172.21.15.123:0/3452601143 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f2f4006c8f0 0x7f2f4006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:18.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.112+0000 7f2f62a00640 1 --2- 172.21.15.123:0/3452601143 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f2f4006c8f0 0x7f2f4006edb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2f54036000 tx=0x7f2f5403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:18.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.115+0000 7f2f5b400640 1 -- 172.21.15.123:0/3452601143 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f2f5c090070 con 0x7f2f641ce310 2024-04-17T05:27:18.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.337+0000 7f2f63e00640 1 -- 172.21.15.123:0/3452601143 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f2f640b7910 con 0x7f2f641ce310 2024-04-17T05:27:18.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.384+0000 7f2f5b400640 1 -- 172.21.15.123:0/3452601143 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7f2f5c059e90 con 0x7f2f641ce310 2024-04-17T05:27:18.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.387+0000 7f2f63e00640 1 -- 172.21.15.123:0/3452601143 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f2f4006c8f0 msgr2=0x7f2f4006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:18.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.387+0000 7f2f63e00640 1 --2- 172.21.15.123:0/3452601143 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f2f4006c8f0 0x7f2f4006edb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2f54036000 tx=0x7f2f5403c040 comp rx=0 tx=0).stop 2024-04-17T05:27:18.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.387+0000 7f2f63e00640 1 -- 172.21.15.123:0/3452601143 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f641ce310 msgr2=0x7f2f641e0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:18.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.387+0000 7f2f63e00640 1 --2- 172.21.15.123:0/3452601143 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f641ce310 0x7f2f641e0e60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c00c7a0 tx=0x7f2f5c00cc60 comp rx=0 tx=0).stop 2024-04-17T05:27:18.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.387+0000 7f2f63e00640 1 -- 172.21.15.123:0/3452601143 shutdown_connections 2024-04-17T05:27:18.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.387+0000 7f2f63e00640 1 --2- 172.21.15.123:0/3452601143 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f641ce310 0x7f2f641e0e60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:18.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.387+0000 7f2f63e00640 1 --2- 172.21.15.123:0/3452601143 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f2f4006c8f0 0x7f2f4006edb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:18.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.387+0000 7f2f63e00640 1 --2- 172.21.15.123:0/3452601143 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2f6409d3d0 0x7f2f641e0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:18.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.387+0000 7f2f63e00640 1 --2- 172.21.15.123:0/3452601143 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2f6406d040 0x7f2f64072450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:18.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.387+0000 7f2f63e00640 1 -- 172.21.15.123:0/3452601143 >> 172.21.15.123:0/3452601143 conn(0x7f2f6406c430 msgr2=0x7f2f640676c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:18.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.387+0000 7f2f63e00640 1 -- 172.21.15.123:0/3452601143 shutdown_connections 2024-04-17T05:27:18.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.387+0000 7f2f63e00640 1 -- 172.21.15.123:0/3452601143 wait complete. 2024-04-17T05:27:18.403 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-04-17T05:27:18.404 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-17T05:27:18.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.616+0000 7f440a600640 1 Processor -- start 2024-04-17T05:27:18.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.616+0000 7f440a600640 1 -- start start 2024-04-17T05:27:18.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.617+0000 7f440a600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f440406d040 0x7f440409c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:18.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.618+0000 7f440a600640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f440409d5a0 0x7f440414f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:18.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.618+0000 7f440a600640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f440406d420 con 0x7f44040ae7b0 2024-04-17T05:27:18.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.618+0000 7f440a600640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f44040afe90 con 0x7f440409d5a0 2024-04-17T05:27:18.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.618+0000 7f440a600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f44040b03a0 con 0x7f440406d040 2024-04-17T05:27:18.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.618+0000 7f4409200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f440406d040 0x7f440409c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:18.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.618+0000 7f4409c00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f440409d5a0 0x7f440414f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:18.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.618+0000 7f4409200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f440406d040 0x7f440409c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.123:59192/0 (socket says 172.21.15.123:59192) 2024-04-17T05:27:18.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.618+0000 7f4409200640 1 -- 172.21.15.123:0/1070850342 learned_addr learned my addr 172.21.15.123:0/1070850342 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:18.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.619+0000 7f4409c00640 1 -- 172.21.15.123:0/1070850342 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f440406d040 msgr2=0x7f440409c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:18.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.620+0000 7f4409c00640 1 --2- 172.21.15.123:0/1070850342 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f440406d040 0x7f440409c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:18.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.620+0000 7f4409c00640 1 -- 172.21.15.123:0/1070850342 >> v1:172.21.15.164:6789/0 conn(0x7f44040ae7b0 legacy=0x7f440409ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:18.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.620+0000 7f4409c00640 1 -- 172.21.15.123:0/1070850342 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44040af720 con 0x7f440409d5a0 2024-04-17T05:27:18.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.620+0000 7f4409200640 1 --2- 172.21.15.123:0/1070850342 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f440406d040 0x7f440409c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T05:27:18.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.621+0000 7f4409c00640 1 --2- 172.21.15.123:0/1070850342 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f440409d5a0 0x7f440414f3c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f43fc00bfa0 tx=0x7f43fc02e010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98ffc99c1e1dc539 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:18.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.621+0000 7f4403400640 1 -- 172.21.15.123:0/1070850342 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43fc02e9b0 con 0x7f440409d5a0 2024-04-17T05:27:18.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.621+0000 7f4403400640 1 -- 172.21.15.123:0/1070850342 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43fc02eb50 con 0x7f440409d5a0 2024-04-17T05:27:18.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.622+0000 7f4403400640 1 -- 172.21.15.123:0/1070850342 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43fc009540 con 0x7f440409d5a0 2024-04-17T05:27:18.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.622+0000 7f440a600640 1 -- 172.21.15.123:0/1070850342 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f440409d5a0 msgr2=0x7f440414f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:18.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.622+0000 7f440a600640 1 --2- 172.21.15.123:0/1070850342 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f440409d5a0 0x7f440414f3c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f43fc00bfa0 tx=0x7f43fc02e010 comp rx=0 tx=0).stop 2024-04-17T05:27:18.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.622+0000 7f440a600640 1 -- 172.21.15.123:0/1070850342 shutdown_connections 2024-04-17T05:27:18.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.622+0000 7f440a600640 1 --2- 172.21.15.123:0/1070850342 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f440409d5a0 0x7f440414f3c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:18.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.622+0000 7f440a600640 1 --2- 172.21.15.123:0/1070850342 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f440406d040 0x7f440409c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:18.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.622+0000 7f440a600640 1 -- 172.21.15.123:0/1070850342 >> 172.21.15.123:0/1070850342 conn(0x7f440406c430 msgr2=0x7f44040b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:18.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.622+0000 7f440a600640 1 -- 172.21.15.123:0/1070850342 shutdown_connections 2024-04-17T05:27:18.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.622+0000 7f440a600640 1 -- 172.21.15.123:0/1070850342 wait complete. 2024-04-17T05:27:18.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.624+0000 7f440a600640 1 Processor -- start 2024-04-17T05:27:18.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.624+0000 7f440a600640 1 -- start start 2024-04-17T05:27:18.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.625+0000 7f440a600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f440406d040 0x7f4404072c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:18.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.625+0000 7f440a600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f440409d5a0 0x7f44041e0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:18.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.625+0000 7f440a600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44041e1050 0x7f4404070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:18.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.625+0000 7f440a600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f44040ae290 con 0x7f44041e1050 2024-04-17T05:27:18.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.625+0000 7f440a600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f440409c830 con 0x7f440406d040 2024-04-17T05:27:18.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.625+0000 7f440a600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f44041e1500 con 0x7f440409d5a0 2024-04-17T05:27:18.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.625+0000 7f4409c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44041e1050 0x7f4404070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:18.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.625+0000 7f4409c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44041e1050 0x7f4404070010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37978/0 (socket says 172.21.15.123:37978) 2024-04-17T05:27:18.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.625+0000 7f4409c00640 1 -- 172.21.15.123:0/4105011449 learned_addr learned my addr 172.21.15.123:0/4105011449 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:18.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.625+0000 7f4403e00640 1 --2- 172.21.15.123:0/4105011449 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f440409d5a0 0x7f44041e0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:18.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.625+0000 7f4409200640 1 --2- 172.21.15.123:0/4105011449 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f440406d040 0x7f4404072c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:18.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.625+0000 7f4409c00640 1 -- 172.21.15.123:0/4105011449 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f440409d5a0 msgr2=0x7f44041e0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:18.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.625+0000 7f4409c00640 1 --2- 172.21.15.123:0/4105011449 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f440409d5a0 0x7f44041e0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:18.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.625+0000 7f4409c00640 1 -- 172.21.15.123:0/4105011449 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f440406d040 msgr2=0x7f4404072c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:18.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.625+0000 7f4409c00640 1 --2- 172.21.15.123:0/4105011449 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f440406d040 0x7f4404072c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:18.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.626+0000 7f4409c00640 1 -- 172.21.15.123:0/4105011449 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44041ced90 con 0x7f44041e1050 2024-04-17T05:27:18.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.626+0000 7f4409c00640 1 --2- 172.21.15.123:0/4105011449 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44041e1050 0x7f4404070010 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f43fc038040 tx=0x7f43fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:18.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.626+0000 7f4400c00640 1 -- 172.21.15.123:0/4105011449 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43fc040620 con 0x7f44041e1050 2024-04-17T05:27:18.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.626+0000 7f4400c00640 1 -- 172.21.15.123:0/4105011449 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43fc045070 con 0x7f44041e1050 2024-04-17T05:27:18.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.626+0000 7f4400c00640 1 -- 172.21.15.123:0/4105011449 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43fc040a20 con 0x7f44041e1050 2024-04-17T05:27:18.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.626+0000 7f440a600640 1 -- 172.21.15.123:0/4105011449 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44040b1f30 con 0x7f44041e1050 2024-04-17T05:27:18.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.626+0000 7f440a600640 1 -- 172.21.15.123:0/4105011449 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44041ceab0 con 0x7f44041e1050 2024-04-17T05:27:18.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.628+0000 7f440a600640 1 -- 172.21.15.123:0/4105011449 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4404075b30 con 0x7f44041e1050 2024-04-17T05:27:18.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.628+0000 7f4400c00640 1 -- 172.21.15.123:0/4105011449 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f43fc040bc0 con 0x7f44041e1050 2024-04-17T05:27:18.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.630+0000 7f4400c00640 1 --2- 172.21.15.123:0/4105011449 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f43e406c8f0 0x7f43e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:18.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.630+0000 7f4400c00640 1 -- 172.21.15.123:0/4105011449 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f43fc0aeb70 con 0x7f44041e1050 2024-04-17T05:27:18.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.630+0000 7f4409200640 1 --2- 172.21.15.123:0/4105011449 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f43e406c8f0 0x7f43e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:18.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.631+0000 7f4409200640 1 --2- 172.21.15.123:0/4105011449 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f43e406c8f0 0x7f43e406edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f43f8009630 tx=0x7f43f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:18.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.634+0000 7f4400c00640 1 -- 172.21.15.123:0/4105011449 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f43fc07cc90 con 0x7f44041e1050 2024-04-17T05:27:18.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:18.879+0000 7f440a600640 1 -- 172.21.15.123:0/4105011449 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f44040ba050 con 0x7f44041e1050 2024-04-17T05:27:19.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.405+0000 7f4400c00640 1 -- 172.21.15.123:0/4105011449 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7f43fc07c590 con 0x7f44041e1050 2024-04-17T05:27:19.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.410+0000 7f440a600640 1 -- 172.21.15.123:0/4105011449 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f43e406c8f0 msgr2=0x7f43e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:19.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.410+0000 7f440a600640 1 --2- 172.21.15.123:0/4105011449 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f43e406c8f0 0x7f43e406edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f43f8009630 tx=0x7f43f8008040 comp rx=0 tx=0).stop 2024-04-17T05:27:19.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.410+0000 7f440a600640 1 -- 172.21.15.123:0/4105011449 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44041e1050 msgr2=0x7f4404070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:19.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.410+0000 7f440a600640 1 --2- 172.21.15.123:0/4105011449 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44041e1050 0x7f4404070010 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f43fc038040 tx=0x7f43fc004a40 comp rx=0 tx=0).stop 2024-04-17T05:27:19.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.410+0000 7f440a600640 1 -- 172.21.15.123:0/4105011449 shutdown_connections 2024-04-17T05:27:19.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.410+0000 7f440a600640 1 --2- 172.21.15.123:0/4105011449 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44041e1050 0x7f4404070010 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:19.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.410+0000 7f440a600640 1 --2- 172.21.15.123:0/4105011449 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f43e406c8f0 0x7f43e406edb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:19.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.410+0000 7f440a600640 1 --2- 172.21.15.123:0/4105011449 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f440409d5a0 0x7f44041e0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:19.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.410+0000 7f440a600640 1 --2- 172.21.15.123:0/4105011449 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f440406d040 0x7f4404072c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:19.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.410+0000 7f440a600640 1 -- 172.21.15.123:0/4105011449 >> 172.21.15.123:0/4105011449 conn(0x7f440406c430 msgr2=0x7f44040676c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:19.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.410+0000 7f440a600640 1 -- 172.21.15.123:0/4105011449 shutdown_connections 2024-04-17T05:27:19.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.410+0000 7f440a600640 1 -- 172.21.15.123:0/4105011449 wait complete. 2024-04-17T05:27:19.431 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-17T05:27:19.431 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T05:27:19.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.642+0000 7f156f200640 1 Processor -- start 2024-04-17T05:27:19.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.642+0000 7f156f200640 1 -- start start 2024-04-17T05:27:19.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.643+0000 7f156f200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f15701485f0 0x7f157013e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:19.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.643+0000 7f156f200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15700b5910 con 0x7f15700b3dc0 2024-04-17T05:27:19.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.643+0000 7f156f200640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15700b1870 con 0x7f157013e920 2024-04-17T05:27:19.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.643+0000 7f156f200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f15700b2c80 con 0x7f15701485f0 2024-04-17T05:27:19.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.643+0000 7f156de00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f15700b3dc0 0x7f1570147ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54876/0 (socket says 172.21.15.123:54876) 2024-04-17T05:27:19.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.644+0000 7f156de00640 1 -- 172.21.15.123:0/2221163003 learned_addr learned my addr 172.21.15.123:0/2221163003 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:27:19.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.644+0000 7f156d400640 1 --2- 172.21.15.123:0/2221163003 >> v2:172.21.15.123:3300/0 conn(0x7f15701485f0 0x7f157013e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:19.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.644+0000 7f156d400640 1 -- 172.21.15.123:0/2221163003 >> v1:172.21.15.164:6789/0 conn(0x7f157013e920 legacy=0x7f157014f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:19.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.644+0000 7f156ca00640 1 -- 172.21.15.123:0/2221163003 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4180668029 0 0) 0x7f15700b5910 con 0x7f15700b3dc0 2024-04-17T05:27:19.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.644+0000 7f156d400640 1 -- 172.21.15.123:0/2221163003 >> v1:172.21.15.123:6789/0 conn(0x7f15700b3dc0 legacy=0x7f1570147ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:19.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.644+0000 7f156d400640 1 -- 172.21.15.123:0/2221163003 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15700b41a0 con 0x7f15701485f0 2024-04-17T05:27:19.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.645+0000 7f156d400640 1 --2- 172.21.15.123:0/2221163003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15701485f0 0x7f157013e3e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f155c0097a0 tx=0x7f155c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8f3647de2e52e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:19.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.646+0000 7f156ca00640 1 -- 172.21.15.123:0/2221163003 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f155c0315a0 con 0x7f15701485f0 2024-04-17T05:27:19.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.646+0000 7f156ca00640 1 -- 172.21.15.123:0/2221163003 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f155c037070 con 0x7f15701485f0 2024-04-17T05:27:19.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.646+0000 7f156ca00640 1 -- 172.21.15.123:0/2221163003 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f155c031960 con 0x7f15701485f0 2024-04-17T05:27:19.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.646+0000 7f156f200640 1 -- 172.21.15.123:0/2221163003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15701485f0 msgr2=0x7f157013e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:19.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.646+0000 7f156f200640 1 --2- 172.21.15.123:0/2221163003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15701485f0 0x7f157013e3e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f155c0097a0 tx=0x7f155c02b840 comp rx=0 tx=0).stop 2024-04-17T05:27:19.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.646+0000 7f156f200640 1 -- 172.21.15.123:0/2221163003 shutdown_connections 2024-04-17T05:27:19.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.646+0000 7f156f200640 1 --2- 172.21.15.123:0/2221163003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15701485f0 0x7f157013e3e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:19.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.646+0000 7f156f200640 1 -- 172.21.15.123:0/2221163003 >> 172.21.15.123:0/2221163003 conn(0x7f15700b9150 msgr2=0x7f15700b9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:19.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.646+0000 7f156f200640 1 -- 172.21.15.123:0/2221163003 shutdown_connections 2024-04-17T05:27:19.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.646+0000 7f156f200640 1 -- 172.21.15.123:0/2221163003 wait complete. 2024-04-17T05:27:19.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.648+0000 7f156f200640 1 Processor -- start 2024-04-17T05:27:19.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.648+0000 7f156f200640 1 -- start start 2024-04-17T05:27:19.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.649+0000 7f156f200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15700b3dc0 0x7f15700ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:19.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.649+0000 7f156f200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f157013e920 0x7f1570146530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:19.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.649+0000 7f156f200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f15701485f0 0x7f1570146a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:19.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.649+0000 7f156f200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f15700b1b10 con 0x7f15700b3dc0 2024-04-17T05:27:19.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.649+0000 7f156f200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f15700708c0 con 0x7f157013e920 2024-04-17T05:27:19.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.649+0000 7f156f200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f15700b2a00 con 0x7f15701485f0 2024-04-17T05:27:19.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.649+0000 7f156de00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15700b3dc0 0x7f15700ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:19.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.649+0000 7f156de00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15700b3dc0 0x7f15700ae4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37996/0 (socket says 172.21.15.123:37996) 2024-04-17T05:27:19.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.649+0000 7f156de00640 1 -- 172.21.15.123:0/2567150760 learned_addr learned my addr 172.21.15.123:0/2567150760 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:19.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.649+0000 7f156de00640 1 -- 172.21.15.123:0/2567150760 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f15701485f0 msgr2=0x7f1570146a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:19.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.649+0000 7f156de00640 1 --2- 172.21.15.123:0/2567150760 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f15701485f0 0x7f1570146a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:19.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.649+0000 7f156d400640 1 --2- 172.21.15.123:0/2567150760 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f157013e920 0x7f1570146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:19.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.649+0000 7f156de00640 1 -- 172.21.15.123:0/2567150760 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f157013e920 msgr2=0x7f1570146530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:19.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.649+0000 7f156de00640 1 --2- 172.21.15.123:0/2567150760 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f157013e920 0x7f1570146530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:19.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.649+0000 7f156de00640 1 -- 172.21.15.123:0/2567150760 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15700afe20 con 0x7f15700b3dc0 2024-04-17T05:27:19.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.650+0000 7f156de00640 1 --2- 172.21.15.123:0/2567150760 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15700b3dc0 0x7f15700ae4d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f156000c4d0 tx=0x7f156000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:19.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.650+0000 7f1566000640 1 -- 172.21.15.123:0/2567150760 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1560017070 con 0x7f15700b3dc0 2024-04-17T05:27:19.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.650+0000 7f1566000640 1 -- 172.21.15.123:0/2567150760 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1560005d00 con 0x7f15700b3dc0 2024-04-17T05:27:19.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.650+0000 7f1566000640 1 -- 172.21.15.123:0/2567150760 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15600072b0 con 0x7f15700b3dc0 2024-04-17T05:27:19.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.650+0000 7f156f200640 1 -- 172.21.15.123:0/2567150760 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1570146010 con 0x7f15700b3dc0 2024-04-17T05:27:19.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.650+0000 7f156f200640 1 -- 172.21.15.123:0/2567150760 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1570147ae0 con 0x7f15700b3dc0 2024-04-17T05:27:19.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.651+0000 7f156f200640 1 -- 172.21.15.123:0/2567150760 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15700759b0 con 0x7f15700b3dc0 2024-04-17T05:27:19.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.652+0000 7f1566000640 1 -- 172.21.15.123:0/2567150760 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f156001a070 con 0x7f15700b3dc0 2024-04-17T05:27:19.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.653+0000 7f1566000640 1 --2- 172.21.15.123:0/2567150760 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f155006c8f0 0x7f155006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:19.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.653+0000 7f1566000640 1 -- 172.21.15.123:0/2567150760 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f156008b290 con 0x7f15700b3dc0 2024-04-17T05:27:19.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.654+0000 7f156d400640 1 --2- 172.21.15.123:0/2567150760 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f155006c8f0 0x7f155006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:19.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.655+0000 7f156d400640 1 --2- 172.21.15.123:0/2567150760 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f155006c8f0 0x7f155006edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f155c036000 tx=0x7f155c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:19.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.658+0000 7f1566000640 1 -- 172.21.15.123:0/2567150760 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f1560059370 con 0x7f15700b3dc0 2024-04-17T05:27:19.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.879+0000 7f156f200640 1 -- 172.21.15.123:0/2567150760 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15701461e0 con 0x7f15700b3dc0 2024-04-17T05:27:19.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.881+0000 7f1566000640 1 -- 172.21.15.123:0/2567150760 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+3550 (secure 0 0 0) 0x7f156005f070 con 0x7f15700b3dc0 2024-04-17T05:27:19.879 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:27:19.879 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/515699398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":515699398},{"type":"v1","addr":"172.21.15.123:6833","nonce":515699398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T05:26:52.642446+0000","modified":"2024-04-17T05:27:18.881148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4243},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4243":{"gid":4243,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/1946746019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1946746019},{"type":"v1","addr":"172.21.15.164:6835","nonce":1946746019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4243,"qdb_cluster":[4243]},"id":1}]} 2024-04-17T05:27:19.879 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 9 2024-04-17T05:27:19.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.883+0000 7f156f200640 1 -- 172.21.15.123:0/2567150760 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f155006c8f0 msgr2=0x7f155006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:19.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.883+0000 7f156f200640 1 --2- 172.21.15.123:0/2567150760 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f155006c8f0 0x7f155006edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f155c036000 tx=0x7f155c008030 comp rx=0 tx=0).stop 2024-04-17T05:27:19.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.883+0000 7f156f200640 1 -- 172.21.15.123:0/2567150760 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15700b3dc0 msgr2=0x7f15700ae4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:19.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.883+0000 7f156f200640 1 --2- 172.21.15.123:0/2567150760 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15700b3dc0 0x7f15700ae4d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f156000c4d0 tx=0x7f156000c990 comp rx=0 tx=0).stop 2024-04-17T05:27:19.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.883+0000 7f156f200640 1 -- 172.21.15.123:0/2567150760 shutdown_connections 2024-04-17T05:27:19.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.883+0000 7f156f200640 1 --2- 172.21.15.123:0/2567150760 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f155006c8f0 0x7f155006edb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:19.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.883+0000 7f156f200640 1 --2- 172.21.15.123:0/2567150760 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f15701485f0 0x7f1570146a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:19.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.883+0000 7f156f200640 1 --2- 172.21.15.123:0/2567150760 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f157013e920 0x7f1570146530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:19.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.883+0000 7f156f200640 1 --2- 172.21.15.123:0/2567150760 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15700b3dc0 0x7f15700ae4d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:19.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.883+0000 7f156f200640 1 -- 172.21.15.123:0/2567150760 >> 172.21.15.123:0/2567150760 conn(0x7f15700b9150 msgr2=0x7f15700676c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:19.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.884+0000 7f156f200640 1 -- 172.21.15.123:0/2567150760 shutdown_connections 2024-04-17T05:27:19.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:19.884+0000 7f156f200640 1 -- 172.21.15.123:0/2567150760 wait complete. 2024-04-17T05:27:19.901 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T05:27:20.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.112+0000 7ff7f8c00640 1 Processor -- start 2024-04-17T05:27:20.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.112+0000 7ff7f8c00640 1 -- start start 2024-04-17T05:27:20.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.114+0000 7ff7f8c00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff7f40ba6a0 0x7ff7f40b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:20.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.114+0000 7ff7f8c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7f40b9a80 0x7ff7f4147b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:20.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.114+0000 7ff7f8c00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7f40b57e0 con 0x7ff7f4141a00 2024-04-17T05:27:20.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.114+0000 7ff7f8c00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7ff7f40b5e10 con 0x7ff7f40ba6a0 2024-04-17T05:27:20.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.114+0000 7ff7f8c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7ff7f40b71d0 con 0x7ff7f40b9a80 2024-04-17T05:27:20.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.114+0000 7ff7f3e00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff7f4141a00 0x7ff7f40b7e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54884/0 (socket says 172.21.15.123:54884) 2024-04-17T05:27:20.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.114+0000 7ff7f3e00640 1 -- 172.21.15.123:0/2098994468 learned_addr learned my addr 172.21.15.123:0/2098994468 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:27:20.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.114+0000 7ff7f3400640 1 --2- 172.21.15.123:0/2098994468 >> v2:172.21.15.164:3300/0 conn(0x7ff7f40ba6a0 0x7ff7f40b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:20.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.114+0000 7ff7eaa00640 1 --2- 172.21.15.123:0/2098994468 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7f40b9a80 0x7ff7f4147b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:20.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.115+0000 7ff7f2a00640 1 -- 172.21.15.123:0/2098994468 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4252675395 0 0) 0x7ff7f40b57e0 con 0x7ff7f4141a00 2024-04-17T05:27:20.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.115+0000 7ff7f2a00640 1 -- 172.21.15.123:0/2098994468 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7d8003520 con 0x7ff7f4141a00 2024-04-17T05:27:20.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.115+0000 7ff7f2a00640 1 -- 172.21.15.123:0/2098994468 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 926849595 0 0) 0x7ff7d8003520 con 0x7ff7f4141a00 2024-04-17T05:27:20.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.115+0000 7ff7f2a00640 1 -- 172.21.15.123:0/2098994468 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7f40b9a80 msgr2=0x7ff7f4147b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:20.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.115+0000 7ff7f2a00640 1 --2- 172.21.15.123:0/2098994468 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7f40b9a80 0x7ff7f4147b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:20.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.115+0000 7ff7f2a00640 1 -- 172.21.15.123:0/2098994468 >> v2:172.21.15.164:3300/0 conn(0x7ff7f40ba6a0 msgr2=0x7ff7f40b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:20.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.115+0000 7ff7f2a00640 1 --2- 172.21.15.123:0/2098994468 >> v2:172.21.15.164:3300/0 conn(0x7ff7f40ba6a0 0x7ff7f40b48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:20.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.115+0000 7ff7f2a00640 1 -- 172.21.15.123:0/2098994468 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f40baa80 con 0x7ff7f4141a00 2024-04-17T05:27:20.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.115+0000 7ff7f2a00640 1 -- 172.21.15.123:0/2098994468 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1042962670 0 0) 0x7ff7ec001670 con 0x7ff7f4141a00 2024-04-17T05:27:20.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.115+0000 7ff7f2a00640 1 -- 172.21.15.123:0/2098994468 >> v1:172.21.15.123:6789/0 conn(0x7ff7f4141a00 legacy=0x7ff7f40b7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:20.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.115+0000 7ff7f2a00640 1 --2- 172.21.15.123:0/2098994468 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7f40b9a80 0x7ff7d80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:20.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.115+0000 7ff7f2a00640 1 --2- 172.21.15.123:0/2098994468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7d8003f30 0x7ff7d8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:20.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.115+0000 7ff7f2a00640 1 --2- 172.21.15.123:0/2098994468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7d8004d40 0x7ff7d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:20.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.115+0000 7ff7f2a00640 1 -- 172.21.15.123:0/2098994468 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f40b5e10 con 0x7ff7d8003f30 2024-04-17T05:27:20.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.115+0000 7ff7f2a00640 1 -- 172.21.15.123:0/2098994468 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f40b71d0 con 0x7ff7d8004d40 2024-04-17T05:27:20.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.115+0000 7ff7f2a00640 1 -- 172.21.15.123:0/2098994468 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7ff7d800ba10 con 0x7ff7f40b9a80 2024-04-17T05:27:20.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.115+0000 7ff7eaa00640 1 --2- 172.21.15.123:0/2098994468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7d8003f30 0x7ff7d8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:20.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.116+0000 7ff7f3400640 1 --2- 172.21.15.123:0/2098994468 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7f40b9a80 0x7ff7d80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:20.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.116+0000 7ff7f3e00640 1 --2- 172.21.15.123:0/2098994468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7d8004d40 0x7ff7d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:20.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.116+0000 7ff7eaa00640 1 -- 172.21.15.123:0/2098994468 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7f40b9a80 msgr2=0x7ff7d80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:20.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.116+0000 7ff7eaa00640 1 --2- 172.21.15.123:0/2098994468 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7f40b9a80 0x7ff7d80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:20.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.116+0000 7ff7eaa00640 1 -- 172.21.15.123:0/2098994468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7d8004d40 msgr2=0x7ff7d80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:20.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.116+0000 7ff7eaa00640 1 --2- 172.21.15.123:0/2098994468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7d8004d40 0x7ff7d80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:20.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.116+0000 7ff7eaa00640 1 -- 172.21.15.123:0/2098994468 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7d8003520 con 0x7ff7d8003f30 2024-04-17T05:27:20.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.117+0000 7ff7eaa00640 1 --2- 172.21.15.123:0/2098994468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7d8003f30 0x7ff7d8004800 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc009af0 tx=0x7ff7d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc243f18eec6d667 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:20.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.117+0000 7ff7f2a00640 1 -- 172.21.15.123:0/2098994468 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc039070 con 0x7ff7d8003f30 2024-04-17T05:27:20.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.117+0000 7ff7f2a00640 1 -- 172.21.15.123:0/2098994468 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7dc02c6b0 con 0x7ff7d8003f30 2024-04-17T05:27:20.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.117+0000 7ff7f2a00640 1 -- 172.21.15.123:0/2098994468 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc009690 con 0x7ff7d8003f30 2024-04-17T05:27:20.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.118+0000 7ff7f8c00640 1 -- 172.21.15.123:0/2098994468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7d8003f30 msgr2=0x7ff7d8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:20.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.118+0000 7ff7f8c00640 1 --2- 172.21.15.123:0/2098994468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7d8003f30 0x7ff7d8004800 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc009af0 tx=0x7ff7d8005830 comp rx=0 tx=0).stop 2024-04-17T05:27:20.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.118+0000 7ff7f3e00640 1 -- 172.21.15.123:0/2098994468 reap_dead start 2024-04-17T05:27:20.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.118+0000 7ff7f8c00640 1 -- 172.21.15.123:0/2098994468 shutdown_connections 2024-04-17T05:27:20.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.118+0000 7ff7f8c00640 1 -- 172.21.15.123:0/2098994468 >> 172.21.15.123:0/2098994468 conn(0x7ff7f406bda0 msgr2=0x7ff7f406c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:20.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.118+0000 7ff7f8c00640 1 -- 172.21.15.123:0/2098994468 shutdown_connections 2024-04-17T05:27:20.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.118+0000 7ff7f8c00640 1 -- 172.21.15.123:0/2098994468 wait complete. 2024-04-17T05:27:20.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.120+0000 7ff7f8c00640 1 Processor -- start 2024-04-17T05:27:20.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.120+0000 7ff7f8c00640 1 -- start start 2024-04-17T05:27:20.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.121+0000 7ff7f8c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7d8003f30 0x7ff7f40b2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:20.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.121+0000 7ff7f8c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7f40b3820 0x7ff7f41dd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:20.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.121+0000 7ff7f8c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7f41ddc80 0x7ff7f41e0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:20.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.121+0000 7ff7f8c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f40b6420 con 0x7ff7f41ddc80 2024-04-17T05:27:20.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.121+0000 7ff7f8c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f40b62a0 con 0x7ff7f40b3820 2024-04-17T05:27:20.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.121+0000 7ff7f8c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7ff7f4141e90 con 0x7ff7d8003f30 2024-04-17T05:27:20.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.121+0000 7ff7f3e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7f41ddc80 0x7ff7f41e0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:20.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.121+0000 7ff7f3e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7f41ddc80 0x7ff7f41e0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38016/0 (socket says 172.21.15.123:38016) 2024-04-17T05:27:20.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.121+0000 7ff7f3e00640 1 -- 172.21.15.123:0/1503792285 learned_addr learned my addr 172.21.15.123:0/1503792285 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:20.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.121+0000 7ff7f3400640 1 --2- 172.21.15.123:0/1503792285 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7d8003f30 0x7ff7f40b2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:20.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.121+0000 7ff7eaa00640 1 --2- 172.21.15.123:0/1503792285 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7f40b3820 0x7ff7f41dd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:20.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.121+0000 7ff7f3e00640 1 -- 172.21.15.123:0/1503792285 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7d8003f30 msgr2=0x7ff7f40b2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:20.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.121+0000 7ff7f3e00640 1 --2- 172.21.15.123:0/1503792285 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7d8003f30 0x7ff7f40b2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:20.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.121+0000 7ff7f3e00640 1 -- 172.21.15.123:0/1503792285 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7f40b3820 msgr2=0x7ff7f41dd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:20.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.121+0000 7ff7f3e00640 1 --2- 172.21.15.123:0/1503792285 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7f40b3820 0x7ff7f41dd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:20.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.121+0000 7ff7f3e00640 1 -- 172.21.15.123:0/1503792285 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f41de100 con 0x7ff7f41ddc80 2024-04-17T05:27:20.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.122+0000 7ff7f3e00640 1 --2- 172.21.15.123:0/1503792285 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7f41ddc80 0x7ff7f41e0960 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec000c00 tx=0x7ff7ec00eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:20.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.122+0000 7ff7ebe00640 1 -- 172.21.15.123:0/1503792285 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec019070 con 0x7ff7f41ddc80 2024-04-17T05:27:20.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.122+0000 7ff7ebe00640 1 -- 172.21.15.123:0/1503792285 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7ec00c570 con 0x7ff7f41ddc80 2024-04-17T05:27:20.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.122+0000 7ff7f8c00640 1 -- 172.21.15.123:0/1503792285 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7f40b2790 con 0x7ff7f41ddc80 2024-04-17T05:27:20.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.122+0000 7ff7ebe00640 1 -- 172.21.15.123:0/1503792285 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec00c960 con 0x7ff7f41ddc80 2024-04-17T05:27:20.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.122+0000 7ff7f8c00640 1 -- 172.21.15.123:0/1503792285 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7f40b1dc0 con 0x7ff7f41ddc80 2024-04-17T05:27:20.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.124+0000 7ff7f8c00640 1 -- 172.21.15.123:0/1503792285 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7f40b2960 con 0x7ff7f41ddc80 2024-04-17T05:27:20.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.124+0000 7ff7ebe00640 1 -- 172.21.15.123:0/1503792285 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff7ec01c070 con 0x7ff7f41ddc80 2024-04-17T05:27:20.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.125+0000 7ff7ebe00640 1 --2- 172.21.15.123:0/1503792285 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7ff7d006c8f0 0x7ff7d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:20.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.125+0000 7ff7ebe00640 1 -- 172.21.15.123:0/1503792285 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff7ec08b330 con 0x7ff7f41ddc80 2024-04-17T05:27:20.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.126+0000 7ff7f3400640 1 --2- 172.21.15.123:0/1503792285 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7ff7d006c8f0 0x7ff7d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:20.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.127+0000 7ff7f3400640 1 --2- 172.21.15.123:0/1503792285 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7ff7d006c8f0 0x7ff7d006edb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4007380 tx=0x7ff7e400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:20.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.129+0000 7ff7ebe00640 1 -- 172.21.15.123:0/1503792285 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7ff7f41de100 con 0x7ff7f41ddc80 2024-04-17T05:27:20.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.335+0000 7ff7f8c00640 1 -- 172.21.15.123:0/1503792285 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff7f40759b0 con 0x7ff7f41ddc80 2024-04-17T05:27:20.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.337+0000 7ff7ebe00640 1 -- 172.21.15.123:0/1503792285 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18526 (secure 0 0 0) 0x7ff7ec0594b0 con 0x7ff7f41ddc80 2024-04-17T05:27:20.335 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:27:20.335 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":26,"fsid":"0787c5c0-e77a-4102-a899-30db48b19c68","created":"2024-04-17T05:26:33.031507+0000","modified":"2024-04-17T05:26:57.743352+0000","last_up_change":"2024-04-17T05:26:44.988433+0000","last_in_change":"2024-04-17T05:26:36.682131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T05:26:46.329778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T05:26:50.600195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T05:26:51.626498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T05:26:55.264044+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15c87cdb-9415-45a6-a2a6-ea6bec9daece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6801","nonce":840753170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6803","nonce":840753170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6807","nonce":840753170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6805","nonce":840753170}]},"public_addr":"172.21.15.123:6801/840753170","cluster_addr":"172.21.15.123:6803/840753170","heartbeat_back_addr":"172.21.15.123:6807/840753170","heartbeat_front_addr":"172.21.15.123:6805/840753170","state":["exists","up"]},{"osd":1,"uuid":"281751b5-486d-4845-b4aa-b308bf7cec62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6822","nonce":2231878927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6827","nonce":2231878927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6831","nonce":2231878927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6829","nonce":2231878927}]},"public_addr":"172.21.15.123:6822/2231878927","cluster_addr":"172.21.15.123:6827/2231878927","heartbeat_back_addr":"172.21.15.123:6831/2231878927","heartbeat_front_addr":"172.21.15.123:6829/2231878927","state":["exists","up"]},{"osd":2,"uuid":"b42257d3-bd20-4db5-aa37-1bf5c512d0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6817","nonce":754360844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6820","nonce":754360844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6825","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6826","nonce":754360844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6823","nonce":754360844}]},"public_addr":"172.21.15.123:6817/754360844","cluster_addr":"172.21.15.123:6820/754360844","heartbeat_back_addr":"172.21.15.123:6826/754360844","heartbeat_front_addr":"172.21.15.123:6823/754360844","state":["exists","up"]},{"osd":3,"uuid":"0f26b891-bbe6-478e-8dee-78e69bb48cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6809","nonce":2898088574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6811","nonce":2898088574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6815","nonce":2898088574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6813","nonce":2898088574}]},"public_addr":"172.21.15.123:6809/2898088574","cluster_addr":"172.21.15.123:6811/2898088574","heartbeat_back_addr":"172.21.15.123:6815/2898088574","heartbeat_front_addr":"172.21.15.123:6813/2898088574","state":["exists","up"]},{"osd":4,"uuid":"43e59318-2740-4625-9d64-eec1fd43c322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6801","nonce":606484349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6804","nonce":606484349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6812","nonce":606484349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6808","nonce":606484349}]},"public_addr":"172.21.15.164:6801/606484349","cluster_addr":"172.21.15.164:6804/606484349","heartbeat_back_addr":"172.21.15.164:6812/606484349","heartbeat_front_addr":"172.21.15.164:6808/606484349","state":["exists","up"]},{"osd":5,"uuid":"aaa3acf4-4adc-4337-aba3-363851d35310","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6805","nonce":1376989593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6809","nonce":1376989593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6815","nonce":1376989593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6813","nonce":1376989593}]},"public_addr":"172.21.15.164:6805/1376989593","cluster_addr":"172.21.15.164:6809/1376989593","heartbeat_back_addr":"172.21.15.164:6815/1376989593","heartbeat_front_addr":"172.21.15.164:6813/1376989593","state":["exists","up"]},{"osd":6,"uuid":"6f765b27-7377-4d81-9192-23a965651145","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6817","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6821","nonce":1594306924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6823","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6826","nonce":1594306924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6831","nonce":1594306924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6829","nonce":1594306924}]},"public_addr":"172.21.15.164:6821/1594306924","cluster_addr":"172.21.15.164:6826/1594306924","heartbeat_back_addr":"172.21.15.164:6831/1594306924","heartbeat_front_addr":"172.21.15.164:6829/1594306924","state":["exists","up"]},{"osd":7,"uuid":"5547394b-ec2f-4311-846d-369af4b1acf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6818","nonce":295402697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6819","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6820","nonce":295402697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6825","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6827","nonce":295402697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6824","nonce":295402697}]},"public_addr":"172.21.15.164:6818/295402697","cluster_addr":"172.21.15.164:6820/295402697","heartbeat_back_addr":"172.21.15.164:6827/295402697","heartbeat_front_addr":"172.21.15.164:6824/295402697","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.034807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.022201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.751897+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.850533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.083608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.047524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.314753+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.413586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T05:27:20.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.340+0000 7ff7f8c00640 1 -- 172.21.15.123:0/1503792285 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7ff7d006c8f0 msgr2=0x7ff7d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:20.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.340+0000 7ff7f8c00640 1 --2- 172.21.15.123:0/1503792285 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7ff7d006c8f0 0x7ff7d006edb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4007380 tx=0x7ff7e400b040 comp rx=0 tx=0).stop 2024-04-17T05:27:20.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.340+0000 7ff7f8c00640 1 -- 172.21.15.123:0/1503792285 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7f41ddc80 msgr2=0x7ff7f41e0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:20.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.340+0000 7ff7f8c00640 1 --2- 172.21.15.123:0/1503792285 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7f41ddc80 0x7ff7f41e0960 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec000c00 tx=0x7ff7ec00eae0 comp rx=0 tx=0).stop 2024-04-17T05:27:20.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.340+0000 7ff7f8c00640 1 -- 172.21.15.123:0/1503792285 shutdown_connections 2024-04-17T05:27:20.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.340+0000 7ff7f8c00640 1 --2- 172.21.15.123:0/1503792285 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7f41ddc80 0x7ff7f41e0960 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:20.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.340+0000 7ff7f8c00640 1 --2- 172.21.15.123:0/1503792285 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff7f40b3820 0x7ff7f41dd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:20.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.340+0000 7ff7f8c00640 1 --2- 172.21.15.123:0/1503792285 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7ff7d006c8f0 0x7ff7d006edb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:20.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.340+0000 7ff7f8c00640 1 --2- 172.21.15.123:0/1503792285 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff7d8003f30 0x7ff7f40b2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:20.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.340+0000 7ff7f8c00640 1 -- 172.21.15.123:0/1503792285 >> 172.21.15.123:0/1503792285 conn(0x7ff7f406bda0 msgr2=0x7ff7f41463a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:20.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.340+0000 7ff7f8c00640 1 -- 172.21.15.123:0/1503792285 shutdown_connections 2024-04-17T05:27:20.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.340+0000 7ff7f8c00640 1 -- 172.21.15.123:0/1503792285 wait complete. 2024-04-17T05:27:20.356 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-17T05:27:20.356 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T05:27:20.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.562+0000 7f77de600640 1 Processor -- start 2024-04-17T05:27:20.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.562+0000 7f77de600640 1 -- start start 2024-04-17T05:27:20.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.563+0000 7f77de600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f77d80ba6a0 0x7f77d80b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:20.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.563+0000 7f77de600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77d8141a00 0x7f77d8141e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:20.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.563+0000 7f77de600640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77d8148240 con 0x7f77d80b9a80 2024-04-17T05:27:20.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.563+0000 7f77de600640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f77d80b5e10 con 0x7f77d80ba6a0 2024-04-17T05:27:20.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.563+0000 7f77de600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f77d80b71d0 con 0x7f77d8141a00 2024-04-17T05:27:20.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.563+0000 7f77dd200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f77d80ba6a0 0x7f77d80b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:20.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.563+0000 7f77dd200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f77d80ba6a0 0x7f77d80b48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38032/0 (socket says 172.21.15.123:38032) 2024-04-17T05:27:20.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.563+0000 7f77dd200640 1 -- 172.21.15.123:0/3588140590 learned_addr learned my addr 172.21.15.123:0/3588140590 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:20.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.564+0000 7f77ddc00640 1 --2- 172.21.15.123:0/3588140590 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77d8141a00 0x7f77d8141e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:20.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.564+0000 7f77dd200640 1 -- 172.21.15.123:0/3588140590 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77d8141a00 msgr2=0x7f77d8141e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:20.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.564+0000 7f77dd200640 1 --2- 172.21.15.123:0/3588140590 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77d8141a00 0x7f77d8141e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:20.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.564+0000 7f77dd200640 1 -- 172.21.15.123:0/3588140590 >> v1:172.21.15.164:6789/0 conn(0x7f77d80b9a80 legacy=0x7f77d8147b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:20.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.564+0000 7f77dd200640 1 -- 172.21.15.123:0/3588140590 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d80b57e0 con 0x7f77d80ba6a0 2024-04-17T05:27:20.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.565+0000 7f77dd200640 1 --2- 172.21.15.123:0/3588140590 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77d80ba6a0 0x7f77d80b48f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f77cc009870 tx=0x7f77cc02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40aa9d4a0002e81 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:20.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.565+0000 7f77d7400640 1 -- 172.21.15.123:0/3588140590 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77cc0317c0 con 0x7f77d80ba6a0 2024-04-17T05:27:20.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.565+0000 7f77d7400640 1 -- 172.21.15.123:0/3588140590 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77cc037070 con 0x7f77d80ba6a0 2024-04-17T05:27:20.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.565+0000 7f77d7400640 1 -- 172.21.15.123:0/3588140590 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77cc031b80 con 0x7f77d80ba6a0 2024-04-17T05:27:20.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.566+0000 7f77de600640 1 -- 172.21.15.123:0/3588140590 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77d80ba6a0 msgr2=0x7f77d80b48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:20.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.566+0000 7f77de600640 1 --2- 172.21.15.123:0/3588140590 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77d80ba6a0 0x7f77d80b48f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f77cc009870 tx=0x7f77cc02b860 comp rx=0 tx=0).stop 2024-04-17T05:27:20.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.566+0000 7f77de600640 1 -- 172.21.15.123:0/3588140590 shutdown_connections 2024-04-17T05:27:20.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.566+0000 7f77de600640 1 --2- 172.21.15.123:0/3588140590 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77d8141a00 0x7f77d8141e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:20.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.566+0000 7f77de600640 1 --2- 172.21.15.123:0/3588140590 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77d80ba6a0 0x7f77d80b48f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:20.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.566+0000 7f77de600640 1 -- 172.21.15.123:0/3588140590 >> 172.21.15.123:0/3588140590 conn(0x7f77d806bda0 msgr2=0x7f77d806c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:20.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.566+0000 7f77de600640 1 -- 172.21.15.123:0/3588140590 shutdown_connections 2024-04-17T05:27:20.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.566+0000 7f77de600640 1 -- 172.21.15.123:0/3588140590 wait complete. 2024-04-17T05:27:20.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.568+0000 7f77de600640 1 Processor -- start 2024-04-17T05:27:20.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.568+0000 7f77de600640 1 -- start start 2024-04-17T05:27:20.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.568+0000 7f77de600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77d80b9a80 0x7f77d80b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:20.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.568+0000 7f77de600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77d80ba6a0 0x7f77d80b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:20.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.569+0000 7f77de600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77d8141a00 0x7f77d81e08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:20.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.569+0000 7f77de600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f77d80b62a0 con 0x7f77d80ba6a0 2024-04-17T05:27:20.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.569+0000 7f77de600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f77d80b5a80 con 0x7f77d8141a00 2024-04-17T05:27:20.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.569+0000 7f77de600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f77d80b6420 con 0x7f77d80b9a80 2024-04-17T05:27:20.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.569+0000 7f77d7e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77d80ba6a0 0x7f77d80b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:20.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.569+0000 7f77d7e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77d80ba6a0 0x7f77d80b26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38034/0 (socket says 172.21.15.123:38034) 2024-04-17T05:27:20.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.569+0000 7f77d7e00640 1 -- 172.21.15.123:0/1070180145 learned_addr learned my addr 172.21.15.123:0/1070180145 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:20.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.569+0000 7f77d7e00640 1 -- 172.21.15.123:0/1070180145 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77d80b9a80 msgr2=0x7f77d80b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:20.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.569+0000 7f77dd200640 1 --2- 172.21.15.123:0/1070180145 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77d80b9a80 0x7f77d80b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:20.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.569+0000 7f77ddc00640 1 --2- 172.21.15.123:0/1070180145 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77d8141a00 0x7f77d81e08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:20.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.569+0000 7f77d7e00640 1 --2- 172.21.15.123:0/1070180145 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77d80b9a80 0x7f77d80b35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:20.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.569+0000 7f77d7e00640 1 -- 172.21.15.123:0/1070180145 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77d8141a00 msgr2=0x7f77d81e08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:20.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.569+0000 7f77d7e00640 1 --2- 172.21.15.123:0/1070180145 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77d8141a00 0x7f77d81e08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:20.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.569+0000 7f77d7e00640 1 -- 172.21.15.123:0/1070180145 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d81dd380 con 0x7f77d80ba6a0 2024-04-17T05:27:20.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.569+0000 7f77ddc00640 1 --2- 172.21.15.123:0/1070180145 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77d8141a00 0x7f77d81e08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:20.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.570+0000 7f77d7e00640 1 --2- 172.21.15.123:0/1070180145 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77d80ba6a0 0x7f77d80b26f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f77c400c430 tx=0x7f77c400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:20.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.570+0000 7f77d4c00640 1 -- 172.21.15.123:0/1070180145 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c4011790 con 0x7f77d80ba6a0 2024-04-17T05:27:20.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.570+0000 7f77d4c00640 1 -- 172.21.15.123:0/1070180145 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77c4017070 con 0x7f77d80ba6a0 2024-04-17T05:27:20.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.570+0000 7f77d4c00640 1 -- 172.21.15.123:0/1070180145 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c4011bb0 con 0x7f77d80ba6a0 2024-04-17T05:27:20.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.570+0000 7f77de600640 1 -- 172.21.15.123:0/1070180145 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77d81dd640 con 0x7f77d80ba6a0 2024-04-17T05:27:20.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.570+0000 7f77de600640 1 -- 172.21.15.123:0/1070180145 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77d8144c90 con 0x7f77d80ba6a0 2024-04-17T05:27:20.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.571+0000 7f77de600640 1 -- 172.21.15.123:0/1070180145 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77d81dda30 con 0x7f77d80ba6a0 2024-04-17T05:27:20.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.572+0000 7f77d4c00640 1 -- 172.21.15.123:0/1070180145 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f77c401c460 con 0x7f77d80ba6a0 2024-04-17T05:27:20.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.573+0000 7f77d4c00640 1 --2- 172.21.15.123:0/1070180145 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f77b806c8f0 0x7f77b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:20.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.573+0000 7f77d4c00640 1 -- 172.21.15.123:0/1070180145 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f77c408bd20 con 0x7f77d80ba6a0 2024-04-17T05:27:20.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.574+0000 7f77dd200640 1 --2- 172.21.15.123:0/1070180145 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f77b806c8f0 0x7f77b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:20.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.575+0000 7f77dd200640 1 --2- 172.21.15.123:0/1070180145 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f77b806c8f0 0x7f77b806edb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f77cc036000 tx=0x7f77cc008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:20.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.578+0000 7f77d4c00640 1 -- 172.21.15.123:0/1070180145 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f77c4059ea0 con 0x7f77d80ba6a0 2024-04-17T05:27:20.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.776+0000 7f77de600640 1 -- 172.21.15.123:0/1070180145 --> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f77d81dd810 con 0x7f77b806c8f0 2024-04-17T05:27:20.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.806+0000 7f77d4c00640 1 -- 172.21.15.123:0/1070180145 <== mgr.4103 v2:172.21.15.164:6832/4204006015 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332573 (secure 0 0 0) 0x7f77d81dd810 con 0x7f77b806c8f0 2024-04-17T05:27:20.810 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:27:20.812 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-04-17T05:27:20.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.812+0000 7f77de600640 1 -- 172.21.15.123:0/1070180145 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f77b806c8f0 msgr2=0x7f77b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:20.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.812+0000 7f77de600640 1 --2- 172.21.15.123:0/1070180145 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f77b806c8f0 0x7f77b806edb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f77cc036000 tx=0x7f77cc008030 comp rx=0 tx=0).stop 2024-04-17T05:27:20.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.813+0000 7f77de600640 1 -- 172.21.15.123:0/1070180145 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77d80ba6a0 msgr2=0x7f77d80b26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:20.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.813+0000 7f77de600640 1 --2- 172.21.15.123:0/1070180145 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77d80ba6a0 0x7f77d80b26f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f77c400c430 tx=0x7f77c400c8f0 comp rx=0 tx=0).stop 2024-04-17T05:27:20.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.813+0000 7f77de600640 1 -- 172.21.15.123:0/1070180145 shutdown_connections 2024-04-17T05:27:20.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.813+0000 7f77de600640 1 --2- 172.21.15.123:0/1070180145 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77d8141a00 0x7f77d81e08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:20.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.813+0000 7f77de600640 1 --2- 172.21.15.123:0/1070180145 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77d80ba6a0 0x7f77d80b26f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:20.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.813+0000 7f77de600640 1 --2- 172.21.15.123:0/1070180145 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f77b806c8f0 0x7f77b806edb0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:20.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.813+0000 7f77de600640 1 --2- 172.21.15.123:0/1070180145 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77d80b9a80 0x7f77d80b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:20.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.813+0000 7f77de600640 1 -- 172.21.15.123:0/1070180145 >> 172.21.15.123:0/1070180145 conn(0x7f77d806bda0 msgr2=0x7f77d80b85c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:20.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.813+0000 7f77de600640 1 -- 172.21.15.123:0/1070180145 shutdown_connections 2024-04-17T05:27:20.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:20.813+0000 7f77de600640 1 -- 172.21.15.123:0/1070180145 wait complete. 2024-04-17T05:27:20.831 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-04-17T05:27:20.307478+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219524,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755196,"statfs":{"total":773094113280,"available":772869320704,"internally_reserved":0,"allocated":3448832,"data_stored":2055264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005009"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314325+0000","last_change":"2024-04-17T05:26:52.205802+0000","last_active":"2024-04-17T05:26:59.314325+0000","last_peered":"2024-04-17T05:26:59.314325+0000","last_clean":"2024-04-17T05:26:59.314325+0000","last_became_active":"2024-04-17T05:26:52.205459+0000","last_became_peered":"2024-04-17T05:26:52.205459+0000","last_unstale":"2024-04-17T05:26:59.314325+0000","last_undegraded":"2024-04-17T05:26:59.314325+0000","last_fullsized":"2024-04-17T05:26:59.314325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:12:06.528342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274704+0000","last_change":"2024-04-17T05:26:53.231441+0000","last_active":"2024-04-17T05:26:58.274704+0000","last_peered":"2024-04-17T05:26:58.274704+0000","last_clean":"2024-04-17T05:26:58.274704+0000","last_became_active":"2024-04-17T05:26:53.231139+0000","last_became_peered":"2024-04-17T05:26:53.231139+0000","last_unstale":"2024-04-17T05:26:58.274704+0000","last_undegraded":"2024-04-17T05:26:58.274704+0000","last_fullsized":"2024-04-17T05:26:58.274704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:38:13.010763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273065+0000","last_change":"2024-04-17T05:26:57.347742+0000","last_active":"2024-04-17T05:26:58.273065+0000","last_peered":"2024-04-17T05:26:58.273065+0000","last_clean":"2024-04-17T05:26:58.273065+0000","last_became_active":"2024-04-17T05:26:57.347333+0000","last_became_peered":"2024-04-17T05:26:57.347333+0000","last_unstale":"2024-04-17T05:26:58.273065+0000","last_undegraded":"2024-04-17T05:26:58.273065+0000","last_fullsized":"2024-04-17T05:26:58.273065+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:23:44.724644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274845+0000","last_change":"2024-04-17T05:26:52.203448+0000","last_active":"2024-04-17T05:26:58.274845+0000","last_peered":"2024-04-17T05:26:58.274845+0000","last_clean":"2024-04-17T05:26:58.274845+0000","last_became_active":"2024-04-17T05:26:52.203161+0000","last_became_peered":"2024-04-17T05:26:52.203161+0000","last_unstale":"2024-04-17T05:26:58.274845+0000","last_undegraded":"2024-04-17T05:26:58.274845+0000","last_fullsized":"2024-04-17T05:26:58.274845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:11:26.292397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313463+0000","last_change":"2024-04-17T05:26:53.241735+0000","last_active":"2024-04-17T05:26:59.313463+0000","last_peered":"2024-04-17T05:26:59.313463+0000","last_clean":"2024-04-17T05:26:59.313463+0000","last_became_active":"2024-04-17T05:26:53.241460+0000","last_became_peered":"2024-04-17T05:26:53.241460+0000","last_unstale":"2024-04-17T05:26:59.313463+0000","last_undegraded":"2024-04-17T05:26:59.313463+0000","last_fullsized":"2024-04-17T05:26:59.313463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:32.131344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.275682+0000","last_change":"2024-04-17T05:26:57.310052+0000","last_active":"2024-04-17T05:26:58.275682+0000","last_peered":"2024-04-17T05:26:58.275682+0000","last_clean":"2024-04-17T05:26:58.275682+0000","last_became_active":"2024-04-17T05:26:57.309057+0000","last_became_peered":"2024-04-17T05:26:57.309057+0000","last_unstale":"2024-04-17T05:26:58.275682+0000","last_undegraded":"2024-04-17T05:26:58.275682+0000","last_fullsized":"2024-04-17T05:26:58.275682+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:32:29.420749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317337+0000","last_change":"2024-04-17T05:26:52.217413+0000","last_active":"2024-04-17T05:26:59.317337+0000","last_peered":"2024-04-17T05:26:59.317337+0000","last_clean":"2024-04-17T05:26:59.317337+0000","last_became_active":"2024-04-17T05:26:52.217101+0000","last_became_peered":"2024-04-17T05:26:52.217101+0000","last_unstale":"2024-04-17T05:26:59.317337+0000","last_undegraded":"2024-04-17T05:26:59.317337+0000","last_fullsized":"2024-04-17T05:26:59.317337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:39:51.930934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276312+0000","last_change":"2024-04-17T05:26:53.219012+0000","last_active":"2024-04-17T05:26:58.276312+0000","last_peered":"2024-04-17T05:26:58.276312+0000","last_clean":"2024-04-17T05:26:58.276312+0000","last_became_active":"2024-04-17T05:26:53.216591+0000","last_became_peered":"2024-04-17T05:26:53.216591+0000","last_unstale":"2024-04-17T05:26:58.276312+0000","last_undegraded":"2024-04-17T05:26:58.276312+0000","last_fullsized":"2024-04-17T05:26:58.276312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:02:12.833146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276701+0000","last_change":"2024-04-17T05:26:57.310537+0000","last_active":"2024-04-17T05:26:58.276701+0000","last_peered":"2024-04-17T05:26:58.276701+0000","last_clean":"2024-04-17T05:26:58.276701+0000","last_became_active":"2024-04-17T05:26:57.309381+0000","last_became_peered":"2024-04-17T05:26:57.309381+0000","last_unstale":"2024-04-17T05:26:58.276701+0000","last_undegraded":"2024-04-17T05:26:58.276701+0000","last_fullsized":"2024-04-17T05:26:58.276701+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:38:17.093545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317625+0000","last_change":"2024-04-17T05:26:52.218309+0000","last_active":"2024-04-17T05:26:59.317625+0000","last_peered":"2024-04-17T05:26:59.317625+0000","last_clean":"2024-04-17T05:26:59.317625+0000","last_became_active":"2024-04-17T05:26:52.217898+0000","last_became_peered":"2024-04-17T05:26:52.217898+0000","last_unstale":"2024-04-17T05:26:59.317625+0000","last_undegraded":"2024-04-17T05:26:59.317625+0000","last_fullsized":"2024-04-17T05:26:59.317625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:16:02.152039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276476+0000","last_change":"2024-04-17T05:26:53.232546+0000","last_active":"2024-04-17T05:26:58.276476+0000","last_peered":"2024-04-17T05:26:58.276476+0000","last_clean":"2024-04-17T05:26:58.276476+0000","last_became_active":"2024-04-17T05:26:53.232239+0000","last_became_peered":"2024-04-17T05:26:53.232239+0000","last_unstale":"2024-04-17T05:26:58.276476+0000","last_undegraded":"2024-04-17T05:26:58.276476+0000","last_fullsized":"2024-04-17T05:26:58.276476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:38:13.010763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276356+0000","last_change":"2024-04-17T05:26:57.297256+0000","last_active":"2024-04-17T05:26:58.276356+0000","last_peered":"2024-04-17T05:26:58.276356+0000","last_clean":"2024-04-17T05:26:58.276356+0000","last_became_active":"2024-04-17T05:26:57.296757+0000","last_became_peered":"2024-04-17T05:26:57.296757+0000","last_unstale":"2024-04-17T05:26:58.276356+0000","last_undegraded":"2024-04-17T05:26:58.276356+0000","last_fullsized":"2024-04-17T05:26:58.276356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:45:59.432940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315091+0000","last_change":"2024-04-17T05:26:53.244539+0000","last_active":"2024-04-17T05:26:59.315091+0000","last_peered":"2024-04-17T05:26:59.315091+0000","last_clean":"2024-04-17T05:26:59.315091+0000","last_became_active":"2024-04-17T05:26:53.244104+0000","last_became_peered":"2024-04-17T05:26:53.244104+0000","last_unstale":"2024-04-17T05:26:59.315091+0000","last_undegraded":"2024-04-17T05:26:59.315091+0000","last_fullsized":"2024-04-17T05:26:59.315091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:41:48.514881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317859+0000","last_change":"2024-04-17T05:26:52.214434+0000","last_active":"2024-04-17T05:26:59.317859+0000","last_peered":"2024-04-17T05:26:59.317859+0000","last_clean":"2024-04-17T05:26:59.317859+0000","last_became_active":"2024-04-17T05:26:52.214158+0000","last_became_peered":"2024-04-17T05:26:52.214158+0000","last_unstale":"2024-04-17T05:26:59.317859+0000","last_undegraded":"2024-04-17T05:26:59.317859+0000","last_fullsized":"2024-04-17T05:26:59.317859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:36:56.201576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.278955+0000","last_change":"2024-04-17T05:26:57.307151+0000","last_active":"2024-04-17T05:26:58.278955+0000","last_peered":"2024-04-17T05:26:58.278955+0000","last_clean":"2024-04-17T05:26:58.278955+0000","last_became_active":"2024-04-17T05:26:57.305676+0000","last_became_peered":"2024-04-17T05:26:57.305676+0000","last_unstale":"2024-04-17T05:26:58.278955+0000","last_undegraded":"2024-04-17T05:26:58.278955+0000","last_fullsized":"2024-04-17T05:26:58.278955+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:40:55.126943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273944+0000","last_change":"2024-04-17T05:26:53.230514+0000","last_active":"2024-04-17T05:26:58.273944+0000","last_peered":"2024-04-17T05:26:58.273944+0000","last_clean":"2024-04-17T05:26:58.273944+0000","last_became_active":"2024-04-17T05:26:53.230175+0000","last_became_peered":"2024-04-17T05:26:53.230175+0000","last_unstale":"2024-04-17T05:26:58.273944+0000","last_undegraded":"2024-04-17T05:26:58.273944+0000","last_fullsized":"2024-04-17T05:26:58.273944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:32.131344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315033+0000","last_change":"2024-04-17T05:26:52.207664+0000","last_active":"2024-04-17T05:26:59.315033+0000","last_peered":"2024-04-17T05:26:59.315033+0000","last_clean":"2024-04-17T05:26:59.315033+0000","last_became_active":"2024-04-17T05:26:52.207343+0000","last_became_peered":"2024-04-17T05:26:52.207343+0000","last_unstale":"2024-04-17T05:26:59.315033+0000","last_undegraded":"2024-04-17T05:26:59.315033+0000","last_fullsized":"2024-04-17T05:26:59.315033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:05:28.743450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.277704+0000","last_change":"2024-04-17T05:26:57.311205+0000","last_active":"2024-04-17T05:26:58.277704+0000","last_peered":"2024-04-17T05:26:58.277704+0000","last_clean":"2024-04-17T05:26:58.277704+0000","last_became_active":"2024-04-17T05:26:57.310038+0000","last_became_peered":"2024-04-17T05:26:57.310038+0000","last_unstale":"2024-04-17T05:26:58.277704+0000","last_undegraded":"2024-04-17T05:26:58.277704+0000","last_fullsized":"2024-04-17T05:26:58.277704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:02:16.915928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273375+0000","last_change":"2024-04-17T05:26:53.229416+0000","last_active":"2024-04-17T05:26:58.273375+0000","last_peered":"2024-04-17T05:26:58.273375+0000","last_clean":"2024-04-17T05:26:58.273375+0000","last_became_active":"2024-04-17T05:26:53.227324+0000","last_became_peered":"2024-04-17T05:26:53.227324+0000","last_unstale":"2024-04-17T05:26:58.273375+0000","last_undegraded":"2024-04-17T05:26:58.273375+0000","last_fullsized":"2024-04-17T05:26:58.273375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:08:41.870139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314210+0000","last_change":"2024-04-17T05:26:52.207557+0000","last_active":"2024-04-17T05:26:59.314210+0000","last_peered":"2024-04-17T05:26:59.314210+0000","last_clean":"2024-04-17T05:26:59.314210+0000","last_became_active":"2024-04-17T05:26:52.207019+0000","last_became_peered":"2024-04-17T05:26:52.207019+0000","last_unstale":"2024-04-17T05:26:59.314210+0000","last_undegraded":"2024-04-17T05:26:59.314210+0000","last_fullsized":"2024-04-17T05:26:59.314210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:43.039139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316495+0000","last_change":"2024-04-17T05:26:57.345734+0000","last_active":"2024-04-17T05:26:59.316495+0000","last_peered":"2024-04-17T05:26:59.316495+0000","last_clean":"2024-04-17T05:26:59.316495+0000","last_became_active":"2024-04-17T05:26:57.345300+0000","last_became_peered":"2024-04-17T05:26:57.345300+0000","last_unstale":"2024-04-17T05:26:59.316495+0000","last_undegraded":"2024-04-17T05:26:59.316495+0000","last_fullsized":"2024-04-17T05:26:59.316495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:45:07.123915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276660+0000","last_change":"2024-04-17T05:26:53.218687+0000","last_active":"2024-04-17T05:26:58.276660+0000","last_peered":"2024-04-17T05:26:58.276660+0000","last_clean":"2024-04-17T05:26:58.276660+0000","last_became_active":"2024-04-17T05:26:53.218355+0000","last_became_peered":"2024-04-17T05:26:53.218355+0000","last_unstale":"2024-04-17T05:26:58.276660+0000","last_undegraded":"2024-04-17T05:26:58.276660+0000","last_fullsized":"2024-04-17T05:26:58.276660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:05:29.762149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316846+0000","last_change":"2024-04-17T05:26:52.214868+0000","last_active":"2024-04-17T05:26:59.316846+0000","last_peered":"2024-04-17T05:26:59.316846+0000","last_clean":"2024-04-17T05:26:59.316846+0000","last_became_active":"2024-04-17T05:26:52.214633+0000","last_became_peered":"2024-04-17T05:26:52.214633+0000","last_unstale":"2024-04-17T05:26:59.316846+0000","last_undegraded":"2024-04-17T05:26:59.316846+0000","last_fullsized":"2024-04-17T05:26:59.316846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:10:33.072665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276550+0000","last_change":"2024-04-17T05:26:57.309644+0000","last_active":"2024-04-17T05:26:58.276550+0000","last_peered":"2024-04-17T05:26:58.276550+0000","last_clean":"2024-04-17T05:26:58.276550+0000","last_became_active":"2024-04-17T05:26:57.309175+0000","last_became_peered":"2024-04-17T05:26:57.309175+0000","last_unstale":"2024-04-17T05:26:58.276550+0000","last_undegraded":"2024-04-17T05:26:58.276550+0000","last_fullsized":"2024-04-17T05:26:58.276550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:31:30.903722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314210+0000","last_change":"2024-04-17T05:26:53.220368+0000","last_active":"2024-04-17T05:26:59.314210+0000","last_peered":"2024-04-17T05:26:59.314210+0000","last_clean":"2024-04-17T05:26:59.314210+0000","last_became_active":"2024-04-17T05:26:53.220068+0000","last_became_peered":"2024-04-17T05:26:53.220068+0000","last_unstale":"2024-04-17T05:26:59.314210+0000","last_undegraded":"2024-04-17T05:26:59.314210+0000","last_fullsized":"2024-04-17T05:26:59.314210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:04:57.213834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316683+0000","last_change":"2024-04-17T05:26:52.215954+0000","last_active":"2024-04-17T05:26:59.316683+0000","last_peered":"2024-04-17T05:26:59.316683+0000","last_clean":"2024-04-17T05:26:59.316683+0000","last_became_active":"2024-04-17T05:26:52.215637+0000","last_became_peered":"2024-04-17T05:26:52.215637+0000","last_unstale":"2024-04-17T05:26:59.316683+0000","last_undegraded":"2024-04-17T05:26:59.316683+0000","last_fullsized":"2024-04-17T05:26:59.316683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:05:12.780620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276029+0000","last_change":"2024-04-17T05:26:57.342654+0000","last_active":"2024-04-17T05:26:58.276029+0000","last_peered":"2024-04-17T05:26:58.276029+0000","last_clean":"2024-04-17T05:26:58.276029+0000","last_became_active":"2024-04-17T05:26:57.342205+0000","last_became_peered":"2024-04-17T05:26:57.342205+0000","last_unstale":"2024-04-17T05:26:58.276029+0000","last_undegraded":"2024-04-17T05:26:58.276029+0000","last_fullsized":"2024-04-17T05:26:58.276029+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:08:20.405780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.275085+0000","last_change":"2024-04-17T05:26:53.238192+0000","last_active":"2024-04-17T05:26:58.275085+0000","last_peered":"2024-04-17T05:26:58.275085+0000","last_clean":"2024-04-17T05:26:58.275085+0000","last_became_active":"2024-04-17T05:26:53.237901+0000","last_became_peered":"2024-04-17T05:26:53.237901+0000","last_unstale":"2024-04-17T05:26:58.275085+0000","last_undegraded":"2024-04-17T05:26:58.275085+0000","last_fullsized":"2024-04-17T05:26:58.275085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:31:26.820940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315702+0000","last_change":"2024-04-17T05:26:52.213337+0000","last_active":"2024-04-17T05:26:59.315702+0000","last_peered":"2024-04-17T05:26:59.315702+0000","last_clean":"2024-04-17T05:26:59.315702+0000","last_became_active":"2024-04-17T05:26:52.213091+0000","last_became_peered":"2024-04-17T05:26:52.213091+0000","last_unstale":"2024-04-17T05:26:59.315702+0000","last_undegraded":"2024-04-17T05:26:59.315702+0000","last_fullsized":"2024-04-17T05:26:59.315702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:26.013417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.272624+0000","last_change":"2024-04-17T05:26:57.342025+0000","last_active":"2024-04-17T05:26:58.272624+0000","last_peered":"2024-04-17T05:26:58.272624+0000","last_clean":"2024-04-17T05:26:58.272624+0000","last_became_active":"2024-04-17T05:26:57.341654+0000","last_became_peered":"2024-04-17T05:26:57.341654+0000","last_unstale":"2024-04-17T05:26:58.272624+0000","last_undegraded":"2024-04-17T05:26:58.272624+0000","last_fullsized":"2024-04-17T05:26:58.272624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:43:39.199679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315923+0000","last_change":"2024-04-17T05:26:53.220626+0000","last_active":"2024-04-17T05:26:59.315923+0000","last_peered":"2024-04-17T05:26:59.315923+0000","last_clean":"2024-04-17T05:26:59.315923+0000","last_became_active":"2024-04-17T05:26:53.220331+0000","last_became_peered":"2024-04-17T05:26:53.220331+0000","last_unstale":"2024-04-17T05:26:59.315923+0000","last_undegraded":"2024-04-17T05:26:59.315923+0000","last_fullsized":"2024-04-17T05:26:59.315923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:32:25.337967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317911+0000","last_change":"2024-04-17T05:26:52.216060+0000","last_active":"2024-04-17T05:26:59.317911+0000","last_peered":"2024-04-17T05:26:59.317911+0000","last_clean":"2024-04-17T05:26:59.317911+0000","last_became_active":"2024-04-17T05:26:52.215771+0000","last_became_peered":"2024-04-17T05:26:52.215771+0000","last_unstale":"2024-04-17T05:26:59.317911+0000","last_undegraded":"2024-04-17T05:26:59.317911+0000","last_fullsized":"2024-04-17T05:26:59.317911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:14:11.769826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313579+0000","last_change":"2024-04-17T05:26:57.343520+0000","last_active":"2024-04-17T05:26:59.313579+0000","last_peered":"2024-04-17T05:26:59.313579+0000","last_clean":"2024-04-17T05:26:59.313579+0000","last_became_active":"2024-04-17T05:26:57.343032+0000","last_became_peered":"2024-04-17T05:26:57.343032+0000","last_unstale":"2024-04-17T05:26:59.313579+0000","last_undegraded":"2024-04-17T05:26:59.313579+0000","last_fullsized":"2024-04-17T05:26:59.313579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:59:04.049982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276726+0000","last_change":"2024-04-17T05:26:53.238977+0000","last_active":"2024-04-17T05:26:58.276726+0000","last_peered":"2024-04-17T05:26:58.276726+0000","last_clean":"2024-04-17T05:26:58.276726+0000","last_became_active":"2024-04-17T05:26:53.238516+0000","last_became_peered":"2024-04-17T05:26:53.238516+0000","last_unstale":"2024-04-17T05:26:58.276726+0000","last_undegraded":"2024-04-17T05:26:58.276726+0000","last_fullsized":"2024-04-17T05:26:58.276726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:59:47.655532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315985+0000","last_change":"2024-04-17T05:26:52.204960+0000","last_active":"2024-04-17T05:26:59.315985+0000","last_peered":"2024-04-17T05:26:59.315985+0000","last_clean":"2024-04-17T05:26:59.315985+0000","last_became_active":"2024-04-17T05:26:52.204529+0000","last_became_peered":"2024-04-17T05:26:52.204529+0000","last_unstale":"2024-04-17T05:26:59.315985+0000","last_undegraded":"2024-04-17T05:26:59.315985+0000","last_fullsized":"2024-04-17T05:26:59.315985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:28.440614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314574+0000","last_change":"2024-04-17T05:26:57.300433+0000","last_active":"2024-04-17T05:26:59.314574+0000","last_peered":"2024-04-17T05:26:59.314574+0000","last_clean":"2024-04-17T05:26:59.314574+0000","last_became_active":"2024-04-17T05:26:57.299625+0000","last_became_peered":"2024-04-17T05:26:57.299625+0000","last_unstale":"2024-04-17T05:26:59.314574+0000","last_undegraded":"2024-04-17T05:26:59.314574+0000","last_fullsized":"2024-04-17T05:26:59.314574+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:59:51.738314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.278228+0000","last_change":"2024-04-17T05:26:53.221039+0000","last_active":"2024-04-17T05:26:58.278228+0000","last_peered":"2024-04-17T05:26:58.278228+0000","last_clean":"2024-04-17T05:26:58.278228+0000","last_became_active":"2024-04-17T05:26:53.220763+0000","last_became_peered":"2024-04-17T05:26:53.220763+0000","last_unstale":"2024-04-17T05:26:58.278228+0000","last_undegraded":"2024-04-17T05:26:58.278228+0000","last_fullsized":"2024-04-17T05:26:58.278228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:06:06.694765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.275564+0000","last_change":"2024-04-17T05:26:52.200059+0000","last_active":"2024-04-17T05:26:58.275564+0000","last_peered":"2024-04-17T05:26:58.275564+0000","last_clean":"2024-04-17T05:26:58.275564+0000","last_became_active":"2024-04-17T05:26:52.199528+0000","last_became_peered":"2024-04-17T05:26:52.199528+0000","last_unstale":"2024-04-17T05:26:58.275564+0000","last_undegraded":"2024-04-17T05:26:58.275564+0000","last_fullsized":"2024-04-17T05:26:58.275564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:39:42.873364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315890+0000","last_change":"2024-04-17T05:26:57.306296+0000","last_active":"2024-04-17T05:26:59.315890+0000","last_peered":"2024-04-17T05:26:59.315890+0000","last_clean":"2024-04-17T05:26:59.315890+0000","last_became_active":"2024-04-17T05:26:57.305013+0000","last_became_peered":"2024-04-17T05:26:57.305013+0000","last_unstale":"2024-04-17T05:26:59.315890+0000","last_undegraded":"2024-04-17T05:26:59.315890+0000","last_fullsized":"2024-04-17T05:26:59.315890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:43:13.615366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313694+0000","last_change":"2024-04-17T05:26:53.225946+0000","last_active":"2024-04-17T05:26:59.313694+0000","last_peered":"2024-04-17T05:26:59.313694+0000","last_clean":"2024-04-17T05:26:59.313694+0000","last_became_active":"2024-04-17T05:26:53.220930+0000","last_became_peered":"2024-04-17T05:26:53.220930+0000","last_unstale":"2024-04-17T05:26:59.313694+0000","last_undegraded":"2024-04-17T05:26:59.313694+0000","last_fullsized":"2024-04-17T05:26:59.313694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:08:41.870139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315801+0000","last_change":"2024-04-17T05:26:52.200139+0000","last_active":"2024-04-17T05:26:59.315801+0000","last_peered":"2024-04-17T05:26:59.315801+0000","last_clean":"2024-04-17T05:26:59.315801+0000","last_became_active":"2024-04-17T05:26:52.199804+0000","last_became_peered":"2024-04-17T05:26:52.199804+0000","last_unstale":"2024-04-17T05:26:59.315801+0000","last_undegraded":"2024-04-17T05:26:59.315801+0000","last_fullsized":"2024-04-17T05:26:59.315801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:05:28.743450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316978+0000","last_change":"2024-04-17T05:26:57.303365+0000","last_active":"2024-04-17T05:26:59.316978+0000","last_peered":"2024-04-17T05:26:59.316978+0000","last_clean":"2024-04-17T05:26:59.316978+0000","last_became_active":"2024-04-17T05:26:57.301101+0000","last_became_peered":"2024-04-17T05:26:57.301101+0000","last_unstale":"2024-04-17T05:26:59.316978+0000","last_undegraded":"2024-04-17T05:26:59.316978+0000","last_fullsized":"2024-04-17T05:26:59.316978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:43:39.199679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.312425+0000","last_change":"2024-04-17T05:26:53.238762+0000","last_active":"2024-04-17T05:26:59.312425+0000","last_peered":"2024-04-17T05:26:59.312425+0000","last_clean":"2024-04-17T05:26:59.312425+0000","last_became_active":"2024-04-17T05:26:53.238488+0000","last_became_peered":"2024-04-17T05:26:53.238488+0000","last_unstale":"2024-04-17T05:26:59.312425+0000","last_undegraded":"2024-04-17T05:26:59.312425+0000","last_fullsized":"2024-04-17T05:26:59.312425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:38.214751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315993+0000","last_change":"2024-04-17T05:26:52.213104+0000","last_active":"2024-04-17T05:26:59.315993+0000","last_peered":"2024-04-17T05:26:59.315993+0000","last_clean":"2024-04-17T05:26:59.315993+0000","last_became_active":"2024-04-17T05:26:52.212838+0000","last_became_peered":"2024-04-17T05:26:52.212838+0000","last_unstale":"2024-04-17T05:26:59.315993+0000","last_undegraded":"2024-04-17T05:26:59.315993+0000","last_fullsized":"2024-04-17T05:26:59.315993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:11:58.913400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313981+0000","last_change":"2024-04-17T05:26:57.342387+0000","last_active":"2024-04-17T05:26:59.313981+0000","last_peered":"2024-04-17T05:26:59.313981+0000","last_clean":"2024-04-17T05:26:59.313981+0000","last_became_active":"2024-04-17T05:26:57.342008+0000","last_became_peered":"2024-04-17T05:26:57.342008+0000","last_unstale":"2024-04-17T05:26:59.313981+0000","last_undegraded":"2024-04-17T05:26:59.313981+0000","last_fullsized":"2024-04-17T05:26:59.313981+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:43:39.199679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273541+0000","last_change":"2024-04-17T05:26:53.243046+0000","last_active":"2024-04-17T05:26:58.273541+0000","last_peered":"2024-04-17T05:26:58.273541+0000","last_clean":"2024-04-17T05:26:58.273541+0000","last_became_active":"2024-04-17T05:26:53.242778+0000","last_became_peered":"2024-04-17T05:26:53.242778+0000","last_unstale":"2024-04-17T05:26:58.273541+0000","last_undegraded":"2024-04-17T05:26:58.273541+0000","last_fullsized":"2024-04-17T05:26:58.273541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:32:25.337967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274750+0000","last_change":"2024-04-17T05:26:52.198125+0000","last_active":"2024-04-17T05:26:58.274750+0000","last_peered":"2024-04-17T05:26:58.274750+0000","last_clean":"2024-04-17T05:26:58.274750+0000","last_became_active":"2024-04-17T05:26:52.197762+0000","last_became_peered":"2024-04-17T05:26:52.197762+0000","last_unstale":"2024-04-17T05:26:58.274750+0000","last_undegraded":"2024-04-17T05:26:58.274750+0000","last_fullsized":"2024-04-17T05:26:58.274750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:28.440614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316306+0000","last_change":"2024-04-17T05:26:48.072527+0000","last_active":"2024-04-17T05:26:59.316306+0000","last_peered":"2024-04-17T05:26:59.316306+0000","last_clean":"2024-04-17T05:26:59.316306+0000","last_became_active":"2024-04-17T05:26:48.070585+0000","last_became_peered":"2024-04-17T05:26:48.070585+0000","last_unstale":"2024-04-17T05:26:59.316306+0000","last_undegraded":"2024-04-17T05:26:59.316306+0000","last_fullsized":"2024-04-17T05:26:59.316306+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:46.995002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:46.995002+0000","last_clean_scrub_stamp":"2024-04-17T05:26:46.995002+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:48:35.792125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316121+0000","last_change":"2024-04-17T05:26:57.346681+0000","last_active":"2024-04-17T05:26:59.316121+0000","last_peered":"2024-04-17T05:26:59.316121+0000","last_clean":"2024-04-17T05:26:59.316121+0000","last_became_active":"2024-04-17T05:26:57.345320+0000","last_became_peered":"2024-04-17T05:26:57.345320+0000","last_unstale":"2024-04-17T05:26:59.316121+0000","last_undegraded":"2024-04-17T05:26:59.316121+0000","last_fullsized":"2024-04-17T05:26:59.316121+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:14:02.473527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316740+0000","last_change":"2024-04-17T05:26:53.251585+0000","last_active":"2024-04-17T05:26:59.316740+0000","last_peered":"2024-04-17T05:26:59.316740+0000","last_clean":"2024-04-17T05:26:59.316740+0000","last_became_active":"2024-04-17T05:26:53.249490+0000","last_became_peered":"2024-04-17T05:26:53.249490+0000","last_unstale":"2024-04-17T05:26:59.316740+0000","last_undegraded":"2024-04-17T05:26:59.316740+0000","last_fullsized":"2024-04-17T05:26:59.316740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:32:48.533935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317029+0000","last_change":"2024-04-17T05:26:52.209276+0000","last_active":"2024-04-17T05:26:59.317029+0000","last_peered":"2024-04-17T05:26:59.317029+0000","last_clean":"2024-04-17T05:26:59.317029+0000","last_became_active":"2024-04-17T05:26:52.208422+0000","last_became_peered":"2024-04-17T05:26:52.208422+0000","last_unstale":"2024-04-17T05:26:59.317029+0000","last_undegraded":"2024-04-17T05:26:59.317029+0000","last_fullsized":"2024-04-17T05:26:59.317029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:39:42.873364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315187+0000","last_change":"2024-04-17T05:26:57.342209+0000","last_active":"2024-04-17T05:26:59.315187+0000","last_peered":"2024-04-17T05:26:59.315187+0000","last_clean":"2024-04-17T05:26:59.315187+0000","last_became_active":"2024-04-17T05:26:57.341658+0000","last_became_peered":"2024-04-17T05:26:57.341658+0000","last_unstale":"2024-04-17T05:26:59.315187+0000","last_undegraded":"2024-04-17T05:26:59.315187+0000","last_fullsized":"2024-04-17T05:26:59.315187+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:49.740852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276430+0000","last_change":"2024-04-17T05:26:53.239720+0000","last_active":"2024-04-17T05:26:58.276430+0000","last_peered":"2024-04-17T05:26:58.276430+0000","last_clean":"2024-04-17T05:26:58.276430+0000","last_became_active":"2024-04-17T05:26:53.238669+0000","last_became_peered":"2024-04-17T05:26:53.238669+0000","last_unstale":"2024-04-17T05:26:58.276430+0000","last_undegraded":"2024-04-17T05:26:58.276430+0000","last_fullsized":"2024-04-17T05:26:58.276430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:58:59.967200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316067+0000","last_change":"2024-04-17T05:26:52.202596+0000","last_active":"2024-04-17T05:26:59.316067+0000","last_peered":"2024-04-17T05:26:59.316067+0000","last_clean":"2024-04-17T05:26:59.316067+0000","last_became_active":"2024-04-17T05:26:52.202246+0000","last_became_peered":"2024-04-17T05:26:52.202246+0000","last_unstale":"2024-04-17T05:26:59.316067+0000","last_undegraded":"2024-04-17T05:26:59.316067+0000","last_fullsized":"2024-04-17T05:26:59.316067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:30.475514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313919+0000","last_change":"2024-04-17T05:26:57.303069+0000","last_active":"2024-04-17T05:26:59.313919+0000","last_peered":"2024-04-17T05:26:59.313919+0000","last_clean":"2024-04-17T05:26:59.313919+0000","last_became_active":"2024-04-17T05:26:57.302457+0000","last_became_peered":"2024-04-17T05:26:57.302457+0000","last_unstale":"2024-04-17T05:26:59.313919+0000","last_undegraded":"2024-04-17T05:26:59.313919+0000","last_fullsized":"2024-04-17T05:26:59.313919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:45:07.123915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.318354+0000","last_change":"2024-04-17T05:26:53.255140+0000","last_active":"2024-04-17T05:26:59.318354+0000","last_peered":"2024-04-17T05:26:59.318354+0000","last_clean":"2024-04-17T05:26:59.318354+0000","last_became_active":"2024-04-17T05:26:53.254371+0000","last_became_peered":"2024-04-17T05:26:53.254371+0000","last_unstale":"2024-04-17T05:26:59.318354+0000","last_undegraded":"2024-04-17T05:26:59.318354+0000","last_fullsized":"2024-04-17T05:26:59.318354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:33:12.651636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317435+0000","last_change":"2024-04-17T05:26:52.204598+0000","last_active":"2024-04-17T05:26:59.317435+0000","last_peered":"2024-04-17T05:26:59.317435+0000","last_clean":"2024-04-17T05:26:59.317435+0000","last_became_active":"2024-04-17T05:26:52.204139+0000","last_became_peered":"2024-04-17T05:26:52.204139+0000","last_unstale":"2024-04-17T05:26:59.317435+0000","last_undegraded":"2024-04-17T05:26:59.317435+0000","last_fullsized":"2024-04-17T05:26:59.317435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:11:26.292397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274608+0000","last_change":"2024-04-17T05:26:57.345152+0000","last_active":"2024-04-17T05:26:58.274608+0000","last_peered":"2024-04-17T05:26:58.274608+0000","last_clean":"2024-04-17T05:26:58.274608+0000","last_became_active":"2024-04-17T05:26:57.342006+0000","last_became_peered":"2024-04-17T05:26:57.342006+0000","last_unstale":"2024-04-17T05:26:58.274608+0000","last_undegraded":"2024-04-17T05:26:58.274608+0000","last_fullsized":"2024-04-17T05:26:58.274608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:56:05.345989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317476+0000","last_change":"2024-04-17T05:26:53.253746+0000","last_active":"2024-04-17T05:26:59.317476+0000","last_peered":"2024-04-17T05:26:59.317476+0000","last_clean":"2024-04-17T05:26:59.317476+0000","last_became_active":"2024-04-17T05:26:53.253395+0000","last_became_peered":"2024-04-17T05:26:53.253395+0000","last_unstale":"2024-04-17T05:26:59.317476+0000","last_undegraded":"2024-04-17T05:26:59.317476+0000","last_fullsized":"2024-04-17T05:26:59.317476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:46:38.091860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.277646+0000","last_change":"2024-04-17T05:26:52.199105+0000","last_active":"2024-04-17T05:26:58.277646+0000","last_peered":"2024-04-17T05:26:58.277646+0000","last_clean":"2024-04-17T05:26:58.277646+0000","last_became_active":"2024-04-17T05:26:52.198798+0000","last_became_peered":"2024-04-17T05:26:52.198798+0000","last_unstale":"2024-04-17T05:26:58.277646+0000","last_undegraded":"2024-04-17T05:26:58.277646+0000","last_fullsized":"2024-04-17T05:26:58.277646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:34:06.405382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274283+0000","last_change":"2024-04-17T05:26:57.306130+0000","last_active":"2024-04-17T05:26:58.274283+0000","last_peered":"2024-04-17T05:26:58.274283+0000","last_clean":"2024-04-17T05:26:58.274283+0000","last_became_active":"2024-04-17T05:26:57.305415+0000","last_became_peered":"2024-04-17T05:26:57.305415+0000","last_unstale":"2024-04-17T05:26:58.274283+0000","last_undegraded":"2024-04-17T05:26:58.274283+0000","last_fullsized":"2024-04-17T05:26:58.274283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:36.214126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317844+0000","last_change":"2024-04-17T05:26:53.253524+0000","last_active":"2024-04-17T05:26:59.317844+0000","last_peered":"2024-04-17T05:26:59.317844+0000","last_clean":"2024-04-17T05:26:59.317844+0000","last_became_active":"2024-04-17T05:26:53.251408+0000","last_became_peered":"2024-04-17T05:26:53.251408+0000","last_unstale":"2024-04-17T05:26:59.317844+0000","last_undegraded":"2024-04-17T05:26:59.317844+0000","last_fullsized":"2024-04-17T05:26:59.317844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:13:58.390745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315457+0000","last_change":"2024-04-17T05:26:52.197556+0000","last_active":"2024-04-17T05:26:59.315457+0000","last_peered":"2024-04-17T05:26:59.315457+0000","last_clean":"2024-04-17T05:26:59.315457+0000","last_became_active":"2024-04-17T05:26:52.197250+0000","last_became_peered":"2024-04-17T05:26:52.197250+0000","last_unstale":"2024-04-17T05:26:59.315457+0000","last_undegraded":"2024-04-17T05:26:59.315457+0000","last_fullsized":"2024-04-17T05:26:59.315457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:12:06.528342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313911+0000","last_change":"2024-04-17T05:26:57.296438+0000","last_active":"2024-04-17T05:26:59.313911+0000","last_peered":"2024-04-17T05:26:59.313911+0000","last_clean":"2024-04-17T05:26:59.313911+0000","last_became_active":"2024-04-17T05:26:57.296040+0000","last_became_peered":"2024-04-17T05:26:57.296040+0000","last_unstale":"2024-04-17T05:26:59.313911+0000","last_undegraded":"2024-04-17T05:26:59.313911+0000","last_fullsized":"2024-04-17T05:26:59.313911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:43:13.615366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315063+0000","last_change":"2024-04-17T05:26:53.231338+0000","last_active":"2024-04-17T05:26:59.315063+0000","last_peered":"2024-04-17T05:26:59.315063+0000","last_clean":"2024-04-17T05:26:59.315063+0000","last_became_active":"2024-04-17T05:26:53.230987+0000","last_became_peered":"2024-04-17T05:26:53.230987+0000","last_unstale":"2024-04-17T05:26:59.315063+0000","last_undegraded":"2024-04-17T05:26:59.315063+0000","last_fullsized":"2024-04-17T05:26:59.315063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:08:10.489719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315083+0000","last_change":"2024-04-17T05:26:52.207087+0000","last_active":"2024-04-17T05:26:59.315083+0000","last_peered":"2024-04-17T05:26:59.315083+0000","last_clean":"2024-04-17T05:26:59.315083+0000","last_became_active":"2024-04-17T05:26:52.206401+0000","last_became_peered":"2024-04-17T05:26:52.206401+0000","last_unstale":"2024-04-17T05:26:59.315083+0000","last_undegraded":"2024-04-17T05:26:59.315083+0000","last_fullsized":"2024-04-17T05:26:59.315083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:56:53.915549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.275125+0000","last_change":"2024-04-17T05:26:57.346955+0000","last_active":"2024-04-17T05:26:58.275125+0000","last_peered":"2024-04-17T05:26:58.275125+0000","last_clean":"2024-04-17T05:26:58.275125+0000","last_became_active":"2024-04-17T05:26:57.346516+0000","last_became_peered":"2024-04-17T05:26:57.346516+0000","last_unstale":"2024-04-17T05:26:58.275125+0000","last_undegraded":"2024-04-17T05:26:58.275125+0000","last_fullsized":"2024-04-17T05:26:58.275125+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:00:55.830345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317606+0000","last_change":"2024-04-17T05:26:53.254195+0000","last_active":"2024-04-17T05:26:59.317606+0000","last_peered":"2024-04-17T05:26:59.317606+0000","last_clean":"2024-04-17T05:26:59.317606+0000","last_became_active":"2024-04-17T05:26:53.253813+0000","last_became_peered":"2024-04-17T05:26:53.253813+0000","last_unstale":"2024-04-17T05:26:59.317606+0000","last_undegraded":"2024-04-17T05:26:59.317606+0000","last_fullsized":"2024-04-17T05:26:59.317606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:18:31.208224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.275423+0000","last_change":"2024-04-17T05:26:52.211664+0000","last_active":"2024-04-17T05:26:58.275423+0000","last_peered":"2024-04-17T05:26:58.275423+0000","last_clean":"2024-04-17T05:26:58.275423+0000","last_became_active":"2024-04-17T05:26:52.210106+0000","last_became_peered":"2024-04-17T05:26:52.210106+0000","last_unstale":"2024-04-17T05:26:58.275423+0000","last_undegraded":"2024-04-17T05:26:58.275423+0000","last_fullsized":"2024-04-17T05:26:58.275423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:11:26.292397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274110+0000","last_change":"2024-04-17T05:26:57.344473+0000","last_active":"2024-04-17T05:26:58.274110+0000","last_peered":"2024-04-17T05:26:58.274110+0000","last_clean":"2024-04-17T05:26:58.274110+0000","last_became_active":"2024-04-17T05:26:57.341999+0000","last_became_peered":"2024-04-17T05:26:57.341999+0000","last_unstale":"2024-04-17T05:26:58.274110+0000","last_undegraded":"2024-04-17T05:26:58.274110+0000","last_fullsized":"2024-04-17T05:26:58.274110+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:35:19.879335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313364+0000","last_change":"2024-04-17T05:26:53.235732+0000","last_active":"2024-04-17T05:26:59.313364+0000","last_peered":"2024-04-17T05:26:59.313364+0000","last_clean":"2024-04-17T05:26:59.313364+0000","last_became_active":"2024-04-17T05:26:53.233202+0000","last_became_peered":"2024-04-17T05:26:53.233202+0000","last_unstale":"2024-04-17T05:26:59.313364+0000","last_undegraded":"2024-04-17T05:26:59.313364+0000","last_fullsized":"2024-04-17T05:26:59.313364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:58:23.088108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314205+0000","last_change":"2024-04-17T05:26:52.194788+0000","last_active":"2024-04-17T05:26:59.314205+0000","last_peered":"2024-04-17T05:26:59.314205+0000","last_clean":"2024-04-17T05:26:59.314205+0000","last_became_active":"2024-04-17T05:26:52.194504+0000","last_became_peered":"2024-04-17T05:26:52.194504+0000","last_unstale":"2024-04-17T05:26:59.314205+0000","last_undegraded":"2024-04-17T05:26:59.314205+0000","last_fullsized":"2024-04-17T05:26:59.314205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:29:09.631143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276321+0000","last_change":"2024-04-17T05:26:57.344052+0000","last_active":"2024-04-17T05:26:58.276321+0000","last_peered":"2024-04-17T05:26:58.276321+0000","last_clean":"2024-04-17T05:26:58.276321+0000","last_became_active":"2024-04-17T05:26:57.343479+0000","last_became_peered":"2024-04-17T05:26:57.343479+0000","last_unstale":"2024-04-17T05:26:58.276321+0000","last_undegraded":"2024-04-17T05:26:58.276321+0000","last_fullsized":"2024-04-17T05:26:58.276321+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:23:44.724644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316499+0000","last_change":"2024-04-17T05:26:53.250744+0000","last_active":"2024-04-17T05:26:59.316499+0000","last_peered":"2024-04-17T05:26:59.316499+0000","last_clean":"2024-04-17T05:26:59.316499+0000","last_became_active":"2024-04-17T05:26:53.249125+0000","last_became_peered":"2024-04-17T05:26:53.249125+0000","last_unstale":"2024-04-17T05:26:59.316499+0000","last_undegraded":"2024-04-17T05:26:59.316499+0000","last_fullsized":"2024-04-17T05:26:59.316499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:29.313074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:27:10.814542+0000","last_change":"2024-04-17T05:26:52.208074+0000","last_active":"2024-04-17T05:27:10.814542+0000","last_peered":"2024-04-17T05:27:10.814542+0000","last_clean":"2024-04-17T05:27:10.814542+0000","last_became_active":"2024-04-17T05:26:52.207696+0000","last_became_peered":"2024-04-17T05:26:52.207696+0000","last_unstale":"2024-04-17T05:27:10.814542+0000","last_undegraded":"2024-04-17T05:27:10.814542+0000","last_fullsized":"2024-04-17T05:27:10.814542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:10:33.072665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314836+0000","last_change":"2024-04-17T05:26:57.303649+0000","last_active":"2024-04-17T05:26:59.314836+0000","last_peered":"2024-04-17T05:26:59.314836+0000","last_clean":"2024-04-17T05:26:59.314836+0000","last_became_active":"2024-04-17T05:26:57.303124+0000","last_became_peered":"2024-04-17T05:26:57.303124+0000","last_unstale":"2024-04-17T05:26:59.314836+0000","last_undegraded":"2024-04-17T05:26:59.314836+0000","last_fullsized":"2024-04-17T05:26:59.314836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:59:04.049982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.277954+0000","last_change":"2024-04-17T05:26:53.232911+0000","last_active":"2024-04-17T05:26:58.277954+0000","last_peered":"2024-04-17T05:26:58.277954+0000","last_clean":"2024-04-17T05:26:58.277954+0000","last_became_active":"2024-04-17T05:26:53.232624+0000","last_became_peered":"2024-04-17T05:26:53.232624+0000","last_unstale":"2024-04-17T05:26:58.277954+0000","last_undegraded":"2024-04-17T05:26:58.277954+0000","last_fullsized":"2024-04-17T05:26:58.277954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:31.494213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315869+0000","last_change":"2024-04-17T05:26:52.207484+0000","last_active":"2024-04-17T05:26:59.315869+0000","last_peered":"2024-04-17T05:26:59.315869+0000","last_clean":"2024-04-17T05:26:59.315869+0000","last_became_active":"2024-04-17T05:26:52.207181+0000","last_became_peered":"2024-04-17T05:26:52.207181+0000","last_unstale":"2024-04-17T05:26:59.315869+0000","last_undegraded":"2024-04-17T05:26:59.315869+0000","last_fullsized":"2024-04-17T05:26:59.315869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:06:05.676066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.277617+0000","last_change":"2024-04-17T05:26:57.310269+0000","last_active":"2024-04-17T05:26:58.277617+0000","last_peered":"2024-04-17T05:26:58.277617+0000","last_clean":"2024-04-17T05:26:58.277617+0000","last_became_active":"2024-04-17T05:26:57.308888+0000","last_became_peered":"2024-04-17T05:26:57.308888+0000","last_unstale":"2024-04-17T05:26:58.277617+0000","last_undegraded":"2024-04-17T05:26:58.277617+0000","last_fullsized":"2024-04-17T05:26:58.277617+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:52:36.475652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314048+0000","last_change":"2024-04-17T05:26:53.241678+0000","last_active":"2024-04-17T05:26:59.314048+0000","last_peered":"2024-04-17T05:26:59.314048+0000","last_clean":"2024-04-17T05:26:59.314048+0000","last_became_active":"2024-04-17T05:26:53.241388+0000","last_became_peered":"2024-04-17T05:26:53.241388+0000","last_unstale":"2024-04-17T05:26:59.314048+0000","last_undegraded":"2024-04-17T05:26:59.314048+0000","last_fullsized":"2024-04-17T05:26:59.314048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:32:25.337967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.277856+0000","last_change":"2024-04-17T05:26:52.213786+0000","last_active":"2024-04-17T05:26:58.277856+0000","last_peered":"2024-04-17T05:26:58.277856+0000","last_clean":"2024-04-17T05:26:58.277856+0000","last_became_active":"2024-04-17T05:26:52.212440+0000","last_became_peered":"2024-04-17T05:26:52.212440+0000","last_unstale":"2024-04-17T05:26:58.277856+0000","last_undegraded":"2024-04-17T05:26:58.277856+0000","last_fullsized":"2024-04-17T05:26:58.277856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:06:05.676066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273308+0000","last_change":"2024-04-17T05:26:57.300596+0000","last_active":"2024-04-17T05:26:58.273308+0000","last_peered":"2024-04-17T05:26:58.273308+0000","last_clean":"2024-04-17T05:26:58.273308+0000","last_became_active":"2024-04-17T05:26:57.300156+0000","last_became_peered":"2024-04-17T05:26:57.300156+0000","last_unstale":"2024-04-17T05:26:58.273308+0000","last_undegraded":"2024-04-17T05:26:58.273308+0000","last_fullsized":"2024-04-17T05:26:58.273308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:11:16.497552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.277619+0000","last_change":"2024-04-17T05:26:53.238893+0000","last_active":"2024-04-17T05:26:58.277619+0000","last_peered":"2024-04-17T05:26:58.277619+0000","last_clean":"2024-04-17T05:26:58.277619+0000","last_became_active":"2024-04-17T05:26:53.238566+0000","last_became_peered":"2024-04-17T05:26:53.238566+0000","last_unstale":"2024-04-17T05:26:58.277619+0000","last_undegraded":"2024-04-17T05:26:58.277619+0000","last_fullsized":"2024-04-17T05:26:58.277619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:52:32.392870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316389+0000","last_change":"2024-04-17T05:26:52.215304+0000","last_active":"2024-04-17T05:26:59.316389+0000","last_peered":"2024-04-17T05:26:59.316389+0000","last_clean":"2024-04-17T05:26:59.316389+0000","last_became_active":"2024-04-17T05:26:52.214958+0000","last_became_peered":"2024-04-17T05:26:52.214958+0000","last_unstale":"2024-04-17T05:26:59.316389+0000","last_undegraded":"2024-04-17T05:26:59.316389+0000","last_fullsized":"2024-04-17T05:26:59.316389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:13:25.702517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273063+0000","last_change":"2024-04-17T05:26:57.342083+0000","last_active":"2024-04-17T05:26:58.273063+0000","last_peered":"2024-04-17T05:26:58.273063+0000","last_clean":"2024-04-17T05:26:58.273063+0000","last_became_active":"2024-04-17T05:26:57.341304+0000","last_became_peered":"2024-04-17T05:26:57.341304+0000","last_unstale":"2024-04-17T05:26:58.273063+0000","last_undegraded":"2024-04-17T05:26:58.273063+0000","last_fullsized":"2024-04-17T05:26:58.273063+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:56:05.345989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313536+0000","last_change":"2024-04-17T05:26:57.342446+0000","last_active":"2024-04-17T05:26:59.313536+0000","last_peered":"2024-04-17T05:26:59.313536+0000","last_clean":"2024-04-17T05:26:59.313536+0000","last_became_active":"2024-04-17T05:26:57.342076+0000","last_became_peered":"2024-04-17T05:26:57.342076+0000","last_unstale":"2024-04-17T05:26:59.313536+0000","last_undegraded":"2024-04-17T05:26:59.313536+0000","last_fullsized":"2024-04-17T05:26:59.313536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:59:51.738314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314000+0000","last_change":"2024-04-17T05:26:53.228706+0000","last_active":"2024-04-17T05:26:59.314000+0000","last_peered":"2024-04-17T05:26:59.314000+0000","last_clean":"2024-04-17T05:26:59.314000+0000","last_became_active":"2024-04-17T05:26:53.228381+0000","last_became_peered":"2024-04-17T05:26:53.228381+0000","last_unstale":"2024-04-17T05:26:59.314000+0000","last_undegraded":"2024-04-17T05:26:59.314000+0000","last_fullsized":"2024-04-17T05:26:59.314000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:04:57.213834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274809+0000","last_change":"2024-04-17T05:26:52.195697+0000","last_active":"2024-04-17T05:26:58.274809+0000","last_peered":"2024-04-17T05:26:58.274809+0000","last_clean":"2024-04-17T05:26:58.274809+0000","last_became_active":"2024-04-17T05:26:52.193995+0000","last_became_peered":"2024-04-17T05:26:52.193995+0000","last_unstale":"2024-04-17T05:26:58.274809+0000","last_undegraded":"2024-04-17T05:26:58.274809+0000","last_fullsized":"2024-04-17T05:26:58.274809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:05:28.743450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316290+0000","last_change":"2024-04-17T05:26:57.306563+0000","last_active":"2024-04-17T05:26:59.316290+0000","last_peered":"2024-04-17T05:26:59.316290+0000","last_clean":"2024-04-17T05:26:59.316290+0000","last_became_active":"2024-04-17T05:26:57.305777+0000","last_became_peered":"2024-04-17T05:26:57.305777+0000","last_unstale":"2024-04-17T05:26:59.316290+0000","last_undegraded":"2024-04-17T05:26:59.316290+0000","last_fullsized":"2024-04-17T05:26:59.316290+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:33.395856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273167+0000","last_change":"2024-04-17T05:26:53.229100+0000","last_active":"2024-04-17T05:26:58.273167+0000","last_peered":"2024-04-17T05:26:58.273167+0000","last_clean":"2024-04-17T05:26:58.273167+0000","last_became_active":"2024-04-17T05:26:53.225554+0000","last_became_peered":"2024-04-17T05:26:53.225554+0000","last_unstale":"2024-04-17T05:26:58.273167+0000","last_undegraded":"2024-04-17T05:26:58.273167+0000","last_fullsized":"2024-04-17T05:26:58.273167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:04:57.213834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273220+0000","last_change":"2024-04-17T05:26:52.205214+0000","last_active":"2024-04-17T05:26:58.273220+0000","last_peered":"2024-04-17T05:26:58.273220+0000","last_clean":"2024-04-17T05:26:58.273220+0000","last_became_active":"2024-04-17T05:26:52.204982+0000","last_became_peered":"2024-04-17T05:26:52.204982+0000","last_unstale":"2024-04-17T05:26:58.273220+0000","last_undegraded":"2024-04-17T05:26:58.273220+0000","last_fullsized":"2024-04-17T05:26:58.273220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:12:06.528342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315415+0000","last_change":"2024-04-17T05:26:52.211538+0000","last_active":"2024-04-17T05:26:59.315415+0000","last_peered":"2024-04-17T05:26:59.315415+0000","last_clean":"2024-04-17T05:26:59.315415+0000","last_became_active":"2024-04-17T05:26:52.211242+0000","last_became_peered":"2024-04-17T05:26:52.211242+0000","last_unstale":"2024-04-17T05:26:59.315415+0000","last_undegraded":"2024-04-17T05:26:59.315415+0000","last_fullsized":"2024-04-17T05:26:59.315415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:30:14.163882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314091+0000","last_change":"2024-04-17T05:26:53.239968+0000","last_active":"2024-04-17T05:26:59.314091+0000","last_peered":"2024-04-17T05:26:59.314091+0000","last_clean":"2024-04-17T05:26:59.314091+0000","last_became_active":"2024-04-17T05:26:53.239688+0000","last_became_peered":"2024-04-17T05:26:53.239688+0000","last_unstale":"2024-04-17T05:26:59.314091+0000","last_undegraded":"2024-04-17T05:26:59.314091+0000","last_fullsized":"2024-04-17T05:26:59.314091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:19:17.442103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317082+0000","last_change":"2024-04-17T05:26:57.297209+0000","last_active":"2024-04-17T05:26:59.317082+0000","last_peered":"2024-04-17T05:26:59.317082+0000","last_clean":"2024-04-17T05:26:59.317082+0000","last_became_active":"2024-04-17T05:26:57.295730+0000","last_became_peered":"2024-04-17T05:26:57.295730+0000","last_unstale":"2024-04-17T05:26:59.317082+0000","last_undegraded":"2024-04-17T05:26:59.317082+0000","last_fullsized":"2024-04-17T05:26:59.317082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:47:55.696215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274119+0000","last_change":"2024-04-17T05:26:52.214520+0000","last_active":"2024-04-17T05:26:58.274119+0000","last_peered":"2024-04-17T05:26:58.274119+0000","last_clean":"2024-04-17T05:26:58.274119+0000","last_became_active":"2024-04-17T05:26:52.214153+0000","last_became_peered":"2024-04-17T05:26:52.214153+0000","last_unstale":"2024-04-17T05:26:58.274119+0000","last_undegraded":"2024-04-17T05:26:58.274119+0000","last_fullsized":"2024-04-17T05:26:58.274119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:29:09.631143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.277103+0000","last_change":"2024-04-17T05:26:53.218086+0000","last_active":"2024-04-17T05:26:58.277103+0000","last_peered":"2024-04-17T05:26:58.277103+0000","last_clean":"2024-04-17T05:26:58.277103+0000","last_became_active":"2024-04-17T05:26:53.213566+0000","last_became_peered":"2024-04-17T05:26:53.213566+0000","last_unstale":"2024-04-17T05:26:58.277103+0000","last_undegraded":"2024-04-17T05:26:58.277103+0000","last_fullsized":"2024-04-17T05:26:58.277103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:29.459313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274661+0000","last_change":"2024-04-17T05:26:57.306742+0000","last_active":"2024-04-17T05:26:58.274661+0000","last_peered":"2024-04-17T05:26:58.274661+0000","last_clean":"2024-04-17T05:26:58.274661+0000","last_became_active":"2024-04-17T05:26:57.305115+0000","last_became_peered":"2024-04-17T05:26:57.305115+0000","last_unstale":"2024-04-17T05:26:58.274661+0000","last_undegraded":"2024-04-17T05:26:58.274661+0000","last_fullsized":"2024-04-17T05:26:58.274661+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:48:36.621042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315919+0000","last_change":"2024-04-17T05:26:53.232255+0000","last_active":"2024-04-17T05:26:59.315919+0000","last_peered":"2024-04-17T05:26:59.315919+0000","last_clean":"2024-04-17T05:26:59.315919+0000","last_became_active":"2024-04-17T05:26:53.231624+0000","last_became_peered":"2024-04-17T05:26:53.231624+0000","last_unstale":"2024-04-17T05:26:59.315919+0000","last_undegraded":"2024-04-17T05:26:59.315919+0000","last_fullsized":"2024-04-17T05:26:59.315919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:27:51.120892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316072+0000","last_change":"2024-04-17T05:26:53.222619+0000","last_active":"2024-04-17T05:26:59.316072+0000","last_peered":"2024-04-17T05:26:59.316072+0000","last_clean":"2024-04-17T05:26:59.316072+0000","last_became_active":"2024-04-17T05:26:53.222128+0000","last_became_peered":"2024-04-17T05:26:53.222128+0000","last_unstale":"2024-04-17T05:26:59.316072+0000","last_undegraded":"2024-04-17T05:26:59.316072+0000","last_fullsized":"2024-04-17T05:26:59.316072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:31.494213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.275315+0000","last_change":"2024-04-17T05:26:53.234820+0000","last_active":"2024-04-17T05:26:58.275315+0000","last_peered":"2024-04-17T05:26:58.275315+0000","last_clean":"2024-04-17T05:26:58.275315+0000","last_became_active":"2024-04-17T05:26:53.233708+0000","last_became_peered":"2024-04-17T05:26:53.233708+0000","last_unstale":"2024-04-17T05:26:58.275315+0000","last_undegraded":"2024-04-17T05:26:58.275315+0000","last_fullsized":"2024-04-17T05:26:58.275315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:08:16.322998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313987+0000","last_change":"2024-04-17T05:26:53.234961+0000","last_active":"2024-04-17T05:26:59.313987+0000","last_peered":"2024-04-17T05:26:59.313987+0000","last_clean":"2024-04-17T05:26:59.313987+0000","last_became_active":"2024-04-17T05:26:53.234387+0000","last_became_peered":"2024-04-17T05:26:53.234387+0000","last_unstale":"2024-04-17T05:26:59.313987+0000","last_undegraded":"2024-04-17T05:26:59.313987+0000","last_fullsized":"2024-04-17T05:26:59.313987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:07:47.404346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274284+0000","last_change":"2024-04-17T05:26:53.242359+0000","last_active":"2024-04-17T05:26:58.274284+0000","last_peered":"2024-04-17T05:26:58.274284+0000","last_clean":"2024-04-17T05:26:58.274284+0000","last_became_active":"2024-04-17T05:26:53.236476+0000","last_became_peered":"2024-04-17T05:26:53.236476+0000","last_unstale":"2024-04-17T05:26:58.274284+0000","last_undegraded":"2024-04-17T05:26:58.274284+0000","last_fullsized":"2024-04-17T05:26:58.274284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:08:16.322998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314721+0000","last_change":"2024-04-17T05:26:53.231647+0000","last_active":"2024-04-17T05:26:59.314721+0000","last_peered":"2024-04-17T05:26:59.314721+0000","last_clean":"2024-04-17T05:26:59.314721+0000","last_became_active":"2024-04-17T05:26:53.231335+0000","last_became_peered":"2024-04-17T05:26:53.231335+0000","last_unstale":"2024-04-17T05:26:59.314721+0000","last_undegraded":"2024-04-17T05:26:59.314721+0000","last_fullsized":"2024-04-17T05:26:59.314721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:19:17.442103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316585+0000","last_change":"2024-04-17T05:26:53.234892+0000","last_active":"2024-04-17T05:26:59.316585+0000","last_peered":"2024-04-17T05:26:59.316585+0000","last_clean":"2024-04-17T05:26:59.316585+0000","last_became_active":"2024-04-17T05:26:53.234582+0000","last_became_peered":"2024-04-17T05:26:53.234582+0000","last_unstale":"2024-04-17T05:26:59.316585+0000","last_undegraded":"2024-04-17T05:26:59.316585+0000","last_fullsized":"2024-04-17T05:26:59.316585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:48:56.352270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274951+0000","last_change":"2024-04-17T05:26:53.245242+0000","last_active":"2024-04-17T05:26:58.274951+0000","last_peered":"2024-04-17T05:26:58.274951+0000","last_clean":"2024-04-17T05:26:58.274951+0000","last_became_active":"2024-04-17T05:26:53.244910+0000","last_became_peered":"2024-04-17T05:26:53.244910+0000","last_unstale":"2024-04-17T05:26:58.274951+0000","last_undegraded":"2024-04-17T05:26:58.274951+0000","last_fullsized":"2024-04-17T05:26:58.274951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:45:55.350158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.275241+0000","last_change":"2024-04-17T05:26:53.240582+0000","last_active":"2024-04-17T05:26:58.275241+0000","last_peered":"2024-04-17T05:26:58.275241+0000","last_clean":"2024-04-17T05:26:58.275241+0000","last_became_active":"2024-04-17T05:26:53.240184+0000","last_became_peered":"2024-04-17T05:26:53.240184+0000","last_unstale":"2024-04-17T05:26:58.275241+0000","last_undegraded":"2024-04-17T05:26:58.275241+0000","last_fullsized":"2024-04-17T05:26:58.275241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:32:25.337967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273189+0000","last_change":"2024-04-17T05:26:53.236750+0000","last_active":"2024-04-17T05:26:58.273189+0000","last_peered":"2024-04-17T05:26:58.273189+0000","last_clean":"2024-04-17T05:26:58.273189+0000","last_became_active":"2024-04-17T05:26:53.236386+0000","last_became_peered":"2024-04-17T05:26:53.236386+0000","last_unstale":"2024-04-17T05:26:58.273189+0000","last_undegraded":"2024-04-17T05:26:58.273189+0000","last_fullsized":"2024-04-17T05:26:58.273189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:19:17.442103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.275168+0000","last_change":"2024-04-17T05:26:53.242520+0000","last_active":"2024-04-17T05:26:58.275168+0000","last_peered":"2024-04-17T05:26:58.275168+0000","last_clean":"2024-04-17T05:26:58.275168+0000","last_became_active":"2024-04-17T05:26:53.242213+0000","last_became_peered":"2024-04-17T05:26:53.242213+0000","last_unstale":"2024-04-17T05:26:58.275168+0000","last_undegraded":"2024-04-17T05:26:58.275168+0000","last_fullsized":"2024-04-17T05:26:58.275168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:32.131344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313663+0000","last_change":"2024-04-17T05:26:53.230464+0000","last_active":"2024-04-17T05:26:59.313663+0000","last_peered":"2024-04-17T05:26:59.313663+0000","last_clean":"2024-04-17T05:26:59.313663+0000","last_became_active":"2024-04-17T05:26:53.230146+0000","last_became_peered":"2024-04-17T05:26:53.230146+0000","last_unstale":"2024-04-17T05:26:59.313663+0000","last_undegraded":"2024-04-17T05:26:59.313663+0000","last_fullsized":"2024-04-17T05:26:59.313663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:20:19.035658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315881+0000","last_change":"2024-04-17T05:26:53.252592+0000","last_active":"2024-04-17T05:26:59.315881+0000","last_peered":"2024-04-17T05:26:59.315881+0000","last_clean":"2024-04-17T05:26:59.315881+0000","last_became_active":"2024-04-17T05:26:53.252280+0000","last_became_peered":"2024-04-17T05:26:53.252280+0000","last_unstale":"2024-04-17T05:26:59.315881+0000","last_undegraded":"2024-04-17T05:26:59.315881+0000","last_fullsized":"2024-04-17T05:26:59.315881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:47:18.182576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317653+0000","last_change":"2024-04-17T05:26:53.242405+0000","last_active":"2024-04-17T05:26:59.317653+0000","last_peered":"2024-04-17T05:26:59.317653+0000","last_clean":"2024-04-17T05:26:59.317653+0000","last_became_active":"2024-04-17T05:26:53.242046+0000","last_became_peered":"2024-04-17T05:26:53.242046+0000","last_unstale":"2024-04-17T05:26:59.317653+0000","last_undegraded":"2024-04-17T05:26:59.317653+0000","last_fullsized":"2024-04-17T05:26:59.317653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:25:09.244149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317256+0000","last_change":"2024-04-17T05:26:53.228029+0000","last_active":"2024-04-17T05:26:59.317256+0000","last_peered":"2024-04-17T05:26:59.317256+0000","last_clean":"2024-04-17T05:26:59.317256+0000","last_became_active":"2024-04-17T05:26:53.227572+0000","last_became_peered":"2024-04-17T05:26:53.227572+0000","last_unstale":"2024-04-17T05:26:59.317256+0000","last_undegraded":"2024-04-17T05:26:59.317256+0000","last_fullsized":"2024-04-17T05:26:59.317256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:27.032116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.280108+0000","last_change":"2024-04-17T05:26:53.226283+0000","last_active":"2024-04-17T05:26:58.280108+0000","last_peered":"2024-04-17T05:26:58.280108+0000","last_clean":"2024-04-17T05:26:58.280108+0000","last_became_active":"2024-04-17T05:26:53.225983+0000","last_became_peered":"2024-04-17T05:26:53.225983+0000","last_unstale":"2024-04-17T05:26:58.280108+0000","last_undegraded":"2024-04-17T05:26:58.280108+0000","last_fullsized":"2024-04-17T05:26:58.280108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:40:51.044161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274421+0000","last_change":"2024-04-17T05:26:53.230256+0000","last_active":"2024-04-17T05:26:58.274421+0000","last_peered":"2024-04-17T05:26:58.274421+0000","last_clean":"2024-04-17T05:26:58.274421+0000","last_became_active":"2024-04-17T05:26:53.229888+0000","last_became_peered":"2024-04-17T05:26:53.229888+0000","last_unstale":"2024-04-17T05:26:58.274421+0000","last_undegraded":"2024-04-17T05:26:58.274421+0000","last_fullsized":"2024-04-17T05:26:58.274421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:45:55.350158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314103+0000","last_change":"2024-04-17T05:26:53.211199+0000","last_active":"2024-04-17T05:26:59.314103+0000","last_peered":"2024-04-17T05:26:59.314103+0000","last_clean":"2024-04-17T05:26:59.314103+0000","last_became_active":"2024-04-17T05:26:53.208394+0000","last_became_peered":"2024-04-17T05:26:53.208394+0000","last_unstale":"2024-04-17T05:26:59.314103+0000","last_undegraded":"2024-04-17T05:26:59.314103+0000","last_fullsized":"2024-04-17T05:26:59.314103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:20:19.035658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313253+0000","last_change":"2024-04-17T05:26:53.224930+0000","last_active":"2024-04-17T05:26:59.313253+0000","last_peered":"2024-04-17T05:26:59.313253+0000","last_clean":"2024-04-17T05:26:59.313253+0000","last_became_active":"2024-04-17T05:26:53.224314+0000","last_became_peered":"2024-04-17T05:26:53.224314+0000","last_unstale":"2024-04-17T05:26:59.313253+0000","last_undegraded":"2024-04-17T05:26:59.313253+0000","last_fullsized":"2024-04-17T05:26:59.313253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:00:05.875990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273858+0000","last_change":"2024-04-17T05:26:53.234152+0000","last_active":"2024-04-17T05:26:58.273858+0000","last_peered":"2024-04-17T05:26:58.273858+0000","last_clean":"2024-04-17T05:26:58.273858+0000","last_became_active":"2024-04-17T05:26:53.233885+0000","last_became_peered":"2024-04-17T05:26:53.233885+0000","last_unstale":"2024-04-17T05:26:58.273858+0000","last_undegraded":"2024-04-17T05:26:58.273858+0000","last_fullsized":"2024-04-17T05:26:58.273858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:20:19.035658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.277926+0000","last_change":"2024-04-17T05:26:53.233213+0000","last_active":"2024-04-17T05:26:58.277926+0000","last_peered":"2024-04-17T05:26:58.277926+0000","last_clean":"2024-04-17T05:26:58.277926+0000","last_became_active":"2024-04-17T05:26:53.232809+0000","last_became_peered":"2024-04-17T05:26:53.232809+0000","last_unstale":"2024-04-17T05:26:58.277926+0000","last_undegraded":"2024-04-17T05:26:58.277926+0000","last_fullsized":"2024-04-17T05:26:58.277926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:44.057838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316496+0000","last_change":"2024-04-17T05:26:53.245453+0000","last_active":"2024-04-17T05:26:59.316496+0000","last_peered":"2024-04-17T05:26:59.316496+0000","last_clean":"2024-04-17T05:26:59.316496+0000","last_became_active":"2024-04-17T05:26:53.245051+0000","last_became_peered":"2024-04-17T05:26:53.245051+0000","last_unstale":"2024-04-17T05:26:59.316496+0000","last_undegraded":"2024-04-17T05:26:59.316496+0000","last_fullsized":"2024-04-17T05:26:59.316496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:44:40.424363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316508+0000","last_change":"2024-04-17T05:26:53.241934+0000","last_active":"2024-04-17T05:26:59.316508+0000","last_peered":"2024-04-17T05:26:59.316508+0000","last_clean":"2024-04-17T05:26:59.316508+0000","last_became_active":"2024-04-17T05:26:53.241108+0000","last_became_peered":"2024-04-17T05:26:53.241108+0000","last_unstale":"2024-04-17T05:26:59.316508+0000","last_undegraded":"2024-04-17T05:26:59.316508+0000","last_fullsized":"2024-04-17T05:26:59.316508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:53:43.076144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.318239+0000","last_change":"2024-04-17T05:26:53.248438+0000","last_active":"2024-04-17T05:26:59.318239+0000","last_peered":"2024-04-17T05:26:59.318239+0000","last_clean":"2024-04-17T05:26:59.318239+0000","last_became_active":"2024-04-17T05:26:53.247746+0000","last_became_peered":"2024-04-17T05:26:53.247746+0000","last_unstale":"2024-04-17T05:26:59.318239+0000","last_undegraded":"2024-04-17T05:26:59.318239+0000","last_fullsized":"2024-04-17T05:26:59.318239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:28:32.265291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.272812+0000","last_change":"2024-04-17T05:26:53.244109+0000","last_active":"2024-04-17T05:26:58.272812+0000","last_peered":"2024-04-17T05:26:58.272812+0000","last_clean":"2024-04-17T05:26:58.272812+0000","last_became_active":"2024-04-17T05:26:53.243625+0000","last_became_peered":"2024-04-17T05:26:53.243625+0000","last_unstale":"2024-04-17T05:26:58.272812+0000","last_undegraded":"2024-04-17T05:26:58.272812+0000","last_fullsized":"2024-04-17T05:26:58.272812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:07:47.404346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317613+0000","last_change":"2024-04-17T05:26:53.246489+0000","last_active":"2024-04-17T05:26:59.317613+0000","last_peered":"2024-04-17T05:26:59.317613+0000","last_clean":"2024-04-17T05:26:59.317613+0000","last_became_active":"2024-04-17T05:26:53.246286+0000","last_became_peered":"2024-04-17T05:26:53.246286+0000","last_unstale":"2024-04-17T05:26:59.317613+0000","last_undegraded":"2024-04-17T05:26:59.317613+0000","last_fullsized":"2024-04-17T05:26:59.317613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:45.658070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274944+0000","last_change":"2024-04-17T05:26:53.229115+0000","last_active":"2024-04-17T05:26:58.274944+0000","last_peered":"2024-04-17T05:26:58.274944+0000","last_clean":"2024-04-17T05:26:58.274944+0000","last_became_active":"2024-04-17T05:26:53.228706+0000","last_became_peered":"2024-04-17T05:26:53.228706+0000","last_unstale":"2024-04-17T05:26:58.274944+0000","last_undegraded":"2024-04-17T05:26:58.274944+0000","last_fullsized":"2024-04-17T05:26:58.274944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:19:17.442103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317096+0000","last_change":"2024-04-17T05:26:53.244961+0000","last_active":"2024-04-17T05:26:59.317096+0000","last_peered":"2024-04-17T05:26:59.317096+0000","last_clean":"2024-04-17T05:26:59.317096+0000","last_became_active":"2024-04-17T05:26:53.244595+0000","last_became_peered":"2024-04-17T05:26:53.244595+0000","last_unstale":"2024-04-17T05:26:59.317096+0000","last_undegraded":"2024-04-17T05:26:59.317096+0000","last_fullsized":"2024-04-17T05:26:59.317096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:13:34.455173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276173+0000","last_change":"2024-04-17T05:26:53.241645+0000","last_active":"2024-04-17T05:26:58.276173+0000","last_peered":"2024-04-17T05:26:58.276173+0000","last_clean":"2024-04-17T05:26:58.276173+0000","last_became_active":"2024-04-17T05:26:53.241292+0000","last_became_peered":"2024-04-17T05:26:53.241292+0000","last_unstale":"2024-04-17T05:26:58.276173+0000","last_undegraded":"2024-04-17T05:26:58.276173+0000","last_fullsized":"2024-04-17T05:26:58.276173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:31:26.820940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315030+0000","last_change":"2024-04-17T05:26:53.221256+0000","last_active":"2024-04-17T05:26:59.315030+0000","last_peered":"2024-04-17T05:26:59.315030+0000","last_clean":"2024-04-17T05:26:59.315030+0000","last_became_active":"2024-04-17T05:26:53.220445+0000","last_became_peered":"2024-04-17T05:26:53.220445+0000","last_unstale":"2024-04-17T05:26:59.315030+0000","last_undegraded":"2024-04-17T05:26:59.315030+0000","last_fullsized":"2024-04-17T05:26:59.315030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:08:41.870139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315578+0000","last_change":"2024-04-17T05:26:53.214897+0000","last_active":"2024-04-17T05:26:59.315578+0000","last_peered":"2024-04-17T05:26:59.315578+0000","last_clean":"2024-04-17T05:26:59.315578+0000","last_became_active":"2024-04-17T05:26:53.214591+0000","last_became_peered":"2024-04-17T05:26:53.214591+0000","last_unstale":"2024-04-17T05:26:59.315578+0000","last_undegraded":"2024-04-17T05:26:59.315578+0000","last_fullsized":"2024-04-17T05:26:59.315578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:32.131344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315663+0000","last_change":"2024-04-17T05:26:53.248726+0000","last_active":"2024-04-17T05:26:59.315663+0000","last_peered":"2024-04-17T05:26:59.315663+0000","last_clean":"2024-04-17T05:26:59.315663+0000","last_became_active":"2024-04-17T05:26:53.248143+0000","last_became_peered":"2024-04-17T05:26:53.248143+0000","last_unstale":"2024-04-17T05:26:59.315663+0000","last_undegraded":"2024-04-17T05:26:59.315663+0000","last_fullsized":"2024-04-17T05:26:59.315663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:02:51.306764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":699106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":111998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":108246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":108282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":111998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":108156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":108316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":880640,"data_stored":699162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T05:27:20.836 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T05:27:21.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.089+0000 7f129ee00640 1 Processor -- start 2024-04-17T05:27:21.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.089+0000 7f129ee00640 1 -- start start 2024-04-17T05:27:21.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.090+0000 7f129ee00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f129809d630 0x7f129809da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:21.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.090+0000 7f129ee00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f12981492e0 0x7f1298149740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:21.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.090+0000 7f129ee00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f129809cc30 con 0x7f129806d060 2024-04-17T05:27:21.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.090+0000 7f129ee00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f129809bcf0 con 0x7f129809d630 2024-04-17T05:27:21.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.091+0000 7f129ee00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f129809cea0 con 0x7f12981492e0 2024-04-17T05:27:21.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.091+0000 7f129ce00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f129806d060 0x7f129806d4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54890/0 (socket says 172.21.15.123:54890) 2024-04-17T05:27:21.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.091+0000 7f129ce00640 1 -- 172.21.15.123:0/4224221744 learned_addr learned my addr 172.21.15.123:0/4224221744 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:27:21.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.091+0000 7f1297400640 1 --2- 172.21.15.123:0/4224221744 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f12981492e0 0x7f1298149740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:21.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.091+0000 7f1297e00640 1 --2- 172.21.15.123:0/4224221744 >> v2:172.21.15.164:3300/0 conn(0x7f129809d630 0x7f129809da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:21.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.091+0000 7f1296a00640 1 -- 172.21.15.123:0/4224221744 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1811445702 0 0) 0x7f129809cc30 con 0x7f129806d060 2024-04-17T05:27:21.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.091+0000 7f1296a00640 1 -- 172.21.15.123:0/4224221744 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f127c003520 con 0x7f129806d060 2024-04-17T05:27:21.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.092+0000 7f1296a00640 1 -- 172.21.15.123:0/4224221744 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4124405086 0 0) 0x7f127c003520 con 0x7f129806d060 2024-04-17T05:27:21.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.092+0000 7f1296a00640 1 -- 172.21.15.123:0/4224221744 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f12981492e0 msgr2=0x7f1298149740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:21.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.092+0000 7f1296a00640 1 --2- 172.21.15.123:0/4224221744 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f12981492e0 0x7f1298149740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:21.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.092+0000 7f1296a00640 1 -- 172.21.15.123:0/4224221744 >> v2:172.21.15.164:3300/0 conn(0x7f129809d630 msgr2=0x7f129809da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:21.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.092+0000 7f1296a00640 1 --2- 172.21.15.123:0/4224221744 >> v2:172.21.15.164:3300/0 conn(0x7f129809d630 0x7f129809da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:21.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.092+0000 7f1296a00640 1 -- 172.21.15.123:0/4224221744 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1298149c80 con 0x7f129806d060 2024-04-17T05:27:21.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.092+0000 7f1296a00640 1 -- 172.21.15.123:0/4224221744 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1042962670 0 0) 0x7f12900019f0 con 0x7f129806d060 2024-04-17T05:27:21.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.092+0000 7f1296a00640 1 -- 172.21.15.123:0/4224221744 >> v1:172.21.15.123:6789/0 conn(0x7f129806d060 legacy=0x7f129806d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:21.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.092+0000 7f1296a00640 1 --2- 172.21.15.123:0/4224221744 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f127c0039b0 0x7f127c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:21.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.092+0000 7f1296a00640 1 --2- 172.21.15.123:0/4224221744 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f127c004800 0x7f127c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:21.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.092+0000 7f1296a00640 1 --2- 172.21.15.123:0/4224221744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f127c0051c0 0x7f127c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:21.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.092+0000 7f1296a00640 1 -- 172.21.15.123:0/4224221744 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f129809bcf0 con 0x7f127c0051c0 2024-04-17T05:27:21.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.092+0000 7f1296a00640 1 -- 172.21.15.123:0/4224221744 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f129809cea0 con 0x7f127c0039b0 2024-04-17T05:27:21.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.092+0000 7f1296a00640 1 -- 172.21.15.123:0/4224221744 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f127c00bf50 con 0x7f127c004800 2024-04-17T05:27:21.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.092+0000 7f129ce00640 1 --2- 172.21.15.123:0/4224221744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f127c0051c0 0x7f127c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:21.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.092+0000 7f1297e00640 1 --2- 172.21.15.123:0/4224221744 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f127c0039b0 0x7f127c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:21.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.092+0000 7f1297400640 1 --2- 172.21.15.123:0/4224221744 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f127c004800 0x7f127c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:21.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.093+0000 7f129ce00640 1 -- 172.21.15.123:0/4224221744 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f127c004800 msgr2=0x7f127c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:21.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.093+0000 7f129ce00640 1 --2- 172.21.15.123:0/4224221744 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f127c004800 0x7f127c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:21.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.093+0000 7f129ce00640 1 -- 172.21.15.123:0/4224221744 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f127c0039b0 msgr2=0x7f127c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:21.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.093+0000 7f129ce00640 1 --2- 172.21.15.123:0/4224221744 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f127c0039b0 0x7f127c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:21.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.093+0000 7f129ce00640 1 -- 172.21.15.123:0/4224221744 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f127c003520 con 0x7f127c0051c0 2024-04-17T05:27:21.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.093+0000 7f1297400640 1 --2- 172.21.15.123:0/4224221744 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f127c004800 0x7f127c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:21.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.094+0000 7f129ce00640 1 --2- 172.21.15.123:0/4224221744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f127c0051c0 0x7f127c00b9c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f129000a8b0 tx=0x7f127c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1c1cd572e1c3762 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:21.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.094+0000 7f1296a00640 1 -- 172.21.15.123:0/4224221744 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129000a4a0 con 0x7f127c0051c0 2024-04-17T05:27:21.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.094+0000 7f1296a00640 1 -- 172.21.15.123:0/4224221744 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1290034650 con 0x7f127c0051c0 2024-04-17T05:27:21.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.094+0000 7f1296a00640 1 -- 172.21.15.123:0/4224221744 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1290034a40 con 0x7f127c0051c0 2024-04-17T05:27:21.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.095+0000 7f129ee00640 1 -- 172.21.15.123:0/4224221744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f127c0051c0 msgr2=0x7f127c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:21.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.095+0000 7f129ee00640 1 --2- 172.21.15.123:0/4224221744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f127c0051c0 0x7f127c00b9c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f129000a8b0 tx=0x7f127c005830 comp rx=0 tx=0).stop 2024-04-17T05:27:21.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.095+0000 7f129ce00640 1 -- 172.21.15.123:0/4224221744 reap_dead start 2024-04-17T05:27:21.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.095+0000 7f129ee00640 1 -- 172.21.15.123:0/4224221744 shutdown_connections 2024-04-17T05:27:21.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.095+0000 7f129ee00640 1 -- 172.21.15.123:0/4224221744 >> 172.21.15.123:0/4224221744 conn(0x7f12980b93b0 msgr2=0x7f12980b97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:21.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.095+0000 7f129ee00640 1 -- 172.21.15.123:0/4224221744 shutdown_connections 2024-04-17T05:27:21.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.095+0000 7f129ee00640 1 -- 172.21.15.123:0/4224221744 wait complete. 2024-04-17T05:27:21.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.096+0000 7f129ee00640 1 Processor -- start 2024-04-17T05:27:21.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.097+0000 7f129ee00640 1 -- start start 2024-04-17T05:27:21.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.097+0000 7f129ee00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f127c0051c0 0x7f1298144360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:21.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.097+0000 7f129ee00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f12981ddd90 0x7f12981de210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:21.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.097+0000 7f129ee00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1298141100 0x7f1298141580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:21.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.097+0000 7f129ee00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f129809b980 con 0x7f127c0051c0 2024-04-17T05:27:21.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.097+0000 7f129ee00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f129809b6a0 con 0x7f1298141100 2024-04-17T05:27:21.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.097+0000 7f129ee00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f12980b5b10 con 0x7f12981ddd90 2024-04-17T05:27:21.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.098+0000 7f1297e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f127c0051c0 0x7f1298144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:21.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.098+0000 7f1297e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f127c0051c0 0x7f1298144360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38040/0 (socket says 172.21.15.123:38040) 2024-04-17T05:27:21.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.098+0000 7f1297e00640 1 -- 172.21.15.123:0/3455618830 learned_addr learned my addr 172.21.15.123:0/3455618830 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:21.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.098+0000 7f1297e00640 1 -- 172.21.15.123:0/3455618830 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f12981ddd90 msgr2=0x7f12981de210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:21.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.098+0000 7f1297e00640 1 --2- 172.21.15.123:0/3455618830 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f12981ddd90 0x7f12981de210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:21.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.098+0000 7f129ce00640 1 --2- 172.21.15.123:0/3455618830 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1298141100 0x7f1298141580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:21.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.098+0000 7f1297e00640 1 -- 172.21.15.123:0/3455618830 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1298141100 msgr2=0x7f1298141580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:21.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.098+0000 7f1297e00640 1 --2- 172.21.15.123:0/3455618830 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1298141100 0x7f1298141580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:21.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.098+0000 7f1297e00640 1 -- 172.21.15.123:0/3455618830 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1298142ef0 con 0x7f127c0051c0 2024-04-17T05:27:21.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.098+0000 7f1297e00640 1 --2- 172.21.15.123:0/3455618830 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f127c0051c0 0x7f1298144360 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1288011600 tx=0x7f1288011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:21.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.099+0000 7f128fe00640 1 -- 172.21.15.123:0/3455618830 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f128800f920 con 0x7f127c0051c0 2024-04-17T05:27:21.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.099+0000 7f128fe00640 1 -- 172.21.15.123:0/3455618830 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f128800fac0 con 0x7f127c0051c0 2024-04-17T05:27:21.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.099+0000 7f129ee00640 1 -- 172.21.15.123:0/3455618830 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12981de750 con 0x7f127c0051c0 2024-04-17T05:27:21.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.099+0000 7f128fe00640 1 -- 172.21.15.123:0/3455618830 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f128800fe70 con 0x7f127c0051c0 2024-04-17T05:27:21.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.099+0000 7f129ee00640 1 -- 172.21.15.123:0/3455618830 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12980707d0 con 0x7f127c0051c0 2024-04-17T05:27:21.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.100+0000 7f129ee00640 1 -- 172.21.15.123:0/3455618830 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1298068a40 con 0x7f127c0051c0 2024-04-17T05:27:21.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.101+0000 7f128fe00640 1 -- 172.21.15.123:0/3455618830 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1288015460 con 0x7f127c0051c0 2024-04-17T05:27:21.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.102+0000 7f128fe00640 1 --2- 172.21.15.123:0/3455618830 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f127806c920 0x7f127806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:21.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.102+0000 7f128fe00640 1 -- 172.21.15.123:0/3455618830 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f128808c7c0 con 0x7f127c0051c0 2024-04-17T05:27:21.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.102+0000 7f1297400640 1 --2- 172.21.15.123:0/3455618830 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f127806c920 0x7f127806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:21.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.104+0000 7f1297400640 1 --2- 172.21.15.123:0/3455618830 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f127806c920 0x7f127806ede0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1298143eb0 tx=0x7f1284008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:21.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.106+0000 7f128fe00640 1 -- 172.21.15.123:0/3455618830 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f12981de750 con 0x7f127c0051c0 2024-04-17T05:27:21.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.308+0000 7f129ee00640 1 -- 172.21.15.123:0/3455618830 --> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f129809e3c0 con 0x7f127806c920 2024-04-17T05:27:21.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.334+0000 7f128fe00640 1 -- 172.21.15.123:0/3455618830 <== mgr.4103 v2:172.21.15.164:6832/4204006015 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332573 (secure 0 0 0) 0x7f129809e3c0 con 0x7f127806c920 2024-04-17T05:27:21.337 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:27:21.339 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-04-17T05:27:21.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.340+0000 7f129ee00640 1 -- 172.21.15.123:0/3455618830 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f127806c920 msgr2=0x7f127806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:21.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.340+0000 7f129ee00640 1 --2- 172.21.15.123:0/3455618830 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f127806c920 0x7f127806ede0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1298143eb0 tx=0x7f1284008040 comp rx=0 tx=0).stop 2024-04-17T05:27:21.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.340+0000 7f129ee00640 1 -- 172.21.15.123:0/3455618830 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f127c0051c0 msgr2=0x7f1298144360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:21.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.340+0000 7f129ee00640 1 --2- 172.21.15.123:0/3455618830 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f127c0051c0 0x7f1298144360 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1288011600 tx=0x7f1288011ac0 comp rx=0 tx=0).stop 2024-04-17T05:27:21.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.340+0000 7f129ee00640 1 -- 172.21.15.123:0/3455618830 shutdown_connections 2024-04-17T05:27:21.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.340+0000 7f129ee00640 1 --2- 172.21.15.123:0/3455618830 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1298141100 0x7f1298141580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:21.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.340+0000 7f129ee00640 1 --2- 172.21.15.123:0/3455618830 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f127806c920 0x7f127806ede0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:21.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.340+0000 7f129ee00640 1 --2- 172.21.15.123:0/3455618830 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f12981ddd90 0x7f12981de210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:21.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.340+0000 7f129ee00640 1 --2- 172.21.15.123:0/3455618830 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f127c0051c0 0x7f1298144360 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:21.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.340+0000 7f129ee00640 1 -- 172.21.15.123:0/3455618830 >> 172.21.15.123:0/3455618830 conn(0x7f12980b93b0 msgr2=0x7f12980b4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:21.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.340+0000 7f129ee00640 1 -- 172.21.15.123:0/3455618830 shutdown_connections 2024-04-17T05:27:21.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.341+0000 7f129ee00640 1 -- 172.21.15.123:0/3455618830 wait complete. 2024-04-17T05:27:21.362 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-04-17T05:27:20.307478+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219524,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755196,"statfs":{"total":773094113280,"available":772869320704,"internally_reserved":0,"allocated":3448832,"data_stored":2055264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005009"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314325+0000","last_change":"2024-04-17T05:26:52.205802+0000","last_active":"2024-04-17T05:26:59.314325+0000","last_peered":"2024-04-17T05:26:59.314325+0000","last_clean":"2024-04-17T05:26:59.314325+0000","last_became_active":"2024-04-17T05:26:52.205459+0000","last_became_peered":"2024-04-17T05:26:52.205459+0000","last_unstale":"2024-04-17T05:26:59.314325+0000","last_undegraded":"2024-04-17T05:26:59.314325+0000","last_fullsized":"2024-04-17T05:26:59.314325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:12:06.528342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274704+0000","last_change":"2024-04-17T05:26:53.231441+0000","last_active":"2024-04-17T05:26:58.274704+0000","last_peered":"2024-04-17T05:26:58.274704+0000","last_clean":"2024-04-17T05:26:58.274704+0000","last_became_active":"2024-04-17T05:26:53.231139+0000","last_became_peered":"2024-04-17T05:26:53.231139+0000","last_unstale":"2024-04-17T05:26:58.274704+0000","last_undegraded":"2024-04-17T05:26:58.274704+0000","last_fullsized":"2024-04-17T05:26:58.274704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:38:13.010763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273065+0000","last_change":"2024-04-17T05:26:57.347742+0000","last_active":"2024-04-17T05:26:58.273065+0000","last_peered":"2024-04-17T05:26:58.273065+0000","last_clean":"2024-04-17T05:26:58.273065+0000","last_became_active":"2024-04-17T05:26:57.347333+0000","last_became_peered":"2024-04-17T05:26:57.347333+0000","last_unstale":"2024-04-17T05:26:58.273065+0000","last_undegraded":"2024-04-17T05:26:58.273065+0000","last_fullsized":"2024-04-17T05:26:58.273065+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:23:44.724644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274845+0000","last_change":"2024-04-17T05:26:52.203448+0000","last_active":"2024-04-17T05:26:58.274845+0000","last_peered":"2024-04-17T05:26:58.274845+0000","last_clean":"2024-04-17T05:26:58.274845+0000","last_became_active":"2024-04-17T05:26:52.203161+0000","last_became_peered":"2024-04-17T05:26:52.203161+0000","last_unstale":"2024-04-17T05:26:58.274845+0000","last_undegraded":"2024-04-17T05:26:58.274845+0000","last_fullsized":"2024-04-17T05:26:58.274845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:11:26.292397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313463+0000","last_change":"2024-04-17T05:26:53.241735+0000","last_active":"2024-04-17T05:26:59.313463+0000","last_peered":"2024-04-17T05:26:59.313463+0000","last_clean":"2024-04-17T05:26:59.313463+0000","last_became_active":"2024-04-17T05:26:53.241460+0000","last_became_peered":"2024-04-17T05:26:53.241460+0000","last_unstale":"2024-04-17T05:26:59.313463+0000","last_undegraded":"2024-04-17T05:26:59.313463+0000","last_fullsized":"2024-04-17T05:26:59.313463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:32.131344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.275682+0000","last_change":"2024-04-17T05:26:57.310052+0000","last_active":"2024-04-17T05:26:58.275682+0000","last_peered":"2024-04-17T05:26:58.275682+0000","last_clean":"2024-04-17T05:26:58.275682+0000","last_became_active":"2024-04-17T05:26:57.309057+0000","last_became_peered":"2024-04-17T05:26:57.309057+0000","last_unstale":"2024-04-17T05:26:58.275682+0000","last_undegraded":"2024-04-17T05:26:58.275682+0000","last_fullsized":"2024-04-17T05:26:58.275682+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:32:29.420749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317337+0000","last_change":"2024-04-17T05:26:52.217413+0000","last_active":"2024-04-17T05:26:59.317337+0000","last_peered":"2024-04-17T05:26:59.317337+0000","last_clean":"2024-04-17T05:26:59.317337+0000","last_became_active":"2024-04-17T05:26:52.217101+0000","last_became_peered":"2024-04-17T05:26:52.217101+0000","last_unstale":"2024-04-17T05:26:59.317337+0000","last_undegraded":"2024-04-17T05:26:59.317337+0000","last_fullsized":"2024-04-17T05:26:59.317337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:39:51.930934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276312+0000","last_change":"2024-04-17T05:26:53.219012+0000","last_active":"2024-04-17T05:26:58.276312+0000","last_peered":"2024-04-17T05:26:58.276312+0000","last_clean":"2024-04-17T05:26:58.276312+0000","last_became_active":"2024-04-17T05:26:53.216591+0000","last_became_peered":"2024-04-17T05:26:53.216591+0000","last_unstale":"2024-04-17T05:26:58.276312+0000","last_undegraded":"2024-04-17T05:26:58.276312+0000","last_fullsized":"2024-04-17T05:26:58.276312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:02:12.833146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276701+0000","last_change":"2024-04-17T05:26:57.310537+0000","last_active":"2024-04-17T05:26:58.276701+0000","last_peered":"2024-04-17T05:26:58.276701+0000","last_clean":"2024-04-17T05:26:58.276701+0000","last_became_active":"2024-04-17T05:26:57.309381+0000","last_became_peered":"2024-04-17T05:26:57.309381+0000","last_unstale":"2024-04-17T05:26:58.276701+0000","last_undegraded":"2024-04-17T05:26:58.276701+0000","last_fullsized":"2024-04-17T05:26:58.276701+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:38:17.093545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317625+0000","last_change":"2024-04-17T05:26:52.218309+0000","last_active":"2024-04-17T05:26:59.317625+0000","last_peered":"2024-04-17T05:26:59.317625+0000","last_clean":"2024-04-17T05:26:59.317625+0000","last_became_active":"2024-04-17T05:26:52.217898+0000","last_became_peered":"2024-04-17T05:26:52.217898+0000","last_unstale":"2024-04-17T05:26:59.317625+0000","last_undegraded":"2024-04-17T05:26:59.317625+0000","last_fullsized":"2024-04-17T05:26:59.317625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:16:02.152039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276476+0000","last_change":"2024-04-17T05:26:53.232546+0000","last_active":"2024-04-17T05:26:58.276476+0000","last_peered":"2024-04-17T05:26:58.276476+0000","last_clean":"2024-04-17T05:26:58.276476+0000","last_became_active":"2024-04-17T05:26:53.232239+0000","last_became_peered":"2024-04-17T05:26:53.232239+0000","last_unstale":"2024-04-17T05:26:58.276476+0000","last_undegraded":"2024-04-17T05:26:58.276476+0000","last_fullsized":"2024-04-17T05:26:58.276476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:38:13.010763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276356+0000","last_change":"2024-04-17T05:26:57.297256+0000","last_active":"2024-04-17T05:26:58.276356+0000","last_peered":"2024-04-17T05:26:58.276356+0000","last_clean":"2024-04-17T05:26:58.276356+0000","last_became_active":"2024-04-17T05:26:57.296757+0000","last_became_peered":"2024-04-17T05:26:57.296757+0000","last_unstale":"2024-04-17T05:26:58.276356+0000","last_undegraded":"2024-04-17T05:26:58.276356+0000","last_fullsized":"2024-04-17T05:26:58.276356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:45:59.432940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315091+0000","last_change":"2024-04-17T05:26:53.244539+0000","last_active":"2024-04-17T05:26:59.315091+0000","last_peered":"2024-04-17T05:26:59.315091+0000","last_clean":"2024-04-17T05:26:59.315091+0000","last_became_active":"2024-04-17T05:26:53.244104+0000","last_became_peered":"2024-04-17T05:26:53.244104+0000","last_unstale":"2024-04-17T05:26:59.315091+0000","last_undegraded":"2024-04-17T05:26:59.315091+0000","last_fullsized":"2024-04-17T05:26:59.315091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:41:48.514881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317859+0000","last_change":"2024-04-17T05:26:52.214434+0000","last_active":"2024-04-17T05:26:59.317859+0000","last_peered":"2024-04-17T05:26:59.317859+0000","last_clean":"2024-04-17T05:26:59.317859+0000","last_became_active":"2024-04-17T05:26:52.214158+0000","last_became_peered":"2024-04-17T05:26:52.214158+0000","last_unstale":"2024-04-17T05:26:59.317859+0000","last_undegraded":"2024-04-17T05:26:59.317859+0000","last_fullsized":"2024-04-17T05:26:59.317859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:36:56.201576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.278955+0000","last_change":"2024-04-17T05:26:57.307151+0000","last_active":"2024-04-17T05:26:58.278955+0000","last_peered":"2024-04-17T05:26:58.278955+0000","last_clean":"2024-04-17T05:26:58.278955+0000","last_became_active":"2024-04-17T05:26:57.305676+0000","last_became_peered":"2024-04-17T05:26:57.305676+0000","last_unstale":"2024-04-17T05:26:58.278955+0000","last_undegraded":"2024-04-17T05:26:58.278955+0000","last_fullsized":"2024-04-17T05:26:58.278955+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:40:55.126943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273944+0000","last_change":"2024-04-17T05:26:53.230514+0000","last_active":"2024-04-17T05:26:58.273944+0000","last_peered":"2024-04-17T05:26:58.273944+0000","last_clean":"2024-04-17T05:26:58.273944+0000","last_became_active":"2024-04-17T05:26:53.230175+0000","last_became_peered":"2024-04-17T05:26:53.230175+0000","last_unstale":"2024-04-17T05:26:58.273944+0000","last_undegraded":"2024-04-17T05:26:58.273944+0000","last_fullsized":"2024-04-17T05:26:58.273944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:32.131344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315033+0000","last_change":"2024-04-17T05:26:52.207664+0000","last_active":"2024-04-17T05:26:59.315033+0000","last_peered":"2024-04-17T05:26:59.315033+0000","last_clean":"2024-04-17T05:26:59.315033+0000","last_became_active":"2024-04-17T05:26:52.207343+0000","last_became_peered":"2024-04-17T05:26:52.207343+0000","last_unstale":"2024-04-17T05:26:59.315033+0000","last_undegraded":"2024-04-17T05:26:59.315033+0000","last_fullsized":"2024-04-17T05:26:59.315033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:05:28.743450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.277704+0000","last_change":"2024-04-17T05:26:57.311205+0000","last_active":"2024-04-17T05:26:58.277704+0000","last_peered":"2024-04-17T05:26:58.277704+0000","last_clean":"2024-04-17T05:26:58.277704+0000","last_became_active":"2024-04-17T05:26:57.310038+0000","last_became_peered":"2024-04-17T05:26:57.310038+0000","last_unstale":"2024-04-17T05:26:58.277704+0000","last_undegraded":"2024-04-17T05:26:58.277704+0000","last_fullsized":"2024-04-17T05:26:58.277704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:02:16.915928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273375+0000","last_change":"2024-04-17T05:26:53.229416+0000","last_active":"2024-04-17T05:26:58.273375+0000","last_peered":"2024-04-17T05:26:58.273375+0000","last_clean":"2024-04-17T05:26:58.273375+0000","last_became_active":"2024-04-17T05:26:53.227324+0000","last_became_peered":"2024-04-17T05:26:53.227324+0000","last_unstale":"2024-04-17T05:26:58.273375+0000","last_undegraded":"2024-04-17T05:26:58.273375+0000","last_fullsized":"2024-04-17T05:26:58.273375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:08:41.870139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314210+0000","last_change":"2024-04-17T05:26:52.207557+0000","last_active":"2024-04-17T05:26:59.314210+0000","last_peered":"2024-04-17T05:26:59.314210+0000","last_clean":"2024-04-17T05:26:59.314210+0000","last_became_active":"2024-04-17T05:26:52.207019+0000","last_became_peered":"2024-04-17T05:26:52.207019+0000","last_unstale":"2024-04-17T05:26:59.314210+0000","last_undegraded":"2024-04-17T05:26:59.314210+0000","last_fullsized":"2024-04-17T05:26:59.314210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:43.039139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316495+0000","last_change":"2024-04-17T05:26:57.345734+0000","last_active":"2024-04-17T05:26:59.316495+0000","last_peered":"2024-04-17T05:26:59.316495+0000","last_clean":"2024-04-17T05:26:59.316495+0000","last_became_active":"2024-04-17T05:26:57.345300+0000","last_became_peered":"2024-04-17T05:26:57.345300+0000","last_unstale":"2024-04-17T05:26:59.316495+0000","last_undegraded":"2024-04-17T05:26:59.316495+0000","last_fullsized":"2024-04-17T05:26:59.316495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:45:07.123915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276660+0000","last_change":"2024-04-17T05:26:53.218687+0000","last_active":"2024-04-17T05:26:58.276660+0000","last_peered":"2024-04-17T05:26:58.276660+0000","last_clean":"2024-04-17T05:26:58.276660+0000","last_became_active":"2024-04-17T05:26:53.218355+0000","last_became_peered":"2024-04-17T05:26:53.218355+0000","last_unstale":"2024-04-17T05:26:58.276660+0000","last_undegraded":"2024-04-17T05:26:58.276660+0000","last_fullsized":"2024-04-17T05:26:58.276660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:05:29.762149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316846+0000","last_change":"2024-04-17T05:26:52.214868+0000","last_active":"2024-04-17T05:26:59.316846+0000","last_peered":"2024-04-17T05:26:59.316846+0000","last_clean":"2024-04-17T05:26:59.316846+0000","last_became_active":"2024-04-17T05:26:52.214633+0000","last_became_peered":"2024-04-17T05:26:52.214633+0000","last_unstale":"2024-04-17T05:26:59.316846+0000","last_undegraded":"2024-04-17T05:26:59.316846+0000","last_fullsized":"2024-04-17T05:26:59.316846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:10:33.072665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276550+0000","last_change":"2024-04-17T05:26:57.309644+0000","last_active":"2024-04-17T05:26:58.276550+0000","last_peered":"2024-04-17T05:26:58.276550+0000","last_clean":"2024-04-17T05:26:58.276550+0000","last_became_active":"2024-04-17T05:26:57.309175+0000","last_became_peered":"2024-04-17T05:26:57.309175+0000","last_unstale":"2024-04-17T05:26:58.276550+0000","last_undegraded":"2024-04-17T05:26:58.276550+0000","last_fullsized":"2024-04-17T05:26:58.276550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:31:30.903722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314210+0000","last_change":"2024-04-17T05:26:53.220368+0000","last_active":"2024-04-17T05:26:59.314210+0000","last_peered":"2024-04-17T05:26:59.314210+0000","last_clean":"2024-04-17T05:26:59.314210+0000","last_became_active":"2024-04-17T05:26:53.220068+0000","last_became_peered":"2024-04-17T05:26:53.220068+0000","last_unstale":"2024-04-17T05:26:59.314210+0000","last_undegraded":"2024-04-17T05:26:59.314210+0000","last_fullsized":"2024-04-17T05:26:59.314210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:04:57.213834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316683+0000","last_change":"2024-04-17T05:26:52.215954+0000","last_active":"2024-04-17T05:26:59.316683+0000","last_peered":"2024-04-17T05:26:59.316683+0000","last_clean":"2024-04-17T05:26:59.316683+0000","last_became_active":"2024-04-17T05:26:52.215637+0000","last_became_peered":"2024-04-17T05:26:52.215637+0000","last_unstale":"2024-04-17T05:26:59.316683+0000","last_undegraded":"2024-04-17T05:26:59.316683+0000","last_fullsized":"2024-04-17T05:26:59.316683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:05:12.780620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276029+0000","last_change":"2024-04-17T05:26:57.342654+0000","last_active":"2024-04-17T05:26:58.276029+0000","last_peered":"2024-04-17T05:26:58.276029+0000","last_clean":"2024-04-17T05:26:58.276029+0000","last_became_active":"2024-04-17T05:26:57.342205+0000","last_became_peered":"2024-04-17T05:26:57.342205+0000","last_unstale":"2024-04-17T05:26:58.276029+0000","last_undegraded":"2024-04-17T05:26:58.276029+0000","last_fullsized":"2024-04-17T05:26:58.276029+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:08:20.405780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.275085+0000","last_change":"2024-04-17T05:26:53.238192+0000","last_active":"2024-04-17T05:26:58.275085+0000","last_peered":"2024-04-17T05:26:58.275085+0000","last_clean":"2024-04-17T05:26:58.275085+0000","last_became_active":"2024-04-17T05:26:53.237901+0000","last_became_peered":"2024-04-17T05:26:53.237901+0000","last_unstale":"2024-04-17T05:26:58.275085+0000","last_undegraded":"2024-04-17T05:26:58.275085+0000","last_fullsized":"2024-04-17T05:26:58.275085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:31:26.820940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315702+0000","last_change":"2024-04-17T05:26:52.213337+0000","last_active":"2024-04-17T05:26:59.315702+0000","last_peered":"2024-04-17T05:26:59.315702+0000","last_clean":"2024-04-17T05:26:59.315702+0000","last_became_active":"2024-04-17T05:26:52.213091+0000","last_became_peered":"2024-04-17T05:26:52.213091+0000","last_unstale":"2024-04-17T05:26:59.315702+0000","last_undegraded":"2024-04-17T05:26:59.315702+0000","last_fullsized":"2024-04-17T05:26:59.315702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:26.013417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.272624+0000","last_change":"2024-04-17T05:26:57.342025+0000","last_active":"2024-04-17T05:26:58.272624+0000","last_peered":"2024-04-17T05:26:58.272624+0000","last_clean":"2024-04-17T05:26:58.272624+0000","last_became_active":"2024-04-17T05:26:57.341654+0000","last_became_peered":"2024-04-17T05:26:57.341654+0000","last_unstale":"2024-04-17T05:26:58.272624+0000","last_undegraded":"2024-04-17T05:26:58.272624+0000","last_fullsized":"2024-04-17T05:26:58.272624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:43:39.199679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315923+0000","last_change":"2024-04-17T05:26:53.220626+0000","last_active":"2024-04-17T05:26:59.315923+0000","last_peered":"2024-04-17T05:26:59.315923+0000","last_clean":"2024-04-17T05:26:59.315923+0000","last_became_active":"2024-04-17T05:26:53.220331+0000","last_became_peered":"2024-04-17T05:26:53.220331+0000","last_unstale":"2024-04-17T05:26:59.315923+0000","last_undegraded":"2024-04-17T05:26:59.315923+0000","last_fullsized":"2024-04-17T05:26:59.315923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:32:25.337967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317911+0000","last_change":"2024-04-17T05:26:52.216060+0000","last_active":"2024-04-17T05:26:59.317911+0000","last_peered":"2024-04-17T05:26:59.317911+0000","last_clean":"2024-04-17T05:26:59.317911+0000","last_became_active":"2024-04-17T05:26:52.215771+0000","last_became_peered":"2024-04-17T05:26:52.215771+0000","last_unstale":"2024-04-17T05:26:59.317911+0000","last_undegraded":"2024-04-17T05:26:59.317911+0000","last_fullsized":"2024-04-17T05:26:59.317911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:14:11.769826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313579+0000","last_change":"2024-04-17T05:26:57.343520+0000","last_active":"2024-04-17T05:26:59.313579+0000","last_peered":"2024-04-17T05:26:59.313579+0000","last_clean":"2024-04-17T05:26:59.313579+0000","last_became_active":"2024-04-17T05:26:57.343032+0000","last_became_peered":"2024-04-17T05:26:57.343032+0000","last_unstale":"2024-04-17T05:26:59.313579+0000","last_undegraded":"2024-04-17T05:26:59.313579+0000","last_fullsized":"2024-04-17T05:26:59.313579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:59:04.049982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276726+0000","last_change":"2024-04-17T05:26:53.238977+0000","last_active":"2024-04-17T05:26:58.276726+0000","last_peered":"2024-04-17T05:26:58.276726+0000","last_clean":"2024-04-17T05:26:58.276726+0000","last_became_active":"2024-04-17T05:26:53.238516+0000","last_became_peered":"2024-04-17T05:26:53.238516+0000","last_unstale":"2024-04-17T05:26:58.276726+0000","last_undegraded":"2024-04-17T05:26:58.276726+0000","last_fullsized":"2024-04-17T05:26:58.276726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:59:47.655532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315985+0000","last_change":"2024-04-17T05:26:52.204960+0000","last_active":"2024-04-17T05:26:59.315985+0000","last_peered":"2024-04-17T05:26:59.315985+0000","last_clean":"2024-04-17T05:26:59.315985+0000","last_became_active":"2024-04-17T05:26:52.204529+0000","last_became_peered":"2024-04-17T05:26:52.204529+0000","last_unstale":"2024-04-17T05:26:59.315985+0000","last_undegraded":"2024-04-17T05:26:59.315985+0000","last_fullsized":"2024-04-17T05:26:59.315985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:28.440614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314574+0000","last_change":"2024-04-17T05:26:57.300433+0000","last_active":"2024-04-17T05:26:59.314574+0000","last_peered":"2024-04-17T05:26:59.314574+0000","last_clean":"2024-04-17T05:26:59.314574+0000","last_became_active":"2024-04-17T05:26:57.299625+0000","last_became_peered":"2024-04-17T05:26:57.299625+0000","last_unstale":"2024-04-17T05:26:59.314574+0000","last_undegraded":"2024-04-17T05:26:59.314574+0000","last_fullsized":"2024-04-17T05:26:59.314574+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:59:51.738314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.278228+0000","last_change":"2024-04-17T05:26:53.221039+0000","last_active":"2024-04-17T05:26:58.278228+0000","last_peered":"2024-04-17T05:26:58.278228+0000","last_clean":"2024-04-17T05:26:58.278228+0000","last_became_active":"2024-04-17T05:26:53.220763+0000","last_became_peered":"2024-04-17T05:26:53.220763+0000","last_unstale":"2024-04-17T05:26:58.278228+0000","last_undegraded":"2024-04-17T05:26:58.278228+0000","last_fullsized":"2024-04-17T05:26:58.278228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:06:06.694765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.275564+0000","last_change":"2024-04-17T05:26:52.200059+0000","last_active":"2024-04-17T05:26:58.275564+0000","last_peered":"2024-04-17T05:26:58.275564+0000","last_clean":"2024-04-17T05:26:58.275564+0000","last_became_active":"2024-04-17T05:26:52.199528+0000","last_became_peered":"2024-04-17T05:26:52.199528+0000","last_unstale":"2024-04-17T05:26:58.275564+0000","last_undegraded":"2024-04-17T05:26:58.275564+0000","last_fullsized":"2024-04-17T05:26:58.275564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:39:42.873364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315890+0000","last_change":"2024-04-17T05:26:57.306296+0000","last_active":"2024-04-17T05:26:59.315890+0000","last_peered":"2024-04-17T05:26:59.315890+0000","last_clean":"2024-04-17T05:26:59.315890+0000","last_became_active":"2024-04-17T05:26:57.305013+0000","last_became_peered":"2024-04-17T05:26:57.305013+0000","last_unstale":"2024-04-17T05:26:59.315890+0000","last_undegraded":"2024-04-17T05:26:59.315890+0000","last_fullsized":"2024-04-17T05:26:59.315890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:43:13.615366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313694+0000","last_change":"2024-04-17T05:26:53.225946+0000","last_active":"2024-04-17T05:26:59.313694+0000","last_peered":"2024-04-17T05:26:59.313694+0000","last_clean":"2024-04-17T05:26:59.313694+0000","last_became_active":"2024-04-17T05:26:53.220930+0000","last_became_peered":"2024-04-17T05:26:53.220930+0000","last_unstale":"2024-04-17T05:26:59.313694+0000","last_undegraded":"2024-04-17T05:26:59.313694+0000","last_fullsized":"2024-04-17T05:26:59.313694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:08:41.870139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315801+0000","last_change":"2024-04-17T05:26:52.200139+0000","last_active":"2024-04-17T05:26:59.315801+0000","last_peered":"2024-04-17T05:26:59.315801+0000","last_clean":"2024-04-17T05:26:59.315801+0000","last_became_active":"2024-04-17T05:26:52.199804+0000","last_became_peered":"2024-04-17T05:26:52.199804+0000","last_unstale":"2024-04-17T05:26:59.315801+0000","last_undegraded":"2024-04-17T05:26:59.315801+0000","last_fullsized":"2024-04-17T05:26:59.315801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:05:28.743450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316978+0000","last_change":"2024-04-17T05:26:57.303365+0000","last_active":"2024-04-17T05:26:59.316978+0000","last_peered":"2024-04-17T05:26:59.316978+0000","last_clean":"2024-04-17T05:26:59.316978+0000","last_became_active":"2024-04-17T05:26:57.301101+0000","last_became_peered":"2024-04-17T05:26:57.301101+0000","last_unstale":"2024-04-17T05:26:59.316978+0000","last_undegraded":"2024-04-17T05:26:59.316978+0000","last_fullsized":"2024-04-17T05:26:59.316978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:43:39.199679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.312425+0000","last_change":"2024-04-17T05:26:53.238762+0000","last_active":"2024-04-17T05:26:59.312425+0000","last_peered":"2024-04-17T05:26:59.312425+0000","last_clean":"2024-04-17T05:26:59.312425+0000","last_became_active":"2024-04-17T05:26:53.238488+0000","last_became_peered":"2024-04-17T05:26:53.238488+0000","last_unstale":"2024-04-17T05:26:59.312425+0000","last_undegraded":"2024-04-17T05:26:59.312425+0000","last_fullsized":"2024-04-17T05:26:59.312425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:38.214751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315993+0000","last_change":"2024-04-17T05:26:52.213104+0000","last_active":"2024-04-17T05:26:59.315993+0000","last_peered":"2024-04-17T05:26:59.315993+0000","last_clean":"2024-04-17T05:26:59.315993+0000","last_became_active":"2024-04-17T05:26:52.212838+0000","last_became_peered":"2024-04-17T05:26:52.212838+0000","last_unstale":"2024-04-17T05:26:59.315993+0000","last_undegraded":"2024-04-17T05:26:59.315993+0000","last_fullsized":"2024-04-17T05:26:59.315993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:11:58.913400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313981+0000","last_change":"2024-04-17T05:26:57.342387+0000","last_active":"2024-04-17T05:26:59.313981+0000","last_peered":"2024-04-17T05:26:59.313981+0000","last_clean":"2024-04-17T05:26:59.313981+0000","last_became_active":"2024-04-17T05:26:57.342008+0000","last_became_peered":"2024-04-17T05:26:57.342008+0000","last_unstale":"2024-04-17T05:26:59.313981+0000","last_undegraded":"2024-04-17T05:26:59.313981+0000","last_fullsized":"2024-04-17T05:26:59.313981+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:43:39.199679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273541+0000","last_change":"2024-04-17T05:26:53.243046+0000","last_active":"2024-04-17T05:26:58.273541+0000","last_peered":"2024-04-17T05:26:58.273541+0000","last_clean":"2024-04-17T05:26:58.273541+0000","last_became_active":"2024-04-17T05:26:53.242778+0000","last_became_peered":"2024-04-17T05:26:53.242778+0000","last_unstale":"2024-04-17T05:26:58.273541+0000","last_undegraded":"2024-04-17T05:26:58.273541+0000","last_fullsized":"2024-04-17T05:26:58.273541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:32:25.337967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274750+0000","last_change":"2024-04-17T05:26:52.198125+0000","last_active":"2024-04-17T05:26:58.274750+0000","last_peered":"2024-04-17T05:26:58.274750+0000","last_clean":"2024-04-17T05:26:58.274750+0000","last_became_active":"2024-04-17T05:26:52.197762+0000","last_became_peered":"2024-04-17T05:26:52.197762+0000","last_unstale":"2024-04-17T05:26:58.274750+0000","last_undegraded":"2024-04-17T05:26:58.274750+0000","last_fullsized":"2024-04-17T05:26:58.274750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:28.440614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316306+0000","last_change":"2024-04-17T05:26:48.072527+0000","last_active":"2024-04-17T05:26:59.316306+0000","last_peered":"2024-04-17T05:26:59.316306+0000","last_clean":"2024-04-17T05:26:59.316306+0000","last_became_active":"2024-04-17T05:26:48.070585+0000","last_became_peered":"2024-04-17T05:26:48.070585+0000","last_unstale":"2024-04-17T05:26:59.316306+0000","last_undegraded":"2024-04-17T05:26:59.316306+0000","last_fullsized":"2024-04-17T05:26:59.316306+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:46.995002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:46.995002+0000","last_clean_scrub_stamp":"2024-04-17T05:26:46.995002+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:48:35.792125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316121+0000","last_change":"2024-04-17T05:26:57.346681+0000","last_active":"2024-04-17T05:26:59.316121+0000","last_peered":"2024-04-17T05:26:59.316121+0000","last_clean":"2024-04-17T05:26:59.316121+0000","last_became_active":"2024-04-17T05:26:57.345320+0000","last_became_peered":"2024-04-17T05:26:57.345320+0000","last_unstale":"2024-04-17T05:26:59.316121+0000","last_undegraded":"2024-04-17T05:26:59.316121+0000","last_fullsized":"2024-04-17T05:26:59.316121+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:14:02.473527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316740+0000","last_change":"2024-04-17T05:26:53.251585+0000","last_active":"2024-04-17T05:26:59.316740+0000","last_peered":"2024-04-17T05:26:59.316740+0000","last_clean":"2024-04-17T05:26:59.316740+0000","last_became_active":"2024-04-17T05:26:53.249490+0000","last_became_peered":"2024-04-17T05:26:53.249490+0000","last_unstale":"2024-04-17T05:26:59.316740+0000","last_undegraded":"2024-04-17T05:26:59.316740+0000","last_fullsized":"2024-04-17T05:26:59.316740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:32:48.533935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317029+0000","last_change":"2024-04-17T05:26:52.209276+0000","last_active":"2024-04-17T05:26:59.317029+0000","last_peered":"2024-04-17T05:26:59.317029+0000","last_clean":"2024-04-17T05:26:59.317029+0000","last_became_active":"2024-04-17T05:26:52.208422+0000","last_became_peered":"2024-04-17T05:26:52.208422+0000","last_unstale":"2024-04-17T05:26:59.317029+0000","last_undegraded":"2024-04-17T05:26:59.317029+0000","last_fullsized":"2024-04-17T05:26:59.317029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:39:42.873364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315187+0000","last_change":"2024-04-17T05:26:57.342209+0000","last_active":"2024-04-17T05:26:59.315187+0000","last_peered":"2024-04-17T05:26:59.315187+0000","last_clean":"2024-04-17T05:26:59.315187+0000","last_became_active":"2024-04-17T05:26:57.341658+0000","last_became_peered":"2024-04-17T05:26:57.341658+0000","last_unstale":"2024-04-17T05:26:59.315187+0000","last_undegraded":"2024-04-17T05:26:59.315187+0000","last_fullsized":"2024-04-17T05:26:59.315187+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:49.740852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276430+0000","last_change":"2024-04-17T05:26:53.239720+0000","last_active":"2024-04-17T05:26:58.276430+0000","last_peered":"2024-04-17T05:26:58.276430+0000","last_clean":"2024-04-17T05:26:58.276430+0000","last_became_active":"2024-04-17T05:26:53.238669+0000","last_became_peered":"2024-04-17T05:26:53.238669+0000","last_unstale":"2024-04-17T05:26:58.276430+0000","last_undegraded":"2024-04-17T05:26:58.276430+0000","last_fullsized":"2024-04-17T05:26:58.276430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:58:59.967200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316067+0000","last_change":"2024-04-17T05:26:52.202596+0000","last_active":"2024-04-17T05:26:59.316067+0000","last_peered":"2024-04-17T05:26:59.316067+0000","last_clean":"2024-04-17T05:26:59.316067+0000","last_became_active":"2024-04-17T05:26:52.202246+0000","last_became_peered":"2024-04-17T05:26:52.202246+0000","last_unstale":"2024-04-17T05:26:59.316067+0000","last_undegraded":"2024-04-17T05:26:59.316067+0000","last_fullsized":"2024-04-17T05:26:59.316067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:30.475514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313919+0000","last_change":"2024-04-17T05:26:57.303069+0000","last_active":"2024-04-17T05:26:59.313919+0000","last_peered":"2024-04-17T05:26:59.313919+0000","last_clean":"2024-04-17T05:26:59.313919+0000","last_became_active":"2024-04-17T05:26:57.302457+0000","last_became_peered":"2024-04-17T05:26:57.302457+0000","last_unstale":"2024-04-17T05:26:59.313919+0000","last_undegraded":"2024-04-17T05:26:59.313919+0000","last_fullsized":"2024-04-17T05:26:59.313919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:45:07.123915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.318354+0000","last_change":"2024-04-17T05:26:53.255140+0000","last_active":"2024-04-17T05:26:59.318354+0000","last_peered":"2024-04-17T05:26:59.318354+0000","last_clean":"2024-04-17T05:26:59.318354+0000","last_became_active":"2024-04-17T05:26:53.254371+0000","last_became_peered":"2024-04-17T05:26:53.254371+0000","last_unstale":"2024-04-17T05:26:59.318354+0000","last_undegraded":"2024-04-17T05:26:59.318354+0000","last_fullsized":"2024-04-17T05:26:59.318354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:33:12.651636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317435+0000","last_change":"2024-04-17T05:26:52.204598+0000","last_active":"2024-04-17T05:26:59.317435+0000","last_peered":"2024-04-17T05:26:59.317435+0000","last_clean":"2024-04-17T05:26:59.317435+0000","last_became_active":"2024-04-17T05:26:52.204139+0000","last_became_peered":"2024-04-17T05:26:52.204139+0000","last_unstale":"2024-04-17T05:26:59.317435+0000","last_undegraded":"2024-04-17T05:26:59.317435+0000","last_fullsized":"2024-04-17T05:26:59.317435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:11:26.292397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274608+0000","last_change":"2024-04-17T05:26:57.345152+0000","last_active":"2024-04-17T05:26:58.274608+0000","last_peered":"2024-04-17T05:26:58.274608+0000","last_clean":"2024-04-17T05:26:58.274608+0000","last_became_active":"2024-04-17T05:26:57.342006+0000","last_became_peered":"2024-04-17T05:26:57.342006+0000","last_unstale":"2024-04-17T05:26:58.274608+0000","last_undegraded":"2024-04-17T05:26:58.274608+0000","last_fullsized":"2024-04-17T05:26:58.274608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:56:05.345989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317476+0000","last_change":"2024-04-17T05:26:53.253746+0000","last_active":"2024-04-17T05:26:59.317476+0000","last_peered":"2024-04-17T05:26:59.317476+0000","last_clean":"2024-04-17T05:26:59.317476+0000","last_became_active":"2024-04-17T05:26:53.253395+0000","last_became_peered":"2024-04-17T05:26:53.253395+0000","last_unstale":"2024-04-17T05:26:59.317476+0000","last_undegraded":"2024-04-17T05:26:59.317476+0000","last_fullsized":"2024-04-17T05:26:59.317476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:46:38.091860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.277646+0000","last_change":"2024-04-17T05:26:52.199105+0000","last_active":"2024-04-17T05:26:58.277646+0000","last_peered":"2024-04-17T05:26:58.277646+0000","last_clean":"2024-04-17T05:26:58.277646+0000","last_became_active":"2024-04-17T05:26:52.198798+0000","last_became_peered":"2024-04-17T05:26:52.198798+0000","last_unstale":"2024-04-17T05:26:58.277646+0000","last_undegraded":"2024-04-17T05:26:58.277646+0000","last_fullsized":"2024-04-17T05:26:58.277646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:34:06.405382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274283+0000","last_change":"2024-04-17T05:26:57.306130+0000","last_active":"2024-04-17T05:26:58.274283+0000","last_peered":"2024-04-17T05:26:58.274283+0000","last_clean":"2024-04-17T05:26:58.274283+0000","last_became_active":"2024-04-17T05:26:57.305415+0000","last_became_peered":"2024-04-17T05:26:57.305415+0000","last_unstale":"2024-04-17T05:26:58.274283+0000","last_undegraded":"2024-04-17T05:26:58.274283+0000","last_fullsized":"2024-04-17T05:26:58.274283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:36.214126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317844+0000","last_change":"2024-04-17T05:26:53.253524+0000","last_active":"2024-04-17T05:26:59.317844+0000","last_peered":"2024-04-17T05:26:59.317844+0000","last_clean":"2024-04-17T05:26:59.317844+0000","last_became_active":"2024-04-17T05:26:53.251408+0000","last_became_peered":"2024-04-17T05:26:53.251408+0000","last_unstale":"2024-04-17T05:26:59.317844+0000","last_undegraded":"2024-04-17T05:26:59.317844+0000","last_fullsized":"2024-04-17T05:26:59.317844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:13:58.390745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315457+0000","last_change":"2024-04-17T05:26:52.197556+0000","last_active":"2024-04-17T05:26:59.315457+0000","last_peered":"2024-04-17T05:26:59.315457+0000","last_clean":"2024-04-17T05:26:59.315457+0000","last_became_active":"2024-04-17T05:26:52.197250+0000","last_became_peered":"2024-04-17T05:26:52.197250+0000","last_unstale":"2024-04-17T05:26:59.315457+0000","last_undegraded":"2024-04-17T05:26:59.315457+0000","last_fullsized":"2024-04-17T05:26:59.315457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:12:06.528342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313911+0000","last_change":"2024-04-17T05:26:57.296438+0000","last_active":"2024-04-17T05:26:59.313911+0000","last_peered":"2024-04-17T05:26:59.313911+0000","last_clean":"2024-04-17T05:26:59.313911+0000","last_became_active":"2024-04-17T05:26:57.296040+0000","last_became_peered":"2024-04-17T05:26:57.296040+0000","last_unstale":"2024-04-17T05:26:59.313911+0000","last_undegraded":"2024-04-17T05:26:59.313911+0000","last_fullsized":"2024-04-17T05:26:59.313911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:43:13.615366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315063+0000","last_change":"2024-04-17T05:26:53.231338+0000","last_active":"2024-04-17T05:26:59.315063+0000","last_peered":"2024-04-17T05:26:59.315063+0000","last_clean":"2024-04-17T05:26:59.315063+0000","last_became_active":"2024-04-17T05:26:53.230987+0000","last_became_peered":"2024-04-17T05:26:53.230987+0000","last_unstale":"2024-04-17T05:26:59.315063+0000","last_undegraded":"2024-04-17T05:26:59.315063+0000","last_fullsized":"2024-04-17T05:26:59.315063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:08:10.489719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315083+0000","last_change":"2024-04-17T05:26:52.207087+0000","last_active":"2024-04-17T05:26:59.315083+0000","last_peered":"2024-04-17T05:26:59.315083+0000","last_clean":"2024-04-17T05:26:59.315083+0000","last_became_active":"2024-04-17T05:26:52.206401+0000","last_became_peered":"2024-04-17T05:26:52.206401+0000","last_unstale":"2024-04-17T05:26:59.315083+0000","last_undegraded":"2024-04-17T05:26:59.315083+0000","last_fullsized":"2024-04-17T05:26:59.315083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:56:53.915549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.275125+0000","last_change":"2024-04-17T05:26:57.346955+0000","last_active":"2024-04-17T05:26:58.275125+0000","last_peered":"2024-04-17T05:26:58.275125+0000","last_clean":"2024-04-17T05:26:58.275125+0000","last_became_active":"2024-04-17T05:26:57.346516+0000","last_became_peered":"2024-04-17T05:26:57.346516+0000","last_unstale":"2024-04-17T05:26:58.275125+0000","last_undegraded":"2024-04-17T05:26:58.275125+0000","last_fullsized":"2024-04-17T05:26:58.275125+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:00:55.830345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317606+0000","last_change":"2024-04-17T05:26:53.254195+0000","last_active":"2024-04-17T05:26:59.317606+0000","last_peered":"2024-04-17T05:26:59.317606+0000","last_clean":"2024-04-17T05:26:59.317606+0000","last_became_active":"2024-04-17T05:26:53.253813+0000","last_became_peered":"2024-04-17T05:26:53.253813+0000","last_unstale":"2024-04-17T05:26:59.317606+0000","last_undegraded":"2024-04-17T05:26:59.317606+0000","last_fullsized":"2024-04-17T05:26:59.317606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:18:31.208224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.275423+0000","last_change":"2024-04-17T05:26:52.211664+0000","last_active":"2024-04-17T05:26:58.275423+0000","last_peered":"2024-04-17T05:26:58.275423+0000","last_clean":"2024-04-17T05:26:58.275423+0000","last_became_active":"2024-04-17T05:26:52.210106+0000","last_became_peered":"2024-04-17T05:26:52.210106+0000","last_unstale":"2024-04-17T05:26:58.275423+0000","last_undegraded":"2024-04-17T05:26:58.275423+0000","last_fullsized":"2024-04-17T05:26:58.275423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:11:26.292397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274110+0000","last_change":"2024-04-17T05:26:57.344473+0000","last_active":"2024-04-17T05:26:58.274110+0000","last_peered":"2024-04-17T05:26:58.274110+0000","last_clean":"2024-04-17T05:26:58.274110+0000","last_became_active":"2024-04-17T05:26:57.341999+0000","last_became_peered":"2024-04-17T05:26:57.341999+0000","last_unstale":"2024-04-17T05:26:58.274110+0000","last_undegraded":"2024-04-17T05:26:58.274110+0000","last_fullsized":"2024-04-17T05:26:58.274110+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:35:19.879335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313364+0000","last_change":"2024-04-17T05:26:53.235732+0000","last_active":"2024-04-17T05:26:59.313364+0000","last_peered":"2024-04-17T05:26:59.313364+0000","last_clean":"2024-04-17T05:26:59.313364+0000","last_became_active":"2024-04-17T05:26:53.233202+0000","last_became_peered":"2024-04-17T05:26:53.233202+0000","last_unstale":"2024-04-17T05:26:59.313364+0000","last_undegraded":"2024-04-17T05:26:59.313364+0000","last_fullsized":"2024-04-17T05:26:59.313364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:58:23.088108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314205+0000","last_change":"2024-04-17T05:26:52.194788+0000","last_active":"2024-04-17T05:26:59.314205+0000","last_peered":"2024-04-17T05:26:59.314205+0000","last_clean":"2024-04-17T05:26:59.314205+0000","last_became_active":"2024-04-17T05:26:52.194504+0000","last_became_peered":"2024-04-17T05:26:52.194504+0000","last_unstale":"2024-04-17T05:26:59.314205+0000","last_undegraded":"2024-04-17T05:26:59.314205+0000","last_fullsized":"2024-04-17T05:26:59.314205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:29:09.631143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276321+0000","last_change":"2024-04-17T05:26:57.344052+0000","last_active":"2024-04-17T05:26:58.276321+0000","last_peered":"2024-04-17T05:26:58.276321+0000","last_clean":"2024-04-17T05:26:58.276321+0000","last_became_active":"2024-04-17T05:26:57.343479+0000","last_became_peered":"2024-04-17T05:26:57.343479+0000","last_unstale":"2024-04-17T05:26:58.276321+0000","last_undegraded":"2024-04-17T05:26:58.276321+0000","last_fullsized":"2024-04-17T05:26:58.276321+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:23:44.724644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316499+0000","last_change":"2024-04-17T05:26:53.250744+0000","last_active":"2024-04-17T05:26:59.316499+0000","last_peered":"2024-04-17T05:26:59.316499+0000","last_clean":"2024-04-17T05:26:59.316499+0000","last_became_active":"2024-04-17T05:26:53.249125+0000","last_became_peered":"2024-04-17T05:26:53.249125+0000","last_unstale":"2024-04-17T05:26:59.316499+0000","last_undegraded":"2024-04-17T05:26:59.316499+0000","last_fullsized":"2024-04-17T05:26:59.316499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:29.313074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:27:10.814542+0000","last_change":"2024-04-17T05:26:52.208074+0000","last_active":"2024-04-17T05:27:10.814542+0000","last_peered":"2024-04-17T05:27:10.814542+0000","last_clean":"2024-04-17T05:27:10.814542+0000","last_became_active":"2024-04-17T05:26:52.207696+0000","last_became_peered":"2024-04-17T05:26:52.207696+0000","last_unstale":"2024-04-17T05:27:10.814542+0000","last_undegraded":"2024-04-17T05:27:10.814542+0000","last_fullsized":"2024-04-17T05:27:10.814542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:10:33.072665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314836+0000","last_change":"2024-04-17T05:26:57.303649+0000","last_active":"2024-04-17T05:26:59.314836+0000","last_peered":"2024-04-17T05:26:59.314836+0000","last_clean":"2024-04-17T05:26:59.314836+0000","last_became_active":"2024-04-17T05:26:57.303124+0000","last_became_peered":"2024-04-17T05:26:57.303124+0000","last_unstale":"2024-04-17T05:26:59.314836+0000","last_undegraded":"2024-04-17T05:26:59.314836+0000","last_fullsized":"2024-04-17T05:26:59.314836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:59:04.049982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.277954+0000","last_change":"2024-04-17T05:26:53.232911+0000","last_active":"2024-04-17T05:26:58.277954+0000","last_peered":"2024-04-17T05:26:58.277954+0000","last_clean":"2024-04-17T05:26:58.277954+0000","last_became_active":"2024-04-17T05:26:53.232624+0000","last_became_peered":"2024-04-17T05:26:53.232624+0000","last_unstale":"2024-04-17T05:26:58.277954+0000","last_undegraded":"2024-04-17T05:26:58.277954+0000","last_fullsized":"2024-04-17T05:26:58.277954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:31.494213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315869+0000","last_change":"2024-04-17T05:26:52.207484+0000","last_active":"2024-04-17T05:26:59.315869+0000","last_peered":"2024-04-17T05:26:59.315869+0000","last_clean":"2024-04-17T05:26:59.315869+0000","last_became_active":"2024-04-17T05:26:52.207181+0000","last_became_peered":"2024-04-17T05:26:52.207181+0000","last_unstale":"2024-04-17T05:26:59.315869+0000","last_undegraded":"2024-04-17T05:26:59.315869+0000","last_fullsized":"2024-04-17T05:26:59.315869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:06:05.676066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.277617+0000","last_change":"2024-04-17T05:26:57.310269+0000","last_active":"2024-04-17T05:26:58.277617+0000","last_peered":"2024-04-17T05:26:58.277617+0000","last_clean":"2024-04-17T05:26:58.277617+0000","last_became_active":"2024-04-17T05:26:57.308888+0000","last_became_peered":"2024-04-17T05:26:57.308888+0000","last_unstale":"2024-04-17T05:26:58.277617+0000","last_undegraded":"2024-04-17T05:26:58.277617+0000","last_fullsized":"2024-04-17T05:26:58.277617+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:52:36.475652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314048+0000","last_change":"2024-04-17T05:26:53.241678+0000","last_active":"2024-04-17T05:26:59.314048+0000","last_peered":"2024-04-17T05:26:59.314048+0000","last_clean":"2024-04-17T05:26:59.314048+0000","last_became_active":"2024-04-17T05:26:53.241388+0000","last_became_peered":"2024-04-17T05:26:53.241388+0000","last_unstale":"2024-04-17T05:26:59.314048+0000","last_undegraded":"2024-04-17T05:26:59.314048+0000","last_fullsized":"2024-04-17T05:26:59.314048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:32:25.337967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.277856+0000","last_change":"2024-04-17T05:26:52.213786+0000","last_active":"2024-04-17T05:26:58.277856+0000","last_peered":"2024-04-17T05:26:58.277856+0000","last_clean":"2024-04-17T05:26:58.277856+0000","last_became_active":"2024-04-17T05:26:52.212440+0000","last_became_peered":"2024-04-17T05:26:52.212440+0000","last_unstale":"2024-04-17T05:26:58.277856+0000","last_undegraded":"2024-04-17T05:26:58.277856+0000","last_fullsized":"2024-04-17T05:26:58.277856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:06:05.676066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273308+0000","last_change":"2024-04-17T05:26:57.300596+0000","last_active":"2024-04-17T05:26:58.273308+0000","last_peered":"2024-04-17T05:26:58.273308+0000","last_clean":"2024-04-17T05:26:58.273308+0000","last_became_active":"2024-04-17T05:26:57.300156+0000","last_became_peered":"2024-04-17T05:26:57.300156+0000","last_unstale":"2024-04-17T05:26:58.273308+0000","last_undegraded":"2024-04-17T05:26:58.273308+0000","last_fullsized":"2024-04-17T05:26:58.273308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:11:16.497552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.277619+0000","last_change":"2024-04-17T05:26:53.238893+0000","last_active":"2024-04-17T05:26:58.277619+0000","last_peered":"2024-04-17T05:26:58.277619+0000","last_clean":"2024-04-17T05:26:58.277619+0000","last_became_active":"2024-04-17T05:26:53.238566+0000","last_became_peered":"2024-04-17T05:26:53.238566+0000","last_unstale":"2024-04-17T05:26:58.277619+0000","last_undegraded":"2024-04-17T05:26:58.277619+0000","last_fullsized":"2024-04-17T05:26:58.277619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:52:32.392870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316389+0000","last_change":"2024-04-17T05:26:52.215304+0000","last_active":"2024-04-17T05:26:59.316389+0000","last_peered":"2024-04-17T05:26:59.316389+0000","last_clean":"2024-04-17T05:26:59.316389+0000","last_became_active":"2024-04-17T05:26:52.214958+0000","last_became_peered":"2024-04-17T05:26:52.214958+0000","last_unstale":"2024-04-17T05:26:59.316389+0000","last_undegraded":"2024-04-17T05:26:59.316389+0000","last_fullsized":"2024-04-17T05:26:59.316389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:13:25.702517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273063+0000","last_change":"2024-04-17T05:26:57.342083+0000","last_active":"2024-04-17T05:26:58.273063+0000","last_peered":"2024-04-17T05:26:58.273063+0000","last_clean":"2024-04-17T05:26:58.273063+0000","last_became_active":"2024-04-17T05:26:57.341304+0000","last_became_peered":"2024-04-17T05:26:57.341304+0000","last_unstale":"2024-04-17T05:26:58.273063+0000","last_undegraded":"2024-04-17T05:26:58.273063+0000","last_fullsized":"2024-04-17T05:26:58.273063+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:56:05.345989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313536+0000","last_change":"2024-04-17T05:26:57.342446+0000","last_active":"2024-04-17T05:26:59.313536+0000","last_peered":"2024-04-17T05:26:59.313536+0000","last_clean":"2024-04-17T05:26:59.313536+0000","last_became_active":"2024-04-17T05:26:57.342076+0000","last_became_peered":"2024-04-17T05:26:57.342076+0000","last_unstale":"2024-04-17T05:26:59.313536+0000","last_undegraded":"2024-04-17T05:26:59.313536+0000","last_fullsized":"2024-04-17T05:26:59.313536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:59:51.738314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314000+0000","last_change":"2024-04-17T05:26:53.228706+0000","last_active":"2024-04-17T05:26:59.314000+0000","last_peered":"2024-04-17T05:26:59.314000+0000","last_clean":"2024-04-17T05:26:59.314000+0000","last_became_active":"2024-04-17T05:26:53.228381+0000","last_became_peered":"2024-04-17T05:26:53.228381+0000","last_unstale":"2024-04-17T05:26:59.314000+0000","last_undegraded":"2024-04-17T05:26:59.314000+0000","last_fullsized":"2024-04-17T05:26:59.314000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:04:57.213834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274809+0000","last_change":"2024-04-17T05:26:52.195697+0000","last_active":"2024-04-17T05:26:58.274809+0000","last_peered":"2024-04-17T05:26:58.274809+0000","last_clean":"2024-04-17T05:26:58.274809+0000","last_became_active":"2024-04-17T05:26:52.193995+0000","last_became_peered":"2024-04-17T05:26:52.193995+0000","last_unstale":"2024-04-17T05:26:58.274809+0000","last_undegraded":"2024-04-17T05:26:58.274809+0000","last_fullsized":"2024-04-17T05:26:58.274809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:05:28.743450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316290+0000","last_change":"2024-04-17T05:26:57.306563+0000","last_active":"2024-04-17T05:26:59.316290+0000","last_peered":"2024-04-17T05:26:59.316290+0000","last_clean":"2024-04-17T05:26:59.316290+0000","last_became_active":"2024-04-17T05:26:57.305777+0000","last_became_peered":"2024-04-17T05:26:57.305777+0000","last_unstale":"2024-04-17T05:26:59.316290+0000","last_undegraded":"2024-04-17T05:26:59.316290+0000","last_fullsized":"2024-04-17T05:26:59.316290+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:33.395856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273167+0000","last_change":"2024-04-17T05:26:53.229100+0000","last_active":"2024-04-17T05:26:58.273167+0000","last_peered":"2024-04-17T05:26:58.273167+0000","last_clean":"2024-04-17T05:26:58.273167+0000","last_became_active":"2024-04-17T05:26:53.225554+0000","last_became_peered":"2024-04-17T05:26:53.225554+0000","last_unstale":"2024-04-17T05:26:58.273167+0000","last_undegraded":"2024-04-17T05:26:58.273167+0000","last_fullsized":"2024-04-17T05:26:58.273167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:04:57.213834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273220+0000","last_change":"2024-04-17T05:26:52.205214+0000","last_active":"2024-04-17T05:26:58.273220+0000","last_peered":"2024-04-17T05:26:58.273220+0000","last_clean":"2024-04-17T05:26:58.273220+0000","last_became_active":"2024-04-17T05:26:52.204982+0000","last_became_peered":"2024-04-17T05:26:52.204982+0000","last_unstale":"2024-04-17T05:26:58.273220+0000","last_undegraded":"2024-04-17T05:26:58.273220+0000","last_fullsized":"2024-04-17T05:26:58.273220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:12:06.528342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315415+0000","last_change":"2024-04-17T05:26:52.211538+0000","last_active":"2024-04-17T05:26:59.315415+0000","last_peered":"2024-04-17T05:26:59.315415+0000","last_clean":"2024-04-17T05:26:59.315415+0000","last_became_active":"2024-04-17T05:26:52.211242+0000","last_became_peered":"2024-04-17T05:26:52.211242+0000","last_unstale":"2024-04-17T05:26:59.315415+0000","last_undegraded":"2024-04-17T05:26:59.315415+0000","last_fullsized":"2024-04-17T05:26:59.315415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:30:14.163882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314091+0000","last_change":"2024-04-17T05:26:53.239968+0000","last_active":"2024-04-17T05:26:59.314091+0000","last_peered":"2024-04-17T05:26:59.314091+0000","last_clean":"2024-04-17T05:26:59.314091+0000","last_became_active":"2024-04-17T05:26:53.239688+0000","last_became_peered":"2024-04-17T05:26:53.239688+0000","last_unstale":"2024-04-17T05:26:59.314091+0000","last_undegraded":"2024-04-17T05:26:59.314091+0000","last_fullsized":"2024-04-17T05:26:59.314091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:19:17.442103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317082+0000","last_change":"2024-04-17T05:26:57.297209+0000","last_active":"2024-04-17T05:26:59.317082+0000","last_peered":"2024-04-17T05:26:59.317082+0000","last_clean":"2024-04-17T05:26:59.317082+0000","last_became_active":"2024-04-17T05:26:57.295730+0000","last_became_peered":"2024-04-17T05:26:57.295730+0000","last_unstale":"2024-04-17T05:26:59.317082+0000","last_undegraded":"2024-04-17T05:26:59.317082+0000","last_fullsized":"2024-04-17T05:26:59.317082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:47:55.696215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274119+0000","last_change":"2024-04-17T05:26:52.214520+0000","last_active":"2024-04-17T05:26:58.274119+0000","last_peered":"2024-04-17T05:26:58.274119+0000","last_clean":"2024-04-17T05:26:58.274119+0000","last_became_active":"2024-04-17T05:26:52.214153+0000","last_became_peered":"2024-04-17T05:26:52.214153+0000","last_unstale":"2024-04-17T05:26:58.274119+0000","last_undegraded":"2024-04-17T05:26:58.274119+0000","last_fullsized":"2024-04-17T05:26:58.274119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:29:09.631143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.277103+0000","last_change":"2024-04-17T05:26:53.218086+0000","last_active":"2024-04-17T05:26:58.277103+0000","last_peered":"2024-04-17T05:26:58.277103+0000","last_clean":"2024-04-17T05:26:58.277103+0000","last_became_active":"2024-04-17T05:26:53.213566+0000","last_became_peered":"2024-04-17T05:26:53.213566+0000","last_unstale":"2024-04-17T05:26:58.277103+0000","last_undegraded":"2024-04-17T05:26:58.277103+0000","last_fullsized":"2024-04-17T05:26:58.277103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:29.459313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274661+0000","last_change":"2024-04-17T05:26:57.306742+0000","last_active":"2024-04-17T05:26:58.274661+0000","last_peered":"2024-04-17T05:26:58.274661+0000","last_clean":"2024-04-17T05:26:58.274661+0000","last_became_active":"2024-04-17T05:26:57.305115+0000","last_became_peered":"2024-04-17T05:26:57.305115+0000","last_unstale":"2024-04-17T05:26:58.274661+0000","last_undegraded":"2024-04-17T05:26:58.274661+0000","last_fullsized":"2024-04-17T05:26:58.274661+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:48:36.621042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315919+0000","last_change":"2024-04-17T05:26:53.232255+0000","last_active":"2024-04-17T05:26:59.315919+0000","last_peered":"2024-04-17T05:26:59.315919+0000","last_clean":"2024-04-17T05:26:59.315919+0000","last_became_active":"2024-04-17T05:26:53.231624+0000","last_became_peered":"2024-04-17T05:26:53.231624+0000","last_unstale":"2024-04-17T05:26:59.315919+0000","last_undegraded":"2024-04-17T05:26:59.315919+0000","last_fullsized":"2024-04-17T05:26:59.315919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:27:51.120892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316072+0000","last_change":"2024-04-17T05:26:53.222619+0000","last_active":"2024-04-17T05:26:59.316072+0000","last_peered":"2024-04-17T05:26:59.316072+0000","last_clean":"2024-04-17T05:26:59.316072+0000","last_became_active":"2024-04-17T05:26:53.222128+0000","last_became_peered":"2024-04-17T05:26:53.222128+0000","last_unstale":"2024-04-17T05:26:59.316072+0000","last_undegraded":"2024-04-17T05:26:59.316072+0000","last_fullsized":"2024-04-17T05:26:59.316072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:31.494213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.275315+0000","last_change":"2024-04-17T05:26:53.234820+0000","last_active":"2024-04-17T05:26:58.275315+0000","last_peered":"2024-04-17T05:26:58.275315+0000","last_clean":"2024-04-17T05:26:58.275315+0000","last_became_active":"2024-04-17T05:26:53.233708+0000","last_became_peered":"2024-04-17T05:26:53.233708+0000","last_unstale":"2024-04-17T05:26:58.275315+0000","last_undegraded":"2024-04-17T05:26:58.275315+0000","last_fullsized":"2024-04-17T05:26:58.275315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:08:16.322998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313987+0000","last_change":"2024-04-17T05:26:53.234961+0000","last_active":"2024-04-17T05:26:59.313987+0000","last_peered":"2024-04-17T05:26:59.313987+0000","last_clean":"2024-04-17T05:26:59.313987+0000","last_became_active":"2024-04-17T05:26:53.234387+0000","last_became_peered":"2024-04-17T05:26:53.234387+0000","last_unstale":"2024-04-17T05:26:59.313987+0000","last_undegraded":"2024-04-17T05:26:59.313987+0000","last_fullsized":"2024-04-17T05:26:59.313987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:07:47.404346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274284+0000","last_change":"2024-04-17T05:26:53.242359+0000","last_active":"2024-04-17T05:26:58.274284+0000","last_peered":"2024-04-17T05:26:58.274284+0000","last_clean":"2024-04-17T05:26:58.274284+0000","last_became_active":"2024-04-17T05:26:53.236476+0000","last_became_peered":"2024-04-17T05:26:53.236476+0000","last_unstale":"2024-04-17T05:26:58.274284+0000","last_undegraded":"2024-04-17T05:26:58.274284+0000","last_fullsized":"2024-04-17T05:26:58.274284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:08:16.322998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314721+0000","last_change":"2024-04-17T05:26:53.231647+0000","last_active":"2024-04-17T05:26:59.314721+0000","last_peered":"2024-04-17T05:26:59.314721+0000","last_clean":"2024-04-17T05:26:59.314721+0000","last_became_active":"2024-04-17T05:26:53.231335+0000","last_became_peered":"2024-04-17T05:26:53.231335+0000","last_unstale":"2024-04-17T05:26:59.314721+0000","last_undegraded":"2024-04-17T05:26:59.314721+0000","last_fullsized":"2024-04-17T05:26:59.314721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:19:17.442103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316585+0000","last_change":"2024-04-17T05:26:53.234892+0000","last_active":"2024-04-17T05:26:59.316585+0000","last_peered":"2024-04-17T05:26:59.316585+0000","last_clean":"2024-04-17T05:26:59.316585+0000","last_became_active":"2024-04-17T05:26:53.234582+0000","last_became_peered":"2024-04-17T05:26:53.234582+0000","last_unstale":"2024-04-17T05:26:59.316585+0000","last_undegraded":"2024-04-17T05:26:59.316585+0000","last_fullsized":"2024-04-17T05:26:59.316585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:48:56.352270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274951+0000","last_change":"2024-04-17T05:26:53.245242+0000","last_active":"2024-04-17T05:26:58.274951+0000","last_peered":"2024-04-17T05:26:58.274951+0000","last_clean":"2024-04-17T05:26:58.274951+0000","last_became_active":"2024-04-17T05:26:53.244910+0000","last_became_peered":"2024-04-17T05:26:53.244910+0000","last_unstale":"2024-04-17T05:26:58.274951+0000","last_undegraded":"2024-04-17T05:26:58.274951+0000","last_fullsized":"2024-04-17T05:26:58.274951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:45:55.350158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.275241+0000","last_change":"2024-04-17T05:26:53.240582+0000","last_active":"2024-04-17T05:26:58.275241+0000","last_peered":"2024-04-17T05:26:58.275241+0000","last_clean":"2024-04-17T05:26:58.275241+0000","last_became_active":"2024-04-17T05:26:53.240184+0000","last_became_peered":"2024-04-17T05:26:53.240184+0000","last_unstale":"2024-04-17T05:26:58.275241+0000","last_undegraded":"2024-04-17T05:26:58.275241+0000","last_fullsized":"2024-04-17T05:26:58.275241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:32:25.337967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273189+0000","last_change":"2024-04-17T05:26:53.236750+0000","last_active":"2024-04-17T05:26:58.273189+0000","last_peered":"2024-04-17T05:26:58.273189+0000","last_clean":"2024-04-17T05:26:58.273189+0000","last_became_active":"2024-04-17T05:26:53.236386+0000","last_became_peered":"2024-04-17T05:26:53.236386+0000","last_unstale":"2024-04-17T05:26:58.273189+0000","last_undegraded":"2024-04-17T05:26:58.273189+0000","last_fullsized":"2024-04-17T05:26:58.273189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:19:17.442103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.275168+0000","last_change":"2024-04-17T05:26:53.242520+0000","last_active":"2024-04-17T05:26:58.275168+0000","last_peered":"2024-04-17T05:26:58.275168+0000","last_clean":"2024-04-17T05:26:58.275168+0000","last_became_active":"2024-04-17T05:26:53.242213+0000","last_became_peered":"2024-04-17T05:26:53.242213+0000","last_unstale":"2024-04-17T05:26:58.275168+0000","last_undegraded":"2024-04-17T05:26:58.275168+0000","last_fullsized":"2024-04-17T05:26:58.275168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:32.131344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313663+0000","last_change":"2024-04-17T05:26:53.230464+0000","last_active":"2024-04-17T05:26:59.313663+0000","last_peered":"2024-04-17T05:26:59.313663+0000","last_clean":"2024-04-17T05:26:59.313663+0000","last_became_active":"2024-04-17T05:26:53.230146+0000","last_became_peered":"2024-04-17T05:26:53.230146+0000","last_unstale":"2024-04-17T05:26:59.313663+0000","last_undegraded":"2024-04-17T05:26:59.313663+0000","last_fullsized":"2024-04-17T05:26:59.313663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:20:19.035658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315881+0000","last_change":"2024-04-17T05:26:53.252592+0000","last_active":"2024-04-17T05:26:59.315881+0000","last_peered":"2024-04-17T05:26:59.315881+0000","last_clean":"2024-04-17T05:26:59.315881+0000","last_became_active":"2024-04-17T05:26:53.252280+0000","last_became_peered":"2024-04-17T05:26:53.252280+0000","last_unstale":"2024-04-17T05:26:59.315881+0000","last_undegraded":"2024-04-17T05:26:59.315881+0000","last_fullsized":"2024-04-17T05:26:59.315881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:47:18.182576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317653+0000","last_change":"2024-04-17T05:26:53.242405+0000","last_active":"2024-04-17T05:26:59.317653+0000","last_peered":"2024-04-17T05:26:59.317653+0000","last_clean":"2024-04-17T05:26:59.317653+0000","last_became_active":"2024-04-17T05:26:53.242046+0000","last_became_peered":"2024-04-17T05:26:53.242046+0000","last_unstale":"2024-04-17T05:26:59.317653+0000","last_undegraded":"2024-04-17T05:26:59.317653+0000","last_fullsized":"2024-04-17T05:26:59.317653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:25:09.244149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317256+0000","last_change":"2024-04-17T05:26:53.228029+0000","last_active":"2024-04-17T05:26:59.317256+0000","last_peered":"2024-04-17T05:26:59.317256+0000","last_clean":"2024-04-17T05:26:59.317256+0000","last_became_active":"2024-04-17T05:26:53.227572+0000","last_became_peered":"2024-04-17T05:26:53.227572+0000","last_unstale":"2024-04-17T05:26:59.317256+0000","last_undegraded":"2024-04-17T05:26:59.317256+0000","last_fullsized":"2024-04-17T05:26:59.317256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:27.032116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.280108+0000","last_change":"2024-04-17T05:26:53.226283+0000","last_active":"2024-04-17T05:26:58.280108+0000","last_peered":"2024-04-17T05:26:58.280108+0000","last_clean":"2024-04-17T05:26:58.280108+0000","last_became_active":"2024-04-17T05:26:53.225983+0000","last_became_peered":"2024-04-17T05:26:53.225983+0000","last_unstale":"2024-04-17T05:26:58.280108+0000","last_undegraded":"2024-04-17T05:26:58.280108+0000","last_fullsized":"2024-04-17T05:26:58.280108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:40:51.044161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274421+0000","last_change":"2024-04-17T05:26:53.230256+0000","last_active":"2024-04-17T05:26:58.274421+0000","last_peered":"2024-04-17T05:26:58.274421+0000","last_clean":"2024-04-17T05:26:58.274421+0000","last_became_active":"2024-04-17T05:26:53.229888+0000","last_became_peered":"2024-04-17T05:26:53.229888+0000","last_unstale":"2024-04-17T05:26:58.274421+0000","last_undegraded":"2024-04-17T05:26:58.274421+0000","last_fullsized":"2024-04-17T05:26:58.274421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:45:55.350158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314103+0000","last_change":"2024-04-17T05:26:53.211199+0000","last_active":"2024-04-17T05:26:59.314103+0000","last_peered":"2024-04-17T05:26:59.314103+0000","last_clean":"2024-04-17T05:26:59.314103+0000","last_became_active":"2024-04-17T05:26:53.208394+0000","last_became_peered":"2024-04-17T05:26:53.208394+0000","last_unstale":"2024-04-17T05:26:59.314103+0000","last_undegraded":"2024-04-17T05:26:59.314103+0000","last_fullsized":"2024-04-17T05:26:59.314103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:20:19.035658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313253+0000","last_change":"2024-04-17T05:26:53.224930+0000","last_active":"2024-04-17T05:26:59.313253+0000","last_peered":"2024-04-17T05:26:59.313253+0000","last_clean":"2024-04-17T05:26:59.313253+0000","last_became_active":"2024-04-17T05:26:53.224314+0000","last_became_peered":"2024-04-17T05:26:53.224314+0000","last_unstale":"2024-04-17T05:26:59.313253+0000","last_undegraded":"2024-04-17T05:26:59.313253+0000","last_fullsized":"2024-04-17T05:26:59.313253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:00:05.875990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273858+0000","last_change":"2024-04-17T05:26:53.234152+0000","last_active":"2024-04-17T05:26:58.273858+0000","last_peered":"2024-04-17T05:26:58.273858+0000","last_clean":"2024-04-17T05:26:58.273858+0000","last_became_active":"2024-04-17T05:26:53.233885+0000","last_became_peered":"2024-04-17T05:26:53.233885+0000","last_unstale":"2024-04-17T05:26:58.273858+0000","last_undegraded":"2024-04-17T05:26:58.273858+0000","last_fullsized":"2024-04-17T05:26:58.273858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:20:19.035658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.277926+0000","last_change":"2024-04-17T05:26:53.233213+0000","last_active":"2024-04-17T05:26:58.277926+0000","last_peered":"2024-04-17T05:26:58.277926+0000","last_clean":"2024-04-17T05:26:58.277926+0000","last_became_active":"2024-04-17T05:26:53.232809+0000","last_became_peered":"2024-04-17T05:26:53.232809+0000","last_unstale":"2024-04-17T05:26:58.277926+0000","last_undegraded":"2024-04-17T05:26:58.277926+0000","last_fullsized":"2024-04-17T05:26:58.277926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:44.057838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316496+0000","last_change":"2024-04-17T05:26:53.245453+0000","last_active":"2024-04-17T05:26:59.316496+0000","last_peered":"2024-04-17T05:26:59.316496+0000","last_clean":"2024-04-17T05:26:59.316496+0000","last_became_active":"2024-04-17T05:26:53.245051+0000","last_became_peered":"2024-04-17T05:26:53.245051+0000","last_unstale":"2024-04-17T05:26:59.316496+0000","last_undegraded":"2024-04-17T05:26:59.316496+0000","last_fullsized":"2024-04-17T05:26:59.316496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:44:40.424363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316508+0000","last_change":"2024-04-17T05:26:53.241934+0000","last_active":"2024-04-17T05:26:59.316508+0000","last_peered":"2024-04-17T05:26:59.316508+0000","last_clean":"2024-04-17T05:26:59.316508+0000","last_became_active":"2024-04-17T05:26:53.241108+0000","last_became_peered":"2024-04-17T05:26:53.241108+0000","last_unstale":"2024-04-17T05:26:59.316508+0000","last_undegraded":"2024-04-17T05:26:59.316508+0000","last_fullsized":"2024-04-17T05:26:59.316508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:53:43.076144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.318239+0000","last_change":"2024-04-17T05:26:53.248438+0000","last_active":"2024-04-17T05:26:59.318239+0000","last_peered":"2024-04-17T05:26:59.318239+0000","last_clean":"2024-04-17T05:26:59.318239+0000","last_became_active":"2024-04-17T05:26:53.247746+0000","last_became_peered":"2024-04-17T05:26:53.247746+0000","last_unstale":"2024-04-17T05:26:59.318239+0000","last_undegraded":"2024-04-17T05:26:59.318239+0000","last_fullsized":"2024-04-17T05:26:59.318239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:28:32.265291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.272812+0000","last_change":"2024-04-17T05:26:53.244109+0000","last_active":"2024-04-17T05:26:58.272812+0000","last_peered":"2024-04-17T05:26:58.272812+0000","last_clean":"2024-04-17T05:26:58.272812+0000","last_became_active":"2024-04-17T05:26:53.243625+0000","last_became_peered":"2024-04-17T05:26:53.243625+0000","last_unstale":"2024-04-17T05:26:58.272812+0000","last_undegraded":"2024-04-17T05:26:58.272812+0000","last_fullsized":"2024-04-17T05:26:58.272812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:07:47.404346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317613+0000","last_change":"2024-04-17T05:26:53.246489+0000","last_active":"2024-04-17T05:26:59.317613+0000","last_peered":"2024-04-17T05:26:59.317613+0000","last_clean":"2024-04-17T05:26:59.317613+0000","last_became_active":"2024-04-17T05:26:53.246286+0000","last_became_peered":"2024-04-17T05:26:53.246286+0000","last_unstale":"2024-04-17T05:26:59.317613+0000","last_undegraded":"2024-04-17T05:26:59.317613+0000","last_fullsized":"2024-04-17T05:26:59.317613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:45.658070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274944+0000","last_change":"2024-04-17T05:26:53.229115+0000","last_active":"2024-04-17T05:26:58.274944+0000","last_peered":"2024-04-17T05:26:58.274944+0000","last_clean":"2024-04-17T05:26:58.274944+0000","last_became_active":"2024-04-17T05:26:53.228706+0000","last_became_peered":"2024-04-17T05:26:53.228706+0000","last_unstale":"2024-04-17T05:26:58.274944+0000","last_undegraded":"2024-04-17T05:26:58.274944+0000","last_fullsized":"2024-04-17T05:26:58.274944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:19:17.442103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317096+0000","last_change":"2024-04-17T05:26:53.244961+0000","last_active":"2024-04-17T05:26:59.317096+0000","last_peered":"2024-04-17T05:26:59.317096+0000","last_clean":"2024-04-17T05:26:59.317096+0000","last_became_active":"2024-04-17T05:26:53.244595+0000","last_became_peered":"2024-04-17T05:26:53.244595+0000","last_unstale":"2024-04-17T05:26:59.317096+0000","last_undegraded":"2024-04-17T05:26:59.317096+0000","last_fullsized":"2024-04-17T05:26:59.317096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:13:34.455173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276173+0000","last_change":"2024-04-17T05:26:53.241645+0000","last_active":"2024-04-17T05:26:58.276173+0000","last_peered":"2024-04-17T05:26:58.276173+0000","last_clean":"2024-04-17T05:26:58.276173+0000","last_became_active":"2024-04-17T05:26:53.241292+0000","last_became_peered":"2024-04-17T05:26:53.241292+0000","last_unstale":"2024-04-17T05:26:58.276173+0000","last_undegraded":"2024-04-17T05:26:58.276173+0000","last_fullsized":"2024-04-17T05:26:58.276173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:31:26.820940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315030+0000","last_change":"2024-04-17T05:26:53.221256+0000","last_active":"2024-04-17T05:26:59.315030+0000","last_peered":"2024-04-17T05:26:59.315030+0000","last_clean":"2024-04-17T05:26:59.315030+0000","last_became_active":"2024-04-17T05:26:53.220445+0000","last_became_peered":"2024-04-17T05:26:53.220445+0000","last_unstale":"2024-04-17T05:26:59.315030+0000","last_undegraded":"2024-04-17T05:26:59.315030+0000","last_fullsized":"2024-04-17T05:26:59.315030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:08:41.870139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315578+0000","last_change":"2024-04-17T05:26:53.214897+0000","last_active":"2024-04-17T05:26:59.315578+0000","last_peered":"2024-04-17T05:26:59.315578+0000","last_clean":"2024-04-17T05:26:59.315578+0000","last_became_active":"2024-04-17T05:26:53.214591+0000","last_became_peered":"2024-04-17T05:26:53.214591+0000","last_unstale":"2024-04-17T05:26:59.315578+0000","last_undegraded":"2024-04-17T05:26:59.315578+0000","last_fullsized":"2024-04-17T05:26:59.315578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:32.131344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315663+0000","last_change":"2024-04-17T05:26:53.248726+0000","last_active":"2024-04-17T05:26:59.315663+0000","last_peered":"2024-04-17T05:26:59.315663+0000","last_clean":"2024-04-17T05:26:59.315663+0000","last_became_active":"2024-04-17T05:26:53.248143+0000","last_became_peered":"2024-04-17T05:26:53.248143+0000","last_unstale":"2024-04-17T05:26:59.315663+0000","last_undegraded":"2024-04-17T05:26:59.315663+0000","last_fullsized":"2024-04-17T05:26:59.315663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:02:51.306764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":699106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":111998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":108246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":108282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":111998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":108156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":108316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":880640,"data_stored":699162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T05:27:21.367 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-17T05:27:21.368 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-17T05:27:21.368 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-17T05:27:21.368 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-17T05:27:21.368 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-17T05:27:21.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.615+0000 7fc8b3e00640 1 Processor -- start 2024-04-17T05:27:21.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.615+0000 7fc8b3e00640 1 -- start start 2024-04-17T05:27:21.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.616+0000 7fc8b3e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc8b40b3dc0 0x7fc8b4147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:21.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.617+0000 7fc8b3e00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8b40b5910 con 0x7fc8b413eaf0 2024-04-17T05:27:21.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.617+0000 7fc8b3e00640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8b40b1870 con 0x7fc8b4148420 2024-04-17T05:27:21.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.617+0000 7fc8b3e00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc8b40b2c80 con 0x7fc8b40b3dc0 2024-04-17T05:27:21.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.617+0000 7fc8b2a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc8b40b3dc0 0x7fc8b4147ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:21.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.617+0000 7fc8b2a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc8b40b3dc0 0x7fc8b4147ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38048/0 (socket says 172.21.15.123:38048) 2024-04-17T05:27:21.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.617+0000 7fc8b2a00640 1 -- 172.21.15.123:0/2123255846 learned_addr learned my addr 172.21.15.123:0/2123255846 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:21.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.617+0000 7fc8b3400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc8b413eaf0 0x7fc8b414f090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54906/0 (socket says 172.21.15.123:54906) 2024-04-17T05:27:21.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.617+0000 7fc8b2a00640 1 -- 172.21.15.123:0/2123255846 >> v1:172.21.15.164:6789/0 conn(0x7fc8b4148420 legacy=0x7fc8b413e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:21.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.617+0000 7fc8b2a00640 1 -- 172.21.15.123:0/2123255846 >> v1:172.21.15.123:6789/0 conn(0x7fc8b413eaf0 legacy=0x7fc8b414f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:21.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.617+0000 7fc8b2a00640 1 -- 172.21.15.123:0/2123255846 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b40b41a0 con 0x7fc8b40b3dc0 2024-04-17T05:27:21.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.617+0000 7fc8b1600640 1 -- 172.21.15.123:0/2123255846 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2235543596 0 0) 0x7fc8b40b5910 con 0x7fc8b413eaf0 2024-04-17T05:27:21.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.619+0000 7fc8b2a00640 1 --2- 172.21.15.123:0/2123255846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8b40b3dc0 0x7fc8b4147ee0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc8b40b5680 tx=0x7fc8a402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f97e4c7fbfb2dee server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:21.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.619+0000 7fc8b1600640 1 -- 172.21.15.123:0/2123255846 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4035020 con 0x7fc8b40b3dc0 2024-04-17T05:27:21.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.619+0000 7fc8b1600640 1 -- 172.21.15.123:0/2123255846 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8a4031830 con 0x7fc8b40b3dc0 2024-04-17T05:27:21.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.619+0000 7fc8b1600640 1 -- 172.21.15.123:0/2123255846 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4031c00 con 0x7fc8b40b3dc0 2024-04-17T05:27:21.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.619+0000 7fc8b3e00640 1 -- 172.21.15.123:0/2123255846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8b40b3dc0 msgr2=0x7fc8b4147ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:21.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.619+0000 7fc8b3e00640 1 --2- 172.21.15.123:0/2123255846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8b40b3dc0 0x7fc8b4147ee0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc8b40b5680 tx=0x7fc8a402b8d0 comp rx=0 tx=0).stop 2024-04-17T05:27:21.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.620+0000 7fc8b3e00640 1 -- 172.21.15.123:0/2123255846 shutdown_connections 2024-04-17T05:27:21.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.620+0000 7fc8b3e00640 1 --2- 172.21.15.123:0/2123255846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8b40b3dc0 0x7fc8b4147ee0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:21.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.620+0000 7fc8b3e00640 1 -- 172.21.15.123:0/2123255846 >> 172.21.15.123:0/2123255846 conn(0x7fc8b40b9150 msgr2=0x7fc8b40b9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:21.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.620+0000 7fc8b3e00640 1 -- 172.21.15.123:0/2123255846 shutdown_connections 2024-04-17T05:27:21.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.620+0000 7fc8b3e00640 1 -- 172.21.15.123:0/2123255846 wait complete. 2024-04-17T05:27:21.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.621+0000 7fc8b3e00640 1 Processor -- start 2024-04-17T05:27:21.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.621+0000 7fc8b3e00640 1 -- start start 2024-04-17T05:27:21.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.622+0000 7fc8b3e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8b40b3dc0 0x7fc8b41ce340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:21.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.622+0000 7fc8b3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8b413eaf0 0x7fc8b41db270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:21.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.622+0000 7fc8b3e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc8b4148420 0x7fc8b41db7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:21.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.622+0000 7fc8b3e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b40b2ed0 con 0x7fc8b40b3dc0 2024-04-17T05:27:21.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.622+0000 7fc8b3e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b40708c0 con 0x7fc8b413eaf0 2024-04-17T05:27:21.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.622+0000 7fc8b3e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fc8b40b1b10 con 0x7fc8b4148420 2024-04-17T05:27:21.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.622+0000 7fc8b2a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8b40b3dc0 0x7fc8b41ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:21.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.622+0000 7fc8b2a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8b40b3dc0 0x7fc8b41ce340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38062/0 (socket says 172.21.15.123:38062) 2024-04-17T05:27:21.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.623+0000 7fc8b2a00640 1 -- 172.21.15.123:0/135859763 learned_addr learned my addr 172.21.15.123:0/135859763 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:21.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.623+0000 7fc8b2000640 1 --2- 172.21.15.123:0/135859763 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8b413eaf0 0x7fc8b41db270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:21.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.623+0000 7fc8b2a00640 1 -- 172.21.15.123:0/135859763 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc8b4148420 msgr2=0x7fc8b41db7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:21.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.623+0000 7fc8b2a00640 1 --2- 172.21.15.123:0/135859763 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc8b4148420 0x7fc8b41db7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:21.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.623+0000 7fc8b2a00640 1 -- 172.21.15.123:0/135859763 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8b413eaf0 msgr2=0x7fc8b41db270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:21.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.623+0000 7fc8b2a00640 1 --2- 172.21.15.123:0/135859763 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8b413eaf0 0x7fc8b41db270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:21.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.623+0000 7fc8b2a00640 1 -- 172.21.15.123:0/135859763 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b41d0b40 con 0x7fc8b40b3dc0 2024-04-17T05:27:21.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.623+0000 7fc8b2a00640 1 --2- 172.21.15.123:0/135859763 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8b40b3dc0 0x7fc8b41ce340 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4000c00 tx=0x7fc8a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:21.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.623+0000 7fc8aaa00640 1 -- 172.21.15.123:0/135859763 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a403a930 con 0x7fc8b40b3dc0 2024-04-17T05:27:21.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.624+0000 7fc8aaa00640 1 -- 172.21.15.123:0/135859763 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8a403aad0 con 0x7fc8b40b3dc0 2024-04-17T05:27:21.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.624+0000 7fc8aaa00640 1 -- 172.21.15.123:0/135859763 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a40443f0 con 0x7fc8b40b3dc0 2024-04-17T05:27:21.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.624+0000 7fc8b3e00640 1 -- 172.21.15.123:0/135859763 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b41cead0 con 0x7fc8b40b3dc0 2024-04-17T05:27:21.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.624+0000 7fc8b3e00640 1 -- 172.21.15.123:0/135859763 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b4141df0 con 0x7fc8b40b3dc0 2024-04-17T05:27:21.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.625+0000 7fc8b3e00640 1 -- 172.21.15.123:0/135859763 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8b40759b0 con 0x7fc8b40b3dc0 2024-04-17T05:27:21.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.626+0000 7fc8aaa00640 1 -- 172.21.15.123:0/135859763 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc8a4038020 con 0x7fc8b40b3dc0 2024-04-17T05:27:21.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.626+0000 7fc8aaa00640 1 --2- 172.21.15.123:0/135859763 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc89406c8f0 0x7fc89406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:21.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.627+0000 7fc8aaa00640 1 -- 172.21.15.123:0/135859763 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc8a40adc30 con 0x7fc8b40b3dc0 2024-04-17T05:27:21.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.627+0000 7fc8b2000640 1 --2- 172.21.15.123:0/135859763 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc89406c8f0 0x7fc89406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:21.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.628+0000 7fc8b2000640 1 --2- 172.21.15.123:0/135859763 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc89406c8f0 0x7fc89406edb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc8b41418e0 tx=0x7fc8a0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:21.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.631+0000 7fc8aaa00640 1 -- 172.21.15.123:0/135859763 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fc8a403f070 con 0x7fc8b40b3dc0 2024-04-17T05:27:21.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.884+0000 7fc8b3e00640 1 -- 172.21.15.123:0/135859763 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fc8b40b3290 con 0x7fc8b40b3dc0 2024-04-17T05:27:21.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.894+0000 7fc8aaa00640 1 -- 172.21.15.123:0/135859763 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174143 (secure 0 0 0) 0x7fc8a407bc90 con 0x7fc8b40b3dc0 2024-04-17T05:27:21.894 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:27:21.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.898+0000 7fc8b3e00640 1 -- 172.21.15.123:0/135859763 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc89406c8f0 msgr2=0x7fc89406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:21.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.898+0000 7fc8b3e00640 1 --2- 172.21.15.123:0/135859763 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc89406c8f0 0x7fc89406edb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc8b41418e0 tx=0x7fc8a0009040 comp rx=0 tx=0).stop 2024-04-17T05:27:21.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.898+0000 7fc8b3e00640 1 -- 172.21.15.123:0/135859763 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8b40b3dc0 msgr2=0x7fc8b41ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:21.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.898+0000 7fc8b3e00640 1 --2- 172.21.15.123:0/135859763 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8b40b3dc0 0x7fc8b41ce340 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4000c00 tx=0x7fc8a40046c0 comp rx=0 tx=0).stop 2024-04-17T05:27:21.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.898+0000 7fc8b3e00640 1 -- 172.21.15.123:0/135859763 shutdown_connections 2024-04-17T05:27:21.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.898+0000 7fc8b3e00640 1 --2- 172.21.15.123:0/135859763 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc89406c8f0 0x7fc89406edb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:21.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.898+0000 7fc8b3e00640 1 --2- 172.21.15.123:0/135859763 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc8b4148420 0x7fc8b41db7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:21.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.898+0000 7fc8b3e00640 1 --2- 172.21.15.123:0/135859763 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8b413eaf0 0x7fc8b41db270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:21.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.898+0000 7fc8b3e00640 1 --2- 172.21.15.123:0/135859763 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8b40b3dc0 0x7fc8b41ce340 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:21.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.898+0000 7fc8b3e00640 1 -- 172.21.15.123:0/135859763 >> 172.21.15.123:0/135859763 conn(0x7fc8b40b9150 msgr2=0x7fc8b413c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:21.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.898+0000 7fc8b3e00640 1 -- 172.21.15.123:0/135859763 shutdown_connections 2024-04-17T05:27:21.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:21.898+0000 7fc8b3e00640 1 -- 172.21.15.123:0/135859763 wait complete. 2024-04-17T05:27:21.916 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":4204006015},{"type":"v1","addr":"172.21.15.164:6833","nonce":4204006015}]},"active_addr":"172.21.15.164:6833/4204006015","active_change":"2024-04-17T05:26:38.274425+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.164:0","nonce":2472765290}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.164:0","nonce":2975324622}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.164:0","nonce":226476038}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.164:0","nonce":2880076966}]}]} 2024-04-17T05:27:21.920 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-17T05:27:21.920 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-17T05:27:21.920 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T05:27:22.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.132+0000 7f4c72a00640 1 Processor -- start 2024-04-17T05:27:22.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.132+0000 7f4c72a00640 1 -- start start 2024-04-17T05:27:22.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.133+0000 7f4c72a00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4c6c0ba6a0 0x7f4c6c0b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:22.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.134+0000 7f4c72a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4c6c0b9a80 0x7f4c6c147b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:22.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.134+0000 7f4c72a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4c6c141a00 0x7f4c6c141e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:22.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.134+0000 7f4c72a00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f4c6c0b5e10 con 0x7f4c6c0b9a80 2024-04-17T05:27:22.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.134+0000 7f4c72a00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f4c6c0b71d0 con 0x7f4c6c0ba6a0 2024-04-17T05:27:22.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.134+0000 7f4c72a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f4c6c0b57e0 con 0x7f4c6c141a00 2024-04-17T05:27:22.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.134+0000 7f4c70c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4c6c0b9a80 0x7f4c6c147b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:22.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.134+0000 7f4c70c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4c6c0b9a80 0x7f4c6c147b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38078/0 (socket says 172.21.15.123:38078) 2024-04-17T05:27:22.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.134+0000 7f4c70c00640 1 -- 172.21.15.123:0/2069060547 learned_addr learned my addr 172.21.15.123:0/2069060547 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:22.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.134+0000 7f4c71600640 1 --2- 172.21.15.123:0/2069060547 >> v2:172.21.15.164:3300/0 conn(0x7f4c6c0ba6a0 0x7f4c6c0b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:22.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.134+0000 7f4c70c00640 1 -- 172.21.15.123:0/2069060547 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4c6c141a00 msgr2=0x7f4c6c141e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:22.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.134+0000 7f4c70c00640 1 --2- 172.21.15.123:0/2069060547 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4c6c141a00 0x7f4c6c141e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:22.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.134+0000 7f4c70c00640 1 -- 172.21.15.123:0/2069060547 >> v2:172.21.15.164:3300/0 conn(0x7f4c6c0ba6a0 msgr2=0x7f4c6c0b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:22.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.134+0000 7f4c70c00640 1 --2- 172.21.15.123:0/2069060547 >> v2:172.21.15.164:3300/0 conn(0x7f4c6c0ba6a0 0x7f4c6c0b48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:22.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.134+0000 7f4c70c00640 1 -- 172.21.15.123:0/2069060547 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c6c0baa80 con 0x7f4c6c0b9a80 2024-04-17T05:27:22.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.134+0000 7f4c71600640 1 --2- 172.21.15.123:0/2069060547 >> v2:172.21.15.164:3300/0 conn(0x7f4c6c0ba6a0 0x7f4c6c0b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:22.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.136+0000 7f4c70c00640 1 --2- 172.21.15.123:0/2069060547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c6c0b9a80 0x7f4c6c147b30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c0be530 tx=0x7f4c5c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c12d46ec0526d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:22.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.136+0000 7f4c6be00640 1 -- 172.21.15.123:0/2069060547 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c02c9e0 con 0x7f4c6c0b9a80 2024-04-17T05:27:22.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.136+0000 7f4c6be00640 1 -- 172.21.15.123:0/2069060547 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c5c02cb80 con 0x7f4c6c0b9a80 2024-04-17T05:27:22.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.136+0000 7f4c6be00640 1 -- 172.21.15.123:0/2069060547 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c0343f0 con 0x7f4c6c0b9a80 2024-04-17T05:27:22.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.137+0000 7f4c72a00640 1 -- 172.21.15.123:0/2069060547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c6c0b9a80 msgr2=0x7f4c6c147b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:22.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.137+0000 7f4c72a00640 1 --2- 172.21.15.123:0/2069060547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c6c0b9a80 0x7f4c6c147b30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c0be530 tx=0x7f4c5c02be40 comp rx=0 tx=0).stop 2024-04-17T05:27:22.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.137+0000 7f4c72a00640 1 -- 172.21.15.123:0/2069060547 shutdown_connections 2024-04-17T05:27:22.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.137+0000 7f4c72a00640 1 --2- 172.21.15.123:0/2069060547 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4c6c141a00 0x7f4c6c141e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:22.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.137+0000 7f4c72a00640 1 --2- 172.21.15.123:0/2069060547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c6c0b9a80 0x7f4c6c147b30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:22.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.137+0000 7f4c72a00640 1 --2- 172.21.15.123:0/2069060547 >> v2:172.21.15.164:3300/0 conn(0x7f4c6c0ba6a0 0x7f4c6c0b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:22.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.137+0000 7f4c72a00640 1 -- 172.21.15.123:0/2069060547 >> 172.21.15.123:0/2069060547 conn(0x7f4c6c06bda0 msgr2=0x7f4c6c06c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:22.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.137+0000 7f4c72a00640 1 -- 172.21.15.123:0/2069060547 shutdown_connections 2024-04-17T05:27:22.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.137+0000 7f4c72a00640 1 -- 172.21.15.123:0/2069060547 wait complete. 2024-04-17T05:27:22.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.138+0000 7f4c72a00640 1 Processor -- start 2024-04-17T05:27:22.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.139+0000 7f4c72a00640 1 -- start start 2024-04-17T05:27:22.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.139+0000 7f4c72a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c6c0b9a80 0x7f4c6c13e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:22.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.139+0000 7f4c72a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4c6c0ba6a0 0x7f4c6c1cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:22.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.139+0000 7f4c72a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c6c141a00 0x7f4c6c0b3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:22.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.139+0000 7f4c72a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6c0b6420 con 0x7f4c6c141a00 2024-04-17T05:27:22.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.139+0000 7f4c72a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6c0b62a0 con 0x7f4c6c0b9a80 2024-04-17T05:27:22.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.139+0000 7f4c72a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f4c6c148070 con 0x7f4c6c0ba6a0 2024-04-17T05:27:22.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.140+0000 7f4c72000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c6c141a00 0x7f4c6c0b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:22.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.140+0000 7f4c72000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c6c141a00 0x7f4c6c0b3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38084/0 (socket says 172.21.15.123:38084) 2024-04-17T05:27:22.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.140+0000 7f4c72000640 1 -- 172.21.15.123:0/4129368092 learned_addr learned my addr 172.21.15.123:0/4129368092 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:22.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.140+0000 7f4c70c00640 1 --2- 172.21.15.123:0/4129368092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4c6c0ba6a0 0x7f4c6c1cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:22.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.140+0000 7f4c71600640 1 --2- 172.21.15.123:0/4129368092 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c6c0b9a80 0x7f4c6c13e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:22.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.140+0000 7f4c72000640 1 -- 172.21.15.123:0/4129368092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4c6c0ba6a0 msgr2=0x7f4c6c1cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:22.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.140+0000 7f4c72000640 1 --2- 172.21.15.123:0/4129368092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4c6c0ba6a0 0x7f4c6c1cdee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:22.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.140+0000 7f4c72000640 1 -- 172.21.15.123:0/4129368092 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c6c0b9a80 msgr2=0x7f4c6c13e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:22.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.140+0000 7f4c72000640 1 --2- 172.21.15.123:0/4129368092 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c6c0b9a80 0x7f4c6c13e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:22.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.140+0000 7f4c72000640 1 -- 172.21.15.123:0/4129368092 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c6c1cf8a0 con 0x7f4c6c141a00 2024-04-17T05:27:22.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.140+0000 7f4c70c00640 1 --2- 172.21.15.123:0/4129368092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4c6c0ba6a0 0x7f4c6c1cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:22.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.140+0000 7f4c71600640 1 --2- 172.21.15.123:0/4129368092 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c6c0b9a80 0x7f4c6c13e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:22.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.141+0000 7f4c72000640 1 --2- 172.21.15.123:0/4129368092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c6c141a00 0x7f4c6c0b3390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400b410 tx=0x7f4c6400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:22.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.141+0000 7f4c69600640 1 -- 172.21.15.123:0/4129368092 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c64015020 con 0x7f4c6c141a00 2024-04-17T05:27:22.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.141+0000 7f4c69600640 1 -- 172.21.15.123:0/4129368092 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c64011850 con 0x7f4c6c141a00 2024-04-17T05:27:22.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.141+0000 7f4c72a00640 1 -- 172.21.15.123:0/4129368092 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c6c1cf5c0 con 0x7f4c6c141a00 2024-04-17T05:27:22.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.141+0000 7f4c69600640 1 -- 172.21.15.123:0/4129368092 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c64011c40 con 0x7f4c6c141a00 2024-04-17T05:27:22.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.141+0000 7f4c72a00640 1 -- 172.21.15.123:0/4129368092 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c6c1ddcb0 con 0x7f4c6c141a00 2024-04-17T05:27:22.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.142+0000 7f4c72a00640 1 -- 172.21.15.123:0/4129368092 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c6c0759b0 con 0x7f4c6c141a00 2024-04-17T05:27:22.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.143+0000 7f4c69600640 1 -- 172.21.15.123:0/4129368092 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4c64018020 con 0x7f4c6c141a00 2024-04-17T05:27:22.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.144+0000 7f4c69600640 1 --2- 172.21.15.123:0/4129368092 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f4c5006c8f0 0x7f4c5006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:22.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.145+0000 7f4c69600640 1 -- 172.21.15.123:0/4129368092 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f4c6408bd10 con 0x7f4c6c141a00 2024-04-17T05:27:22.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.145+0000 7f4c71600640 1 --2- 172.21.15.123:0/4129368092 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f4c5006c8f0 0x7f4c5006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:22.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.146+0000 7f4c71600640 1 --2- 172.21.15.123:0/4129368092 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f4c5006c8f0 0x7f4c5006edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c140550 tx=0x7f4c60008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:22.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.149+0000 7f4c69600640 1 -- 172.21.15.123:0/4129368092 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f4c64091020 con 0x7f4c6c141a00 2024-04-17T05:27:22.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.351+0000 7f4c72a00640 1 -- 172.21.15.123:0/4129368092 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4c6c145b40 con 0x7f4c6c141a00 2024-04-17T05:27:22.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.354+0000 7f4c69600640 1 -- 172.21.15.123:0/4129368092 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18526 (secure 0 0 0) 0x7f4c6401f020 con 0x7f4c6c141a00 2024-04-17T05:27:22.352 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:27:22.352 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":26,"fsid":"0787c5c0-e77a-4102-a899-30db48b19c68","created":"2024-04-17T05:26:33.031507+0000","modified":"2024-04-17T05:26:57.743352+0000","last_up_change":"2024-04-17T05:26:44.988433+0000","last_in_change":"2024-04-17T05:26:36.682131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T05:26:46.329778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T05:26:50.600195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T05:26:51.626498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T05:26:55.264044+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15c87cdb-9415-45a6-a2a6-ea6bec9daece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6801","nonce":840753170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6803","nonce":840753170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6807","nonce":840753170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6805","nonce":840753170}]},"public_addr":"172.21.15.123:6801/840753170","cluster_addr":"172.21.15.123:6803/840753170","heartbeat_back_addr":"172.21.15.123:6807/840753170","heartbeat_front_addr":"172.21.15.123:6805/840753170","state":["exists","up"]},{"osd":1,"uuid":"281751b5-486d-4845-b4aa-b308bf7cec62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6822","nonce":2231878927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6827","nonce":2231878927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6831","nonce":2231878927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6829","nonce":2231878927}]},"public_addr":"172.21.15.123:6822/2231878927","cluster_addr":"172.21.15.123:6827/2231878927","heartbeat_back_addr":"172.21.15.123:6831/2231878927","heartbeat_front_addr":"172.21.15.123:6829/2231878927","state":["exists","up"]},{"osd":2,"uuid":"b42257d3-bd20-4db5-aa37-1bf5c512d0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6817","nonce":754360844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6820","nonce":754360844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6825","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6826","nonce":754360844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6823","nonce":754360844}]},"public_addr":"172.21.15.123:6817/754360844","cluster_addr":"172.21.15.123:6820/754360844","heartbeat_back_addr":"172.21.15.123:6826/754360844","heartbeat_front_addr":"172.21.15.123:6823/754360844","state":["exists","up"]},{"osd":3,"uuid":"0f26b891-bbe6-478e-8dee-78e69bb48cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6809","nonce":2898088574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6811","nonce":2898088574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6815","nonce":2898088574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6813","nonce":2898088574}]},"public_addr":"172.21.15.123:6809/2898088574","cluster_addr":"172.21.15.123:6811/2898088574","heartbeat_back_addr":"172.21.15.123:6815/2898088574","heartbeat_front_addr":"172.21.15.123:6813/2898088574","state":["exists","up"]},{"osd":4,"uuid":"43e59318-2740-4625-9d64-eec1fd43c322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6801","nonce":606484349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6804","nonce":606484349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6812","nonce":606484349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6808","nonce":606484349}]},"public_addr":"172.21.15.164:6801/606484349","cluster_addr":"172.21.15.164:6804/606484349","heartbeat_back_addr":"172.21.15.164:6812/606484349","heartbeat_front_addr":"172.21.15.164:6808/606484349","state":["exists","up"]},{"osd":5,"uuid":"aaa3acf4-4adc-4337-aba3-363851d35310","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6805","nonce":1376989593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6809","nonce":1376989593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6815","nonce":1376989593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6813","nonce":1376989593}]},"public_addr":"172.21.15.164:6805/1376989593","cluster_addr":"172.21.15.164:6809/1376989593","heartbeat_back_addr":"172.21.15.164:6815/1376989593","heartbeat_front_addr":"172.21.15.164:6813/1376989593","state":["exists","up"]},{"osd":6,"uuid":"6f765b27-7377-4d81-9192-23a965651145","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6817","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6821","nonce":1594306924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6823","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6826","nonce":1594306924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6831","nonce":1594306924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6829","nonce":1594306924}]},"public_addr":"172.21.15.164:6821/1594306924","cluster_addr":"172.21.15.164:6826/1594306924","heartbeat_back_addr":"172.21.15.164:6831/1594306924","heartbeat_front_addr":"172.21.15.164:6829/1594306924","state":["exists","up"]},{"osd":7,"uuid":"5547394b-ec2f-4311-846d-369af4b1acf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6818","nonce":295402697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6819","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6820","nonce":295402697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6825","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6827","nonce":295402697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6824","nonce":295402697}]},"public_addr":"172.21.15.164:6818/295402697","cluster_addr":"172.21.15.164:6820/295402697","heartbeat_back_addr":"172.21.15.164:6827/295402697","heartbeat_front_addr":"172.21.15.164:6824/295402697","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.034807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.022201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.751897+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.850533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.083608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.047524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.314753+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.413586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T05:27:22.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.356+0000 7f4c72a00640 1 -- 172.21.15.123:0/4129368092 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f4c5006c8f0 msgr2=0x7f4c5006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:22.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.356+0000 7f4c72a00640 1 --2- 172.21.15.123:0/4129368092 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f4c5006c8f0 0x7f4c5006edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c140550 tx=0x7f4c60008040 comp rx=0 tx=0).stop 2024-04-17T05:27:22.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.356+0000 7f4c72a00640 1 -- 172.21.15.123:0/4129368092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c6c141a00 msgr2=0x7f4c6c0b3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:22.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.356+0000 7f4c72a00640 1 --2- 172.21.15.123:0/4129368092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c6c141a00 0x7f4c6c0b3390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400b410 tx=0x7f4c6400b8d0 comp rx=0 tx=0).stop 2024-04-17T05:27:22.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.356+0000 7f4c72a00640 1 -- 172.21.15.123:0/4129368092 shutdown_connections 2024-04-17T05:27:22.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.356+0000 7f4c72a00640 1 --2- 172.21.15.123:0/4129368092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c6c141a00 0x7f4c6c0b3390 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:22.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.356+0000 7f4c72a00640 1 --2- 172.21.15.123:0/4129368092 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f4c5006c8f0 0x7f4c5006edb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:22.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.356+0000 7f4c72a00640 1 --2- 172.21.15.123:0/4129368092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4c6c0ba6a0 0x7f4c6c1cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:22.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.356+0000 7f4c72a00640 1 --2- 172.21.15.123:0/4129368092 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c6c0b9a80 0x7f4c6c13e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:22.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.356+0000 7f4c72a00640 1 -- 172.21.15.123:0/4129368092 >> 172.21.15.123:0/4129368092 conn(0x7f4c6c06bda0 msgr2=0x7f4c6c140850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:22.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.357+0000 7f4c72a00640 1 -- 172.21.15.123:0/4129368092 shutdown_connections 2024-04-17T05:27:22.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.357+0000 7f4c72a00640 1 -- 172.21.15.123:0/4129368092 wait complete. 2024-04-17T05:27:22.375 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-17T05:27:22.375 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T05:27:22.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.586+0000 7f677a400640 1 Processor -- start 2024-04-17T05:27:22.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.587+0000 7f677a400640 1 -- start start 2024-04-17T05:27:22.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.588+0000 7f677a400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f67740ba6a0 0x7f67740b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:22.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.588+0000 7f677a400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6774148240 con 0x7f6774141a00 2024-04-17T05:27:22.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.588+0000 7f677a400640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67740b57e0 con 0x7f67740b9a80 2024-04-17T05:27:22.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.588+0000 7f677a400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f67740b5e10 con 0x7f67740ba6a0 2024-04-17T05:27:22.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.588+0000 7f6779000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f67740ba6a0 0x7f67740b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:22.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.588+0000 7f6779000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f67740ba6a0 0x7f67740b48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38100/0 (socket says 172.21.15.123:38100) 2024-04-17T05:27:22.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.588+0000 7f6779000640 1 -- 172.21.15.123:0/216870688 learned_addr learned my addr 172.21.15.123:0/216870688 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:22.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.588+0000 7f6779a00640 1 --1- 172.21.15.123:0/216870688 >> v1:172.21.15.123:6789/0 conn(0x7f6774141a00 0x7f6774152450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54918/0 (socket says 172.21.15.123:54918) 2024-04-17T05:27:22.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.589+0000 7f6779000640 1 -- 172.21.15.123:0/216870688 >> v1:172.21.15.164:6789/0 conn(0x7f67740b9a80 legacy=0x7f6774147b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:22.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.589+0000 7f6779000640 1 -- 172.21.15.123:0/216870688 >> v1:172.21.15.123:6789/0 conn(0x7f6774141a00 legacy=0x7f6774152450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:22.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.589+0000 7f6779000640 1 -- 172.21.15.123:0/216870688 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67740baa80 con 0x7f67740ba6a0 2024-04-17T05:27:22.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.590+0000 7f6779000640 1 --2- 172.21.15.123:0/216870688 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67740ba6a0 0x7f67740b48f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f67740b5f90 tx=0x7f676402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8cea3afc9baad5 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:22.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.590+0000 7f6773400640 1 -- 172.21.15.123:0/216870688 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6764035020 con 0x7f67740ba6a0 2024-04-17T05:27:22.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.590+0000 7f6773400640 1 -- 172.21.15.123:0/216870688 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6764031640 con 0x7f67740ba6a0 2024-04-17T05:27:22.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.590+0000 7f6773400640 1 -- 172.21.15.123:0/216870688 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676402d040 con 0x7f67740ba6a0 2024-04-17T05:27:22.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.591+0000 7f677a400640 1 -- 172.21.15.123:0/216870688 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67740ba6a0 msgr2=0x7f67740b48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:22.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.591+0000 7f677a400640 1 --2- 172.21.15.123:0/216870688 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67740ba6a0 0x7f67740b48f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f67740b5f90 tx=0x7f676402b8f0 comp rx=0 tx=0).stop 2024-04-17T05:27:22.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.591+0000 7f677a400640 1 -- 172.21.15.123:0/216870688 shutdown_connections 2024-04-17T05:27:22.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.591+0000 7f677a400640 1 --2- 172.21.15.123:0/216870688 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67740ba6a0 0x7f67740b48f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:22.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.591+0000 7f677a400640 1 -- 172.21.15.123:0/216870688 >> 172.21.15.123:0/216870688 conn(0x7f677406bda0 msgr2=0x7f677406c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:22.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.591+0000 7f677a400640 1 -- 172.21.15.123:0/216870688 shutdown_connections 2024-04-17T05:27:22.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.591+0000 7f677a400640 1 -- 172.21.15.123:0/216870688 wait complete. 2024-04-17T05:27:22.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.593+0000 7f677a400640 1 Processor -- start 2024-04-17T05:27:22.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.593+0000 7f677a400640 1 -- start start 2024-04-17T05:27:22.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.594+0000 7f677a400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f67740b9a80 0x7f67740b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:22.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.594+0000 7f677a400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67740ba6a0 0x7f67741dd590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:22.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.594+0000 7f677a400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6774141a00 0x7f67741d2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:22.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.594+0000 7f677a400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f67740b62a0 con 0x7f67740ba6a0 2024-04-17T05:27:22.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.594+0000 7f677a400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f67740b71d0 con 0x7f6774141a00 2024-04-17T05:27:22.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.594+0000 7f677a400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f67740b6420 con 0x7f67740b9a80 2024-04-17T05:27:22.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.594+0000 7f6773e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67740ba6a0 0x7f67741dd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:22.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.594+0000 7f6773e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67740ba6a0 0x7f67741dd590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38110/0 (socket says 172.21.15.123:38110) 2024-04-17T05:27:22.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.594+0000 7f6773e00640 1 -- 172.21.15.123:0/1603780937 learned_addr learned my addr 172.21.15.123:0/1603780937 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:22.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.594+0000 7f6779a00640 1 --2- 172.21.15.123:0/1603780937 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6774141a00 0x7f67741d2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:22.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.594+0000 7f6779000640 1 --2- 172.21.15.123:0/1603780937 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f67740b9a80 0x7f67740b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:22.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.594+0000 7f6773e00640 1 -- 172.21.15.123:0/1603780937 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f67740b9a80 msgr2=0x7f67740b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:22.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.594+0000 7f6773e00640 1 --2- 172.21.15.123:0/1603780937 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f67740b9a80 0x7f67740b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:22.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.594+0000 7f6773e00640 1 -- 172.21.15.123:0/1603780937 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6774141a00 msgr2=0x7f67741d2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:22.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.594+0000 7f6773e00640 1 --2- 172.21.15.123:0/1603780937 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6774141a00 0x7f67741d2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:22.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.594+0000 7f6773e00640 1 -- 172.21.15.123:0/1603780937 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67741ce3b0 con 0x7f67740ba6a0 2024-04-17T05:27:22.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.594+0000 7f6779000640 1 --2- 172.21.15.123:0/1603780937 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f67740b9a80 0x7f67740b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:22.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.594+0000 7f6779a00640 1 --2- 172.21.15.123:0/1603780937 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6774141a00 0x7f67741d2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:22.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.595+0000 7f6773e00640 1 --2- 172.21.15.123:0/1603780937 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67740ba6a0 0x7f67741dd590 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f676000b3f0 tx=0x7f676000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:22.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.595+0000 7f6770c00640 1 -- 172.21.15.123:0/1603780937 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6760015020 con 0x7f67740ba6a0 2024-04-17T05:27:22.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.595+0000 7f6770c00640 1 -- 172.21.15.123:0/1603780937 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6760011830 con 0x7f67740ba6a0 2024-04-17T05:27:22.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.595+0000 7f6770c00640 1 -- 172.21.15.123:0/1603780937 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6760011c20 con 0x7f67740ba6a0 2024-04-17T05:27:22.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.595+0000 7f677a400640 1 -- 172.21.15.123:0/1603780937 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67741cf940 con 0x7f67740ba6a0 2024-04-17T05:27:22.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.595+0000 7f677a400640 1 -- 172.21.15.123:0/1603780937 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67741cdd70 con 0x7f67740ba6a0 2024-04-17T05:27:22.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.596+0000 7f677a400640 1 -- 172.21.15.123:0/1603780937 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67740759b0 con 0x7f67740ba6a0 2024-04-17T05:27:22.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.597+0000 7f6770c00640 1 -- 172.21.15.123:0/1603780937 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6760018020 con 0x7f67740ba6a0 2024-04-17T05:27:22.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.598+0000 7f6770c00640 1 --2- 172.21.15.123:0/1603780937 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f675406c8f0 0x7f675406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:22.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.598+0000 7f6770c00640 1 -- 172.21.15.123:0/1603780937 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f676008ba50 con 0x7f67740ba6a0 2024-04-17T05:27:22.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.599+0000 7f6779000640 1 --2- 172.21.15.123:0/1603780937 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f675406c8f0 0x7f675406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:22.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.600+0000 7f6779000640 1 --2- 172.21.15.123:0/1603780937 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f675406c8f0 0x7f675406edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6764036000 tx=0x7f6764008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:22.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.603+0000 7f6770c00640 1 -- 172.21.15.123:0/1603780937 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f676001f030 con 0x7f67740ba6a0 2024-04-17T05:27:22.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.806+0000 7f677a400640 1 -- 172.21.15.123:0/1603780937 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f67740b2670 con 0x7f67740ba6a0 2024-04-17T05:27:22.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.808+0000 7f6770c00640 1 -- 172.21.15.123:0/1603780937 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18526 (secure 0 0 0) 0x7f67600172c0 con 0x7f67740ba6a0 2024-04-17T05:27:22.807 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:27:22.807 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":26,"fsid":"0787c5c0-e77a-4102-a899-30db48b19c68","created":"2024-04-17T05:26:33.031507+0000","modified":"2024-04-17T05:26:57.743352+0000","last_up_change":"2024-04-17T05:26:44.988433+0000","last_in_change":"2024-04-17T05:26:36.682131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T05:26:46.329778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T05:26:50.600195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T05:26:51.626498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T05:26:55.264044+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15c87cdb-9415-45a6-a2a6-ea6bec9daece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6801","nonce":840753170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6803","nonce":840753170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6807","nonce":840753170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6805","nonce":840753170}]},"public_addr":"172.21.15.123:6801/840753170","cluster_addr":"172.21.15.123:6803/840753170","heartbeat_back_addr":"172.21.15.123:6807/840753170","heartbeat_front_addr":"172.21.15.123:6805/840753170","state":["exists","up"]},{"osd":1,"uuid":"281751b5-486d-4845-b4aa-b308bf7cec62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6822","nonce":2231878927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6827","nonce":2231878927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6831","nonce":2231878927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6829","nonce":2231878927}]},"public_addr":"172.21.15.123:6822/2231878927","cluster_addr":"172.21.15.123:6827/2231878927","heartbeat_back_addr":"172.21.15.123:6831/2231878927","heartbeat_front_addr":"172.21.15.123:6829/2231878927","state":["exists","up"]},{"osd":2,"uuid":"b42257d3-bd20-4db5-aa37-1bf5c512d0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6817","nonce":754360844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6820","nonce":754360844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6825","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6826","nonce":754360844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6823","nonce":754360844}]},"public_addr":"172.21.15.123:6817/754360844","cluster_addr":"172.21.15.123:6820/754360844","heartbeat_back_addr":"172.21.15.123:6826/754360844","heartbeat_front_addr":"172.21.15.123:6823/754360844","state":["exists","up"]},{"osd":3,"uuid":"0f26b891-bbe6-478e-8dee-78e69bb48cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6809","nonce":2898088574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6811","nonce":2898088574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6815","nonce":2898088574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6813","nonce":2898088574}]},"public_addr":"172.21.15.123:6809/2898088574","cluster_addr":"172.21.15.123:6811/2898088574","heartbeat_back_addr":"172.21.15.123:6815/2898088574","heartbeat_front_addr":"172.21.15.123:6813/2898088574","state":["exists","up"]},{"osd":4,"uuid":"43e59318-2740-4625-9d64-eec1fd43c322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6801","nonce":606484349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6804","nonce":606484349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6812","nonce":606484349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6808","nonce":606484349}]},"public_addr":"172.21.15.164:6801/606484349","cluster_addr":"172.21.15.164:6804/606484349","heartbeat_back_addr":"172.21.15.164:6812/606484349","heartbeat_front_addr":"172.21.15.164:6808/606484349","state":["exists","up"]},{"osd":5,"uuid":"aaa3acf4-4adc-4337-aba3-363851d35310","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6805","nonce":1376989593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6809","nonce":1376989593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6815","nonce":1376989593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6813","nonce":1376989593}]},"public_addr":"172.21.15.164:6805/1376989593","cluster_addr":"172.21.15.164:6809/1376989593","heartbeat_back_addr":"172.21.15.164:6815/1376989593","heartbeat_front_addr":"172.21.15.164:6813/1376989593","state":["exists","up"]},{"osd":6,"uuid":"6f765b27-7377-4d81-9192-23a965651145","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6817","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6821","nonce":1594306924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6823","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6826","nonce":1594306924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6831","nonce":1594306924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6829","nonce":1594306924}]},"public_addr":"172.21.15.164:6821/1594306924","cluster_addr":"172.21.15.164:6826/1594306924","heartbeat_back_addr":"172.21.15.164:6831/1594306924","heartbeat_front_addr":"172.21.15.164:6829/1594306924","state":["exists","up"]},{"osd":7,"uuid":"5547394b-ec2f-4311-846d-369af4b1acf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6818","nonce":295402697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6819","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6820","nonce":295402697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6825","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6827","nonce":295402697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6824","nonce":295402697}]},"public_addr":"172.21.15.164:6818/295402697","cluster_addr":"172.21.15.164:6820/295402697","heartbeat_back_addr":"172.21.15.164:6827/295402697","heartbeat_front_addr":"172.21.15.164:6824/295402697","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.034807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.022201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.751897+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.850533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.083608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.047524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.314753+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.413586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T05:27:22.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.811+0000 7f677a400640 1 -- 172.21.15.123:0/1603780937 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f675406c8f0 msgr2=0x7f675406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:22.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.811+0000 7f677a400640 1 --2- 172.21.15.123:0/1603780937 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f675406c8f0 0x7f675406edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6764036000 tx=0x7f6764008030 comp rx=0 tx=0).stop 2024-04-17T05:27:22.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.811+0000 7f677a400640 1 -- 172.21.15.123:0/1603780937 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67740ba6a0 msgr2=0x7f67741dd590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:22.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.811+0000 7f677a400640 1 --2- 172.21.15.123:0/1603780937 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67740ba6a0 0x7f67741dd590 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f676000b3f0 tx=0x7f676000b8b0 comp rx=0 tx=0).stop 2024-04-17T05:27:22.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.811+0000 7f677a400640 1 -- 172.21.15.123:0/1603780937 shutdown_connections 2024-04-17T05:27:22.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.811+0000 7f677a400640 1 --2- 172.21.15.123:0/1603780937 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6774141a00 0x7f67741d2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:22.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.811+0000 7f677a400640 1 --2- 172.21.15.123:0/1603780937 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67740ba6a0 0x7f67741dd590 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:22.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.811+0000 7f677a400640 1 --2- 172.21.15.123:0/1603780937 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f675406c8f0 0x7f675406edb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:22.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.811+0000 7f677a400640 1 --2- 172.21.15.123:0/1603780937 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f67740b9a80 0x7f67740b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:22.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.811+0000 7f677a400640 1 -- 172.21.15.123:0/1603780937 >> 172.21.15.123:0/1603780937 conn(0x7f677406bda0 msgr2=0x7f67740bd460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:22.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.811+0000 7f677a400640 1 -- 172.21.15.123:0/1603780937 shutdown_connections 2024-04-17T05:27:22.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:22.811+0000 7f677a400640 1 -- 172.21.15.123:0/1603780937 wait complete. 2024-04-17T05:27:22.828 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-17T05:27:22.828 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-17T05:27:22.829 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-17T05:27:22.829 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-17T05:27:22.830 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-17T05:27:22.830 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-17T05:27:22.830 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-17T05:27:22.831 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-17T05:27:23.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.128+0000 7f8daa400640 1 Processor -- start 2024-04-17T05:27:23.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.128+0000 7f8daa400640 1 -- start start 2024-04-17T05:27:23.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.130+0000 7f8daa400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8d9c007fe0 0x7f8d9c0d12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.130+0000 7f8daa400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d9c0ce5c0 con 0x7f8d9c00c350 2024-04-17T05:27:23.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.130+0000 7f8daa400640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d9c00c730 con 0x7f8d9c0d17e0 2024-04-17T05:27:23.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.130+0000 7f8daa400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f8d9c0d0b30 con 0x7f8d9c007fe0 2024-04-17T05:27:23.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.131+0000 7f8da3e00640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f8d9c0d17e0 0x7f8d9c0db3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.123:48020/0 (socket says 172.21.15.123:48020) 2024-04-17T05:27:23.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.131+0000 7f8da3e00640 1 -- 172.21.15.123:0/754683321 learned_addr learned my addr 172.21.15.123:0/754683321 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:27:23.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.131+0000 7f8da2a00640 1 --2- 172.21.15.123:0/754683321 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8d9c007fe0 0x7f8d9c0d12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.132+0000 7f8da2a00640 1 -- 172.21.15.123:0/754683321 >> v1:172.21.15.164:6789/0 conn(0x7f8d9c0d17e0 legacy=0x7f8d9c0db3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.132+0000 7f8da2a00640 1 -- 172.21.15.123:0/754683321 >> v1:172.21.15.123:6789/0 conn(0x7f8d9c00c350 legacy=0x7f8d9c03ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.132+0000 7f8da2a00640 1 -- 172.21.15.123:0/754683321 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d9c01d400 con 0x7f8d9c007fe0 2024-04-17T05:27:23.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.134+0000 7f8da2a00640 1 --2- 172.21.15.123:0/754683321 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8d9c007fe0 0x7f8d9c0d12a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8da4000b60 tx=0x7f8da40a7040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdfd627014a0d618 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.134+0000 7f8da2000640 1 -- 172.21.15.123:0/754683321 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da40b4070 con 0x7f8d9c007fe0 2024-04-17T05:27:23.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.135+0000 7f8da2000640 1 -- 172.21.15.123:0/754683321 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8da40af440 con 0x7f8d9c007fe0 2024-04-17T05:27:23.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.135+0000 7f8da2000640 1 -- 172.21.15.123:0/754683321 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da40af8b0 con 0x7f8d9c007fe0 2024-04-17T05:27:23.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.136+0000 7f8daa400640 1 -- 172.21.15.123:0/754683321 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8d9c007fe0 msgr2=0x7f8d9c0d12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.136+0000 7f8daa400640 1 --2- 172.21.15.123:0/754683321 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8d9c007fe0 0x7f8d9c0d12a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8da4000b60 tx=0x7f8da40a7040 comp rx=0 tx=0).stop 2024-04-17T05:27:23.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.136+0000 7f8daa400640 1 -- 172.21.15.123:0/754683321 shutdown_connections 2024-04-17T05:27:23.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.136+0000 7f8daa400640 1 --2- 172.21.15.123:0/754683321 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8d9c007fe0 0x7f8d9c0d12a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.136+0000 7f8daa400640 1 -- 172.21.15.123:0/754683321 >> 172.21.15.123:0/754683321 conn(0x7f8d9c00b5c0 msgr2=0x7f8d9c00b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:23.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.136+0000 7f8daa400640 1 -- 172.21.15.123:0/754683321 shutdown_connections 2024-04-17T05:27:23.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.136+0000 7f8daa400640 1 -- 172.21.15.123:0/754683321 wait complete. 2024-04-17T05:27:23.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.139+0000 7f2fe6800640 1 Processor -- start 2024-04-17T05:27:23.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.139+0000 7f2fe6800640 1 -- start start 2024-04-17T05:27:23.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.139+0000 7f8daa400640 1 Processor -- start 2024-04-17T05:27:23.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.141+0000 7f8daa400640 1 -- start start 2024-04-17T05:27:23.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.142+0000 7f8daa400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d9c007fe0 0x7f8d9c039170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.142+0000 7f8daa400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8d9c00c350 0x7f8d9c035aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.142+0000 7f8daa400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8d9c0d17e0 0x7f8d9c16a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.142+0000 7f8daa400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9c03c190 con 0x7f8d9c007fe0 2024-04-17T05:27:23.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.142+0000 7f8daa400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9c009720 con 0x7f8d9c0d17e0 2024-04-17T05:27:23.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.142+0000 7f8daa400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f8d9c008710 con 0x7f8d9c00c350 2024-04-17T05:27:23.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.141+0000 7f2fe6800640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2fe00b1ed0 0x7f2fe00b7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.141+0000 7f2fe6800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2fe00b22b0 0x7f2fe00b9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.141+0000 7f2fe6800640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fe00b77c0 con 0x7f2fe00b96a0 2024-04-17T05:27:23.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.141+0000 7f2fe6800640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f2fe00b3750 con 0x7f2fe00b1ed0 2024-04-17T05:27:23.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.141+0000 7f2fe6800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe00b3980 con 0x7f2fe00b22b0 2024-04-17T05:27:23.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.142+0000 7f2fe5400640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2fe00b1ed0 0x7f2fe00b7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.142+0000 7f2fe5400640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2fe00b1ed0 0x7f2fe00b7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.123:44500/0 (socket says 172.21.15.123:44500) 2024-04-17T05:27:23.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.142+0000 7f2fe5400640 1 -- 172.21.15.123:0/3896288921 learned_addr learned my addr 172.21.15.123:0/3896288921 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:23.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.142+0000 7f2fe4a00640 1 --2- 172.21.15.123:0/3896288921 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2fe00b22b0 0x7f2fe00b9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.143+0000 7f8da3400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d9c007fe0 0x7f8d9c039170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.143+0000 7f8da3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8d9c0d17e0 0x7f8d9c16a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.143+0000 7f8da3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8d9c0d17e0 0x7f8d9c16a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.123:44512/0 (socket says 172.21.15.123:44512) 2024-04-17T05:27:23.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.143+0000 7f8da3e00640 1 -- 172.21.15.123:0/351795114 learned_addr learned my addr 172.21.15.123:0/351795114 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:23.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.143+0000 7f8da2a00640 1 --2- 172.21.15.123:0/351795114 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8d9c00c350 0x7f8d9c035aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.144+0000 7f2fe4a00640 1 -- 172.21.15.123:0/3896288921 >> v2:172.21.15.164:3300/0 conn(0x7f2fe00b1ed0 msgr2=0x7f2fe00b7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:23.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.144+0000 7f2fe4a00640 1 --2- 172.21.15.123:0/3896288921 >> v2:172.21.15.164:3300/0 conn(0x7f2fe00b1ed0 0x7f2fe00b7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.144+0000 7f2fe4a00640 1 -- 172.21.15.123:0/3896288921 >> v1:172.21.15.164:6789/0 conn(0x7f2fe00b96a0 legacy=0x7f2fe014c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.144+0000 7f2fe4a00640 1 -- 172.21.15.123:0/3896288921 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe00b3c60 con 0x7f2fe00b22b0 2024-04-17T05:27:23.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.144+0000 7f8da3400640 1 -- 172.21.15.123:0/351795114 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8d9c00c350 msgr2=0x7f8d9c035aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.144+0000 7f8da3400640 1 --2- 172.21.15.123:0/351795114 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8d9c00c350 0x7f8d9c035aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.144+0000 7f8da3400640 1 -- 172.21.15.123:0/351795114 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8d9c0d17e0 msgr2=0x7f8d9c16a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.144+0000 7f8da3400640 1 --2- 172.21.15.123:0/351795114 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8d9c0d17e0 0x7f8d9c16a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.144+0000 7f8da3400640 1 -- 172.21.15.123:0/351795114 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d9c158230 con 0x7f8d9c007fe0 2024-04-17T05:27:23.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.145+0000 7f8da3e00640 1 --2- 172.21.15.123:0/351795114 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8d9c0d17e0 0x7f8d9c16a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T05:27:23.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.146+0000 7f2fe4a00640 1 --2- 172.21.15.123:0/3896288921 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2fe00b22b0 0x7f2fe00b9160 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc0097a0 tx=0x7f2fcc02b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dba698e7be8dc06 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.146+0000 7f8da3400640 1 --2- 172.21.15.123:0/351795114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d9c007fe0 0x7f8d9c039170 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8d9000c780 tx=0x7f8d9000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.147+0000 7f8d97400640 1 -- 172.21.15.123:0/351795114 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d900050d0 con 0x7f8d9c007fe0 2024-04-17T05:27:23.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.147+0000 7f2fdfe00640 1 -- 172.21.15.123:0/3896288921 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc031780 con 0x7f2fe00b22b0 2024-04-17T05:27:23.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.147+0000 7f8d97400640 1 -- 172.21.15.123:0/351795114 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d90005270 con 0x7f8d9c007fe0 2024-04-17T05:27:23.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.147+0000 7f2fdfe00640 1 -- 172.21.15.123:0/3896288921 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fcc037070 con 0x7f2fe00b22b0 2024-04-17T05:27:23.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.147+0000 7f2fdfe00640 1 -- 172.21.15.123:0/3896288921 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc031b40 con 0x7f2fe00b22b0 2024-04-17T05:27:23.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.147+0000 7f8d97400640 1 -- 172.21.15.123:0/351795114 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9000a880 con 0x7f8d9c007fe0 2024-04-17T05:27:23.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.147+0000 7f8daa400640 1 -- 172.21.15.123:0/351795114 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d9c156e90 con 0x7f8d9c007fe0 2024-04-17T05:27:23.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.147+0000 7f8daa400640 1 -- 172.21.15.123:0/351795114 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d9c157150 con 0x7f8d9c007fe0 2024-04-17T05:27:23.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.148+0000 7f2fe6800640 1 -- 172.21.15.123:0/3896288921 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2fe00b22b0 msgr2=0x7f2fe00b9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.148+0000 7f2fe6800640 1 --2- 172.21.15.123:0/3896288921 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2fe00b22b0 0x7f2fe00b9160 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc0097a0 tx=0x7f2fcc02b820 comp rx=0 tx=0).stop 2024-04-17T05:27:23.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.150+0000 7f8daa400640 1 -- 172.21.15.123:0/351795114 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8d80001030 con 0x7f8d9c007fe0 2024-04-17T05:27:23.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.150+0000 7f0719800640 1 Processor -- start 2024-04-17T05:27:23.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.150+0000 7f2fe6800640 1 -- 172.21.15.123:0/3896288921 shutdown_connections 2024-04-17T05:27:23.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.150+0000 7f2fe6800640 1 --2- 172.21.15.123:0/3896288921 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2fe00b22b0 0x7f2fe00b9160 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.150+0000 7f2fe6800640 1 --2- 172.21.15.123:0/3896288921 >> v2:172.21.15.164:3300/0 conn(0x7f2fe00b1ed0 0x7f2fe00b7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.150+0000 7f2fe6800640 1 -- 172.21.15.123:0/3896288921 >> 172.21.15.123:0/3896288921 conn(0x7f2fe006c260 msgr2=0x7f2fe00b9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:23.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.150+0000 7f0719800640 1 -- start start 2024-04-17T05:27:23.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.150+0000 7f8d97400640 1 -- 172.21.15.123:0/351795114 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8d9000aa20 con 0x7f8d9c007fe0 2024-04-17T05:27:23.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.150+0000 7f2fe6800640 1 -- 172.21.15.123:0/3896288921 shutdown_connections 2024-04-17T05:27:23.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.151+0000 7f2fe6800640 1 -- 172.21.15.123:0/3896288921 wait complete. 2024-04-17T05:27:23.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.151+0000 7f8d97400640 1 --2- 172.21.15.123:0/351795114 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8d8406c9c0 0x7f8d8406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.151+0000 7f8d97400640 1 -- 172.21.15.123:0/351795114 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f8d9008b8e0 con 0x7f8d9c007fe0 2024-04-17T05:27:23.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.152+0000 7f8d97400640 1 --2- 172.21.15.123:0/351795114 >> [v2:172.21.15.123:6800/840753170,v1:172.21.15.123:6801/840753170] conn(0x7f8d84076130 0x7f8d84078570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.152+0000 7f8d97400640 1 -- 172.21.15.123:0/351795114 --> [v2:172.21.15.123:6800/840753170,v1:172.21.15.123:6801/840753170] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8d90004ec0 con 0x7f8d84076130 2024-04-17T05:27:23.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.152+0000 7f8d97400640 1 -- 172.21.15.123:0/351795114 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8d900902a0 con 0x7f8d9c007fe0 2024-04-17T05:27:23.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.151+0000 7f0719800640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f071409b270 0x7f0714144030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.151+0000 7f0719800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f071409b6f0 0x7f0714144570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.152+0000 7f0719800640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07140b0450 con 0x7f071409aa50 2024-04-17T05:27:23.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.152+0000 7f0719800640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f07140736a0 con 0x7f071409b270 2024-04-17T05:27:23.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.152+0000 7f0719800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f07140b53d0 con 0x7f071409b6f0 2024-04-17T05:27:23.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.153+0000 7f00bdc00640 1 Processor -- start 2024-04-17T05:27:23.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.153+0000 7f8da2a00640 1 --2- 172.21.15.123:0/351795114 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8d8406c9c0 0x7f8d8406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.153+0000 7f8da3e00640 1 --2- 172.21.15.123:0/351795114 >> [v2:172.21.15.123:6800/840753170,v1:172.21.15.123:6801/840753170] conn(0x7f8d84076130 0x7f8d84078570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.153+0000 7f2fe6800640 1 Processor -- start 2024-04-17T05:27:23.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.154+0000 7f2fe6800640 1 -- start start 2024-04-17T05:27:23.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.153+0000 7f00bdc00640 1 -- start start 2024-04-17T05:27:23.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.153+0000 7f0713e00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f071409aa50 0x7f07140afd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54934/0 (socket says 172.21.15.123:54934) 2024-04-17T05:27:23.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.153+0000 7f0713e00640 1 -- 172.21.15.123:0/508008776 learned_addr learned my addr 172.21.15.123:0/508008776 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:27:23.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.154+0000 7f0713400640 1 --2- 172.21.15.123:0/508008776 >> v2:172.21.15.164:3300/0 conn(0x7f071409b270 0x7f0714144030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.154+0000 7f0718e00640 1 --2- 172.21.15.123:0/508008776 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f071409b6f0 0x7f0714144570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.154+0000 7f8da3e00640 1 --2- 172.21.15.123:0/351795114 >> [v2:172.21.15.123:6800/840753170,v1:172.21.15.123:6801/840753170] conn(0x7f8d84076130 0x7f8d84078570 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.154+0000 7f0712a00640 1 -- 172.21.15.123:0/508008776 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3060307177 0 0) 0x7f07140b0450 con 0x7f071409aa50 2024-04-17T05:27:23.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.154+0000 7f0712a00640 1 -- 172.21.15.123:0/508008776 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06f8003520 con 0x7f071409aa50 2024-04-17T05:27:23.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.155+0000 7f0718e00640 1 -- 172.21.15.123:0/508008776 >> v2:172.21.15.164:3300/0 conn(0x7f071409b270 msgr2=0x7f0714144030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:23.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.155+0000 7f2fe6800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe00b1ed0 0x7f2fe0148a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.155+0000 7f2fe6800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2fe00b22b0 0x7f2fe01491a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.155+0000 7f2fe6800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2fe00b96a0 0x7f2fe01e20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.155+0000 7f00bdc00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00b80b4470 0x7f00b80b5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.155+0000 7f00bdc00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00b809b870 con 0x7f00b806c4f0 2024-04-17T05:27:23.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.155+0000 7f00bdc00640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00b80ae950 con 0x7f00b80b3e40 2024-04-17T05:27:23.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.155+0000 7f00bdc00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f00b80b42b0 con 0x7f00b80b4470 2024-04-17T05:27:23.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.155+0000 7f0712a00640 1 -- 172.21.15.123:0/508008776 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1087642353 0 0) 0x7f06f8003520 con 0x7f071409aa50 2024-04-17T05:27:23.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.155+0000 7f0718e00640 1 --2- 172.21.15.123:0/508008776 >> v2:172.21.15.164:3300/0 conn(0x7f071409b270 0x7f0714144030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.155+0000 7f0718e00640 1 -- 172.21.15.123:0/508008776 >> v1:172.21.15.123:6789/0 conn(0x7f071409aa50 legacy=0x7f07140afd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.155+0000 7f0718e00640 1 -- 172.21.15.123:0/508008776 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07140af5d0 con 0x7f071409b6f0 2024-04-17T05:27:23.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.155+0000 7f2fe6800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe014ca60 con 0x7f2fe00b1ed0 2024-04-17T05:27:23.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.156+0000 7f2fe6800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe014bdc0 con 0x7f2fe00b22b0 2024-04-17T05:27:23.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.156+0000 7f2fe6800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe014cbe0 con 0x7f2fe00b96a0 2024-04-17T05:27:23.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.156+0000 7f2fe5e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2fe00b96a0 0x7f2fe01e20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.156+0000 7f8d97400640 1 -- 172.21.15.123:0/351795114 <== osd.0 v2:172.21.15.123:6800/840753170 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8d90004ec0 con 0x7f8d84076130 2024-04-17T05:27:23.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.156+0000 7f2fe5e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2fe00b96a0 0x7f2fe01e20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.123:59394/0 (socket says 172.21.15.123:59394) 2024-04-17T05:27:23.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.156+0000 7f2fe5e00640 1 -- 172.21.15.123:0/3113592514 learned_addr learned my addr 172.21.15.123:0/3113592514 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:23.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.156+0000 7f2fe5400640 1 --2- 172.21.15.123:0/3113592514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe00b1ed0 0x7f2fe0148a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.156+0000 7f00b7400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f00b806c4f0 0x7f00b809aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54950/0 (socket says 172.21.15.123:54950) 2024-04-17T05:27:23.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.156+0000 7f00b7400640 1 -- 172.21.15.123:0/303833562 learned_addr learned my addr 172.21.15.123:0/303833562 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:27:23.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.157+0000 7f00b7e00640 1 --2- 172.21.15.123:0/303833562 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00b80b4470 0x7f00b80b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.157+0000 7f2fe5e00640 1 -- 172.21.15.123:0/3113592514 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2fe00b22b0 msgr2=0x7f2fe01491a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.157+0000 7f2fe4a00640 1 --2- 172.21.15.123:0/3113592514 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2fe00b22b0 0x7f2fe01491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.157+0000 7f2fe5e00640 1 --2- 172.21.15.123:0/3113592514 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2fe00b22b0 0x7f2fe01491a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.157+0000 7f2fe5e00640 1 -- 172.21.15.123:0/3113592514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe00b1ed0 msgr2=0x7f2fe0148a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.157+0000 7f2fe5e00640 1 --2- 172.21.15.123:0/3113592514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fe00b1ed0 0x7f2fe0148a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.157+0000 7f0cf0000640 1 Processor -- start 2024-04-17T05:27:23.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.157+0000 7f2fe5e00640 1 -- 172.21.15.123:0/3113592514 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe014d5d0 con 0x7f2fe00b96a0 2024-04-17T05:27:23.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.157+0000 7f8da2a00640 1 --2- 172.21.15.123:0/351795114 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8d8406c9c0 0x7f8d8406ee80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c007830 tx=0x7f8da40ab000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.158+0000 7f1a59200640 1 Processor -- start 2024-04-17T05:27:23.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.158+0000 7f0718e00640 1 --2- 172.21.15.123:0/508008776 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f071409b6f0 0x7f0714144570 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f070c009d90 tx=0x7f070c02bd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39253ad211dd349e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.158+0000 7f00b6a00640 1 -- 172.21.15.123:0/303833562 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3993794035 0 0) 0x7f00b80ae950 con 0x7f00b80b3e40 2024-04-17T05:27:23.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.158+0000 7f00b6a00640 1 -- 172.21.15.123:0/303833562 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f009c003520 con 0x7f00b80b3e40 2024-04-17T05:27:23.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.158+0000 7f0cf0000640 1 -- start start 2024-04-17T05:27:23.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.158+0000 7f2fe5e00640 1 --2- 172.21.15.123:0/3113592514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2fe00b96a0 0x7f2fe01e20b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2fd800c7a0 tx=0x7f2fd800cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.158+0000 7f00b6a00640 1 -- 172.21.15.123:0/303833562 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 436294782 0 0) 0x7f00b809b870 con 0x7f00b806c4f0 2024-04-17T05:27:23.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.158+0000 7f00b6a00640 1 -- 172.21.15.123:0/303833562 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00b80ae950 con 0x7f00b806c4f0 2024-04-17T05:27:23.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.158+0000 7f0712a00640 1 -- 172.21.15.123:0/508008776 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070c039070 con 0x7f071409b6f0 2024-04-17T05:27:23.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.158+0000 7f1a59200640 1 -- start start 2024-04-17T05:27:23.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.158+0000 7f0712a00640 1 -- 172.21.15.123:0/508008776 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f070c02c8a0 con 0x7f071409b6f0 2024-04-17T05:27:23.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.158+0000 7f0712a00640 1 -- 172.21.15.123:0/508008776 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0704001670 con 0x7f071409b6f0 2024-04-17T05:27:23.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.158+0000 7f00b7e00640 1 -- 172.21.15.123:0/303833562 >> v1:172.21.15.164:6789/0 conn(0x7f00b80b3e40 legacy=0x7f00b809b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.158+0000 7f00b7e00640 1 -- 172.21.15.123:0/303833562 >> v1:172.21.15.123:6789/0 conn(0x7f00b806c4f0 legacy=0x7f00b809aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.159+0000 7f00b6a00640 1 -- 172.21.15.123:0/303833562 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4148748852 0 0) 0x7f00b80ae950 con 0x7f00b806c4f0 2024-04-17T05:27:23.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.159+0000 7f00b7e00640 1 -- 172.21.15.123:0/303833562 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b806d480 con 0x7f00b80b4470 2024-04-17T05:27:23.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.159+0000 7f2fdd600640 1 -- 172.21.15.123:0/3113592514 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd8003b70 con 0x7f2fe00b96a0 2024-04-17T05:27:23.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.159+0000 7f2fdd600640 1 -- 172.21.15.123:0/3113592514 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd8003d30 con 0x7f2fe00b96a0 2024-04-17T05:27:23.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.159+0000 7f2fdd600640 1 -- 172.21.15.123:0/3113592514 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd800aa30 con 0x7f2fe00b96a0 2024-04-17T05:27:23.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.159+0000 7f2fe6800640 1 -- 172.21.15.123:0/3113592514 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fe01e18b0 con 0x7f2fe00b96a0 2024-04-17T05:27:23.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.160+0000 7f2fe6800640 1 -- 172.21.15.123:0/3113592514 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fe01e25f0 con 0x7f2fe00b96a0 2024-04-17T05:27:23.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.159+0000 7f0cf0000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ce80b9b20 0x7f0ce80b7c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.159+0000 7f0cf0000640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0ce80b4dd0 0x7f0ce80b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.159+0000 7f0cf0000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0ce814fce0 0x7f0ce8150150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.159+0000 7f0cf0000640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f0ce8073fe0 con 0x7f0ce814fce0 2024-04-17T05:27:23.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.159+0000 7f0cf0000640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f0ce80b92a0 con 0x7f0ce80b4dd0 2024-04-17T05:27:23.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.159+0000 7f0cf0000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f0ce80b9f00 con 0x7f0ce80b9b20 2024-04-17T05:27:23.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.160+0000 7f2ddd600640 1 Processor -- start 2024-04-17T05:27:23.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.160+0000 7fec51800640 1 Processor -- start 2024-04-17T05:27:23.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.160+0000 7f0719800640 1 -- 172.21.15.123:0/508008776 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f071409b6f0 msgr2=0x7f0714144570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.160+0000 7f0719800640 1 --2- 172.21.15.123:0/508008776 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f071409b6f0 0x7f0714144570 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f070c009d90 tx=0x7f070c02bd70 comp rx=0 tx=0).stop 2024-04-17T05:27:23.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.160+0000 7f0719800640 1 -- 172.21.15.123:0/508008776 shutdown_connections 2024-04-17T05:27:23.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.160+0000 7f0cee000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0ce814fce0 0x7f0ce8150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.160+0000 7f1a59200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a540b61f0 0x7f1a540b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.160+0000 7f0719800640 1 --2- 172.21.15.123:0/508008776 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f071409b6f0 0x7f0714144570 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.160+0000 7f0719800640 1 --2- 172.21.15.123:0/508008776 >> v2:172.21.15.164:3300/0 conn(0x7f071409b270 0x7f0714144030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.160+0000 7f0719800640 1 -- 172.21.15.123:0/508008776 >> 172.21.15.123:0/508008776 conn(0x7f07140b9630 msgr2=0x7f07140b9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:23.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.160+0000 7f0cee000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0ce814fce0 0x7f0ce8150150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38134/0 (socket says 172.21.15.123:38134) 2024-04-17T05:27:23.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.160+0000 7f0cee000640 1 -- 172.21.15.123:0/2701478553 learned_addr learned my addr 172.21.15.123:0/2701478553 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:23.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.160+0000 7f0cecc00640 1 --2- 172.21.15.123:0/2701478553 >> v2:172.21.15.164:3300/0 conn(0x7f0ce80b4dd0 0x7f0ce80b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.160+0000 7f1a59200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a540b65d0 con 0x7f1a540b42e0 2024-04-17T05:27:23.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.160+0000 7f1a59200640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a540b75a0 con 0x7f1a540b51e0 2024-04-17T05:27:23.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.160+0000 7f1a59200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f1a540b4d50 con 0x7f1a540b61f0 2024-04-17T05:27:23.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.160+0000 7f2ddd600640 1 -- start start 2024-04-17T05:27:23.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.161+0000 7f0ced600640 1 --2- 172.21.15.123:0/2701478553 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ce80b9b20 0x7f0ce80b7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.161+0000 7f1a53400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a540b61f0 0x7f1a540b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.161+0000 7f1a53400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a540b61f0 0x7f1a540b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.123:59406/0 (socket says 172.21.15.123:59406) 2024-04-17T05:27:23.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.161+0000 7f1a53400640 1 -- 172.21.15.123:0/1084461462 learned_addr learned my addr 172.21.15.123:0/1084461462 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:23.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.161+0000 7fec51800640 1 -- start start 2024-04-17T05:27:23.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.162+0000 7f2fe6800640 1 -- 172.21.15.123:0/3113592514 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2fe0075b30 con 0x7f2fe00b96a0 2024-04-17T05:27:23.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.161+0000 7f0cee000640 1 -- 172.21.15.123:0/2701478553 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ce80b9b20 msgr2=0x7f0ce80b7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:23.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.161+0000 7f0cee000640 1 --2- 172.21.15.123:0/2701478553 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ce80b9b20 0x7f0ce80b7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.161+0000 7f0cee000640 1 -- 172.21.15.123:0/2701478553 >> v2:172.21.15.164:3300/0 conn(0x7f0ce80b4dd0 msgr2=0x7f0ce80b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:23.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.161+0000 7f0cee000640 1 --2- 172.21.15.123:0/2701478553 >> v2:172.21.15.164:3300/0 conn(0x7f0ce80b4dd0 0x7f0ce80b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.161+0000 7f0cee000640 1 -- 172.21.15.123:0/2701478553 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ce80b8140 con 0x7f0ce814fce0 2024-04-17T05:27:23.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.161+0000 7f0ced600640 1 --2- 172.21.15.123:0/2701478553 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ce80b9b20 0x7f0ce80b7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T05:27:23.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.162+0000 7f1a53400640 1 -- 172.21.15.123:0/1084461462 >> v1:172.21.15.164:6789/0 conn(0x7f1a540b51e0 legacy=0x7f1a540b5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:23.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.162+0000 7f1a53400640 1 -- 172.21.15.123:0/1084461462 >> v1:172.21.15.123:6789/0 conn(0x7f1a540b42e0 legacy=0x7f1a54147ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.162+0000 7f1a53400640 1 -- 172.21.15.123:0/1084461462 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a540b49e0 con 0x7f1a540b61f0 2024-04-17T05:27:23.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.162+0000 7f0719800640 1 -- 172.21.15.123:0/508008776 shutdown_connections 2024-04-17T05:27:23.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.162+0000 7fec51800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fec4c06dc70 0x7fec4c06cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.162+0000 7fec51800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec4c0af4e0 0x7fec4c0b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.162+0000 7fec51800640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec4c06e050 con 0x7fec4c09aa50 2024-04-17T05:27:23.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.162+0000 7fec51800640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fec4c0af050 con 0x7fec4c06dc70 2024-04-17T05:27:23.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.162+0000 7fec51800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fec4c0ae570 con 0x7fec4c0af4e0 2024-04-17T05:27:23.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.162+0000 7f2ddd600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2dd8154f20 0x7f2dd8157310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.162+0000 7f00b7e00640 1 --2- 172.21.15.123:0/303833562 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00b80b4470 0x7f00b80b5330 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f00b0009dc0 tx=0x7f00b002bde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b193362fa954389 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.163+0000 7fec4be00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fec4c06dc70 0x7fec4c06cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.163+0000 7f0cee000640 1 --2- 172.21.15.123:0/2701478553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ce814fce0 0x7f0ce8150150 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0ce806eae0 tx=0x7f0ce002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b263ce9c23965144 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.163+0000 7fec4be00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fec4c06dc70 0x7fec4c06cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38150/0 (socket says 172.21.15.123:38150) 2024-04-17T05:27:23.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.163+0000 7fec4be00640 1 -- 172.21.15.123:0/1234541210 learned_addr learned my addr 172.21.15.123:0/1234541210 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:23.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.163+0000 7f0719800640 1 -- 172.21.15.123:0/508008776 wait complete. 2024-04-17T05:27:23.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.163+0000 7fec4b400640 1 --2- 172.21.15.123:0/1234541210 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec4c0af4e0 0x7fec4c0b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.164+0000 7f0ce7e00640 1 -- 172.21.15.123:0/2701478553 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce002ca80 con 0x7f0ce814fce0 2024-04-17T05:27:23.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.164+0000 7f0ce7e00640 1 -- 172.21.15.123:0/2701478553 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ce002cc20 con 0x7f0ce814fce0 2024-04-17T05:27:23.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.164+0000 7f0ce7e00640 1 -- 172.21.15.123:0/2701478553 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce00343f0 con 0x7f0ce814fce0 2024-04-17T05:27:23.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.164+0000 7fec4be00640 1 -- 172.21.15.123:0/1234541210 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec4c0af4e0 msgr2=0x7fec4c0b3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:23.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.164+0000 7fec4be00640 1 --2- 172.21.15.123:0/1234541210 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec4c0af4e0 0x7fec4c0b3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.164+0000 7fec4be00640 1 -- 172.21.15.123:0/1234541210 >> v1:172.21.15.164:6789/0 conn(0x7fec4c09aa50 legacy=0x7fec4c09aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.164+0000 7fec4be00640 1 -- 172.21.15.123:0/1234541210 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec4c0ae850 con 0x7fec4c06dc70 2024-04-17T05:27:23.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.162+0000 7f2ddd600640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dd80b92a0 con 0x7f2dd80b4dd0 2024-04-17T05:27:23.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.163+0000 7f2ddd600640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dd80b9f00 con 0x7f2dd80b9b20 2024-04-17T05:27:23.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.163+0000 7f2ddd600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f2dd8073fe0 con 0x7f2dd8154f20 2024-04-17T05:27:23.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.163+0000 7f2dd6000640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f2dd80b4dd0 0x7f2dd80b5200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54962/0 (socket says 172.21.15.123:54962) 2024-04-17T05:27:23.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.163+0000 7f2dd6000640 1 -- 172.21.15.123:0/613919811 learned_addr learned my addr 172.21.15.123:0/613919811 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:27:23.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.163+0000 7f2dd7400640 1 --2- 172.21.15.123:0/613919811 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2dd8154f20 0x7f2dd8157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.164+0000 7f2dd5600640 1 -- 172.21.15.123:0/613919811 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 680925999 0 0) 0x7f2dd80b92a0 con 0x7f2dd80b4dd0 2024-04-17T05:27:23.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.164+0000 7f2dd5600640 1 -- 172.21.15.123:0/613919811 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2dbc003520 con 0x7f2dd80b4dd0 2024-04-17T05:27:23.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.164+0000 7f1a53400640 1 --2- 172.21.15.123:0/1084461462 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a540b61f0 0x7f1a540b3da0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1a440098a0 tx=0x7f1a4402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8940b84c4b06824c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.165+0000 7f2dd7400640 1 -- 172.21.15.123:0/613919811 >> v1:172.21.15.164:6789/0 conn(0x7f2dd80b9b20 legacy=0x7f2dd80b7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.165+0000 7f2dd7400640 1 -- 172.21.15.123:0/613919811 >> v1:172.21.15.123:6789/0 conn(0x7f2dd80b4dd0 legacy=0x7f2dd80b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.165+0000 7f00b6a00640 1 -- 172.21.15.123:0/303833562 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b0039070 con 0x7f00b80b4470 2024-04-17T05:27:23.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.165+0000 7f00b6a00640 1 -- 172.21.15.123:0/303833562 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b002c910 con 0x7f00b80b4470 2024-04-17T05:27:23.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.165+0000 7f00b6a00640 1 -- 172.21.15.123:0/303833562 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8001670 con 0x7f00b80b4470 2024-04-17T05:27:23.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.165+0000 7f1a52000640 1 -- 172.21.15.123:0/1084461462 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a44034070 con 0x7f1a540b61f0 2024-04-17T05:27:23.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.165+0000 7f1a52000640 1 -- 172.21.15.123:0/1084461462 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a44030840 con 0x7f1a540b61f0 2024-04-17T05:27:23.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.165+0000 7f1a52000640 1 -- 172.21.15.123:0/1084461462 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a44030c10 con 0x7f1a540b61f0 2024-04-17T05:27:23.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.165+0000 7f0719800640 1 Processor -- start 2024-04-17T05:27:23.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.165+0000 7f2dd7400640 1 -- 172.21.15.123:0/613919811 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd80b45d0 con 0x7f2dd8154f20 2024-04-17T05:27:23.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.165+0000 7f2fdd600640 1 -- 172.21.15.123:0/3113592514 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2fd800abd0 con 0x7f2fe00b96a0 2024-04-17T05:27:23.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.165+0000 7f0719800640 1 -- start start 2024-04-17T05:27:23.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.165+0000 7f0cf0000640 1 -- 172.21.15.123:0/2701478553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ce814fce0 msgr2=0x7f0ce8150150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.165+0000 7f0cf0000640 1 --2- 172.21.15.123:0/2701478553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ce814fce0 0x7f0ce8150150 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0ce806eae0 tx=0x7f0ce002bee0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.165+0000 7fec4be00640 1 --2- 172.21.15.123:0/1234541210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec4c06dc70 0x7fec4c06cdd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fec3c009870 tx=0x7fec3c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a7bb180d3c236f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.166+0000 7f00bdc00640 1 -- 172.21.15.123:0/303833562 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00b80b4470 msgr2=0x7f00b80b5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.166+0000 7f00bdc00640 1 --2- 172.21.15.123:0/303833562 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00b80b4470 0x7f00b80b5330 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f00b0009dc0 tx=0x7f00b002bde0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.166+0000 7fec4aa00640 1 -- 172.21.15.123:0/1234541210 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec3c0317c0 con 0x7fec4c06dc70 2024-04-17T05:27:23.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.166+0000 7fec4aa00640 1 -- 172.21.15.123:0/1234541210 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec3c037070 con 0x7fec4c06dc70 2024-04-17T05:27:23.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.166+0000 7fec4aa00640 1 -- 172.21.15.123:0/1234541210 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec3c031b80 con 0x7fec4c06dc70 2024-04-17T05:27:23.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.166+0000 7f1a59200640 1 -- 172.21.15.123:0/1084461462 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a540b61f0 msgr2=0x7f1a540b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.166+0000 7f1a59200640 1 --2- 172.21.15.123:0/1084461462 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a540b61f0 0x7f1a540b3da0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1a440098a0 tx=0x7f1a4402b980 comp rx=0 tx=0).stop 2024-04-17T05:27:23.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.166+0000 7f0cf0000640 1 -- 172.21.15.123:0/2701478553 shutdown_connections 2024-04-17T05:27:23.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.166+0000 7f0cf0000640 1 --2- 172.21.15.123:0/2701478553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ce814fce0 0x7f0ce8150150 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.166+0000 7f0cf0000640 1 --2- 172.21.15.123:0/2701478553 >> v2:172.21.15.164:3300/0 conn(0x7f0ce80b4dd0 0x7f0ce80b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.166+0000 7f0cf0000640 1 --2- 172.21.15.123:0/2701478553 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ce80b9b20 0x7f0ce80b7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.166+0000 7f0cf0000640 1 -- 172.21.15.123:0/2701478553 >> 172.21.15.123:0/2701478553 conn(0x7f0ce806bda0 msgr2=0x7f0ce806c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:23.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.166+0000 7f1a59200640 1 -- 172.21.15.123:0/1084461462 shutdown_connections 2024-04-17T05:27:23.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.166+0000 7f1a59200640 1 --2- 172.21.15.123:0/1084461462 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a540b61f0 0x7f1a540b3da0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.166+0000 7f1a59200640 1 -- 172.21.15.123:0/1084461462 >> 172.21.15.123:0/1084461462 conn(0x7f1a5406c260 msgr2=0x7f1a540b9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:23.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.166+0000 7f0cf0000640 1 -- 172.21.15.123:0/2701478553 shutdown_connections 2024-04-17T05:27:23.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.166+0000 7f1a59200640 1 -- 172.21.15.123:0/1084461462 shutdown_connections 2024-04-17T05:27:23.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.167+0000 7f1a59200640 1 -- 172.21.15.123:0/1084461462 wait complete. 2024-04-17T05:27:23.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.167+0000 7f0719800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f071409aa50 0x7f071409ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.167+0000 7f0719800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f071409b270 0x7f0714071d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.167+0000 7f0719800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f071409b6f0 0x7f07140b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.167+0000 7f0719800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f07140af1a0 con 0x7f071409aa50 2024-04-17T05:27:23.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.167+0000 7f0719800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f07140ae720 con 0x7f071409b270 2024-04-17T05:27:23.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.167+0000 7f0719800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f0714130de0 con 0x7f071409b6f0 2024-04-17T05:27:23.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.167+0000 7f2dd7400640 1 --2- 172.21.15.123:0/613919811 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2dd8154f20 0x7f2dd8157310 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2dc80097d0 tx=0x7f2dc802b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51437a8a053763d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.167+0000 7fec51800640 1 -- 172.21.15.123:0/1234541210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec4c06dc70 msgr2=0x7fec4c06cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.167+0000 7fec51800640 1 --2- 172.21.15.123:0/1234541210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec4c06dc70 0x7fec4c06cdd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fec3c009870 tx=0x7fec3c02b860 comp rx=0 tx=0).stop 2024-04-17T05:27:23.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.167+0000 7f0cf0000640 1 -- 172.21.15.123:0/2701478553 wait complete. 2024-04-17T05:27:23.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.167+0000 7f2fdd600640 1 --2- 172.21.15.123:0/3113592514 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f2fc006c9c0 0x7f2fc006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.167+0000 7f0713400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f071409b270 0x7f0714071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.168+0000 7f2fdd600640 1 -- 172.21.15.123:0/3113592514 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2fd808c7a0 con 0x7f2fe00b96a0 2024-04-17T05:27:23.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.168+0000 7fec51800640 1 -- 172.21.15.123:0/1234541210 shutdown_connections 2024-04-17T05:27:23.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.168+0000 7fec51800640 1 --2- 172.21.15.123:0/1234541210 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec4c0af4e0 0x7fec4c0b3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.168+0000 7fec51800640 1 --2- 172.21.15.123:0/1234541210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec4c06dc70 0x7fec4c06cdd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.168+0000 7fec51800640 1 -- 172.21.15.123:0/1234541210 >> 172.21.15.123:0/1234541210 conn(0x7fec4c06c430 msgr2=0x7fec4c0b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:23.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.168+0000 7f2dd5600640 1 -- 172.21.15.123:0/613919811 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8034070 con 0x7f2dd8154f20 2024-04-17T05:27:23.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.168+0000 7f0713400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f071409b270 0x7f0714071d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.123:44560/0 (socket says 172.21.15.123:44560) 2024-04-17T05:27:23.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.168+0000 7f00bdc00640 1 -- 172.21.15.123:0/303833562 shutdown_connections 2024-04-17T05:27:23.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.168+0000 7f00bdc00640 1 --2- 172.21.15.123:0/303833562 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00b80b4470 0x7f00b80b5330 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.168+0000 7f2dd5600640 1 -- 172.21.15.123:0/613919811 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dc8030800 con 0x7f2dd8154f20 2024-04-17T05:27:23.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.168+0000 7f2dd5600640 1 -- 172.21.15.123:0/613919811 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8034070 con 0x7f2dd8154f20 2024-04-17T05:27:23.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.168+0000 7f00bdc00640 1 -- 172.21.15.123:0/303833562 >> 172.21.15.123:0/303833562 conn(0x7f00b806c040 msgr2=0x7f00b80b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:23.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.168+0000 7fec51800640 1 -- 172.21.15.123:0/1234541210 shutdown_connections 2024-04-17T05:27:23.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.168+0000 7f0718e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f071409b6f0 0x7f07140b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.168+0000 7f0718e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f071409b6f0 0x7f07140b1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.123:59436/0 (socket says 172.21.15.123:59436) 2024-04-17T05:27:23.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.168+0000 7f0718e00640 1 -- 172.21.15.123:0/668578759 learned_addr learned my addr 172.21.15.123:0/668578759 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:23.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.168+0000 7f00bdc00640 1 -- 172.21.15.123:0/303833562 shutdown_connections 2024-04-17T05:27:23.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.168+0000 7f00bdc00640 1 -- 172.21.15.123:0/303833562 wait complete. 2024-04-17T05:27:23.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.168+0000 7f0713e00640 1 --2- 172.21.15.123:0/668578759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f071409aa50 0x7f071409ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.168+0000 7fec51800640 1 -- 172.21.15.123:0/1234541210 wait complete. 2024-04-17T05:27:23.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.168+0000 7f2fdd600640 1 --2- 172.21.15.123:0/3113592514 >> [v2:172.21.15.123:6816/754360844,v1:172.21.15.123:6817/754360844] conn(0x7f2fc0076140 0x7f2fc0078580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.168+0000 7f2fdd600640 1 -- 172.21.15.123:0/3113592514 --> [v2:172.21.15.123:6816/754360844,v1:172.21.15.123:6817/754360844] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2fd8017ec0 con 0x7f2fc0076140 2024-04-17T05:27:23.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.169+0000 7f2fdd600640 1 -- 172.21.15.123:0/3113592514 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2fd808cb90 con 0x7f2fe00b96a0 2024-04-17T05:27:23.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.168+0000 7f2fe5400640 1 --2- 172.21.15.123:0/3113592514 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f2fc006c9c0 0x7f2fc006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.169+0000 7f2ddd600640 1 -- 172.21.15.123:0/613919811 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2dd8154f20 msgr2=0x7f2dd8157310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.169+0000 7f2ddd600640 1 --2- 172.21.15.123:0/613919811 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2dd8154f20 0x7f2dd8157310 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2dc80097d0 tx=0x7f2dc802b940 comp rx=0 tx=0).stop 2024-04-17T05:27:23.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.169+0000 7f2fe4a00640 1 --2- 172.21.15.123:0/3113592514 >> [v2:172.21.15.123:6816/754360844,v1:172.21.15.123:6817/754360844] conn(0x7f2fc0076140 0x7f2fc0078580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.169+0000 7f0cf0000640 1 Processor -- start 2024-04-17T05:27:23.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.169+0000 7f1a59200640 1 Processor -- start 2024-04-17T05:27:23.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.169+0000 7f2ddd600640 1 -- 172.21.15.123:0/613919811 shutdown_connections 2024-04-17T05:27:23.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.169+0000 7f1a59200640 1 -- start start 2024-04-17T05:27:23.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.169+0000 7f2ddd600640 1 --2- 172.21.15.123:0/613919811 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2dd8154f20 0x7f2dd8157310 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.169+0000 7f0718e00640 1 -- 172.21.15.123:0/668578759 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f071409b270 msgr2=0x7f0714071d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.169+0000 7f0718e00640 1 --2- 172.21.15.123:0/668578759 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f071409b270 0x7f0714071d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.169+0000 7f0718e00640 1 -- 172.21.15.123:0/668578759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f071409aa50 msgr2=0x7f071409ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.169+0000 7f0cf0000640 1 -- start start 2024-04-17T05:27:23.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.170+0000 7f2ddd600640 1 -- 172.21.15.123:0/613919811 >> 172.21.15.123:0/613919811 conn(0x7f2dd806bda0 msgr2=0x7f2dd806c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:23.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.170+0000 7f0718e00640 1 --2- 172.21.15.123:0/668578759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f071409aa50 0x7f071409ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.170+0000 7f0718e00640 1 -- 172.21.15.123:0/668578759 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07140b3200 con 0x7f071409b6f0 2024-04-17T05:27:23.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.170+0000 7f0713e00640 1 --2- 172.21.15.123:0/668578759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f071409aa50 0x7f071409ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T05:27:23.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.170+0000 7f00bdc00640 1 Processor -- start 2024-04-17T05:27:23.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.170+0000 7f2ddd600640 1 -- 172.21.15.123:0/613919811 shutdown_connections 2024-04-17T05:27:23.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.171+0000 7f2ddd600640 1 -- 172.21.15.123:0/613919811 wait complete. 2024-04-17T05:27:23.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.170+0000 7f0718e00640 1 --2- 172.21.15.123:0/668578759 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f071409b6f0 0x7f07140b1f90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f070c009eb0 tx=0x7f070c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.171+0000 7f00bdc00640 1 -- start start 2024-04-17T05:27:23.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.171+0000 7fec51800640 1 Processor -- start 2024-04-17T05:27:23.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.171+0000 7f2fe5400640 1 --2- 172.21.15.123:0/3113592514 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f2fc006c9c0 0x7f2fc006ee80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4009a00 tx=0x7f2fd4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.171+0000 7f2fe4a00640 1 --2- 172.21.15.123:0/3113592514 >> [v2:172.21.15.123:6816/754360844,v1:172.21.15.123:6817/754360844] conn(0x7f2fc0076140 0x7f2fc0078580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.171+0000 7f0cf0000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ce80b4dd0 0x7f0ce81e1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.171+0000 7f1a59200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a540b42e0 0x7f1a54143ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.171+0000 7fec51800640 1 -- start start 2024-04-17T05:27:23.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.171+0000 7f070be00640 1 -- 172.21.15.123:0/668578759 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070c039050 con 0x7f071409b6f0 2024-04-17T05:27:23.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.171+0000 7f070be00640 1 -- 172.21.15.123:0/668578759 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f070c03a040 con 0x7f071409b6f0 2024-04-17T05:27:23.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.171+0000 7f070be00640 1 -- 172.21.15.123:0/668578759 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070c009450 con 0x7f071409b6f0 2024-04-17T05:27:23.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.171+0000 7f1a59200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a540b51e0 0x7f1a541431c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.171+0000 7f0cf0000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ce80b9b20 0x7f0ce808e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.172+0000 7f0cf0000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ce814fce0 0x7f0ce809d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.172+0000 7f1a59200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a540b61f0 0x7f1a541e4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.172+0000 7f0719800640 1 -- 172.21.15.123:0/668578759 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0714072bc0 con 0x7f071409b6f0 2024-04-17T05:27:23.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.172+0000 7f0cf0000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce80b5710 con 0x7f0ce80b4dd0 2024-04-17T05:27:23.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.172+0000 7f1a53400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a540b42e0 0x7f1a54143ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.172+0000 7f0ced600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ce80b4dd0 0x7f0ce81e1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.172+0000 7f0719800640 1 -- 172.21.15.123:0/668578759 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0714155150 con 0x7f071409b6f0 2024-04-17T05:27:23.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.172+0000 7f1a53400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a540b42e0 0x7f1a54143ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38172/0 (socket says 172.21.15.123:38172) 2024-04-17T05:27:23.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.172+0000 7f1a53400640 1 -- 172.21.15.123:0/425617460 learned_addr learned my addr 172.21.15.123:0/425617460 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:23.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.172+0000 7f1a59200640 1 -- 172.21.15.123:0/425617460 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1a541534b0 con 0x7f1a540b42e0 2024-04-17T05:27:23.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.172+0000 7f1a59200640 1 -- 172.21.15.123:0/425617460 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1a54153330 con 0x7f1a540b61f0 2024-04-17T05:27:23.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.172+0000 7f1a59200640 1 -- 172.21.15.123:0/425617460 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f1a54153630 con 0x7f1a540b51e0 2024-04-17T05:27:23.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.172+0000 7f0ced600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ce80b4dd0 0x7f0ce81e1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38170/0 (socket says 172.21.15.123:38170) 2024-04-17T05:27:23.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.172+0000 7f0ced600640 1 -- 172.21.15.123:0/2428543320 learned_addr learned my addr 172.21.15.123:0/2428543320 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:23.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.172+0000 7f0cf0000640 1 -- 172.21.15.123:0/2428543320 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce80b48b0 con 0x7f0ce814fce0 2024-04-17T05:27:23.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.172+0000 7f0cf0000640 1 -- 172.21.15.123:0/2428543320 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f0ce80b8400 con 0x7f0ce80b9b20 2024-04-17T05:27:23.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.172+0000 7fec51800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec4c06dc70 0x7fec4c072470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.172+0000 7fec51800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fec4c09aa50 0x7fec4c1e1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.173+0000 7fec51800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec4c0af4e0 0x7fec4c1d72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.173+0000 7f2ddd600640 1 Processor -- start 2024-04-17T05:27:23.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.172+0000 7f0cecc00640 1 --2- 172.21.15.123:0/2428543320 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ce80b9b20 0x7f0ce808e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.173+0000 7f1a52a00640 1 --2- 172.21.15.123:0/425617460 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a540b51e0 0x7f1a541431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.173+0000 7f1a53e00640 1 --2- 172.21.15.123:0/425617460 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a540b61f0 0x7f1a541e4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.173+0000 7f2ddd600640 1 -- start start 2024-04-17T05:27:23.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.173+0000 7fec4be00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec4c06dc70 0x7fec4c072470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.173+0000 7fec4be00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec4c06dc70 0x7fec4c072470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38178/0 (socket says 172.21.15.123:38178) 2024-04-17T05:27:23.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.173+0000 7f0ced600640 1 -- 172.21.15.123:0/2428543320 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ce80b9b20 msgr2=0x7f0ce808e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.173+0000 7f0ced600640 1 --2- 172.21.15.123:0/2428543320 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0ce80b9b20 0x7f0ce808e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.173+0000 7f0ced600640 1 -- 172.21.15.123:0/2428543320 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ce814fce0 msgr2=0x7f0ce809d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.173+0000 7f0cee000640 1 --2- 172.21.15.123:0/2428543320 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ce814fce0 0x7f0ce809d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.172+0000 7f00bdc00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f00b806c4f0 0x7f00b8071e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.172+0000 7f00bdc00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00b80b3e40 0x7f00b80b1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.172+0000 7f00bdc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00b80b4470 0x7f00b80b1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.172+0000 7f00bdc00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f00b806de60 con 0x7f00b806c4f0 2024-04-17T05:27:23.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.172+0000 7f00bdc00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f00b80b4e10 con 0x7f00b80b4470 2024-04-17T05:27:23.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.172+0000 7f00bdc00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f00b80ae520 con 0x7f00b80b3e40 2024-04-17T05:27:23.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.174+0000 7f0ced600640 1 --2- 172.21.15.123:0/2428543320 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ce814fce0 0x7f0ce809d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.174+0000 7f2fdd600640 1 -- 172.21.15.123:0/3113592514 <== osd.2 v2:172.21.15.123:6816/754360844 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2fd8017ec0 con 0x7f2fc0076140 2024-04-17T05:27:23.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.174+0000 7f00bd200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00b80b4470 0x7f00b80b1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.174+0000 7f1a53e00640 1 -- 172.21.15.123:0/425617460 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a540b51e0 msgr2=0x7f1a541431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.174+0000 7f1a53e00640 1 --2- 172.21.15.123:0/425617460 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1a540b51e0 0x7f1a541431c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.174+0000 7f1a53e00640 1 -- 172.21.15.123:0/425617460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a540b42e0 msgr2=0x7f1a54143ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.174+0000 7f1a53e00640 1 --2- 172.21.15.123:0/425617460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a540b42e0 0x7f1a54143ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.174+0000 7fec51800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fec4c0ae1f0 con 0x7fec4c06dc70 2024-04-17T05:27:23.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.174+0000 7fec51800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fec4c0aece0 con 0x7fec4c09aa50 2024-04-17T05:27:23.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.174+0000 7fec51800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fec4c09b5b0 con 0x7fec4c0af4e0 2024-04-17T05:27:23.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.174+0000 7f0719800640 1 -- 172.21.15.123:0/668578759 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0714075b30 con 0x7f071409b6f0 2024-04-17T05:27:23.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.174+0000 7f1a53e00640 1 -- 172.21.15.123:0/425617460 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a541452d0 con 0x7f1a540b61f0 2024-04-17T05:27:23.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.174+0000 7fec4be00640 1 -- 172.21.15.123:0/2601599654 learned_addr learned my addr 172.21.15.123:0/2601599654 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:23.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.174+0000 7f0ced600640 1 -- 172.21.15.123:0/2428543320 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ce81e14a0 con 0x7f0ce80b4dd0 2024-04-17T05:27:23.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.174+0000 7f00bd200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00b80b4470 0x7f00b80b1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.123:44606/0 (socket says 172.21.15.123:44606) 2024-04-17T05:27:23.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.174+0000 7f00bd200640 1 -- 172.21.15.123:0/4289521196 learned_addr learned my addr 172.21.15.123:0/4289521196 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:23.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.174+0000 7f00b7400640 1 --2- 172.21.15.123:0/4289521196 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00b80b3e40 0x7f00b80b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.174+0000 7f2ddd600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2dd80b4dd0 0x7f2dd80b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.174+0000 7fec4b400640 1 --2- 172.21.15.123:0/2601599654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fec4c09aa50 0x7fec4c1e1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.174+0000 7f2ddd600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2dd80b9b20 0x7f2dd814a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.174+0000 7f2ddd600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dd8154f20 0x7f2dd814a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.174+0000 7fec50e00640 1 --2- 172.21.15.123:0/2601599654 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec4c0af4e0 0x7fec4c1d72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.175+0000 7f0ced600640 1 --2- 172.21.15.123:0/2428543320 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ce80b4dd0 0x7f0ce81e1f20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc00e730 tx=0x7f0cdc00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.175+0000 7f00b7e00640 1 --2- 172.21.15.123:0/4289521196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f00b806c4f0 0x7f00b8071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.175+0000 7fec4be00640 1 -- 172.21.15.123:0/2601599654 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec4c0af4e0 msgr2=0x7fec4c1d72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.175+0000 7fec4be00640 1 --2- 172.21.15.123:0/2601599654 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fec4c0af4e0 0x7fec4c1d72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.175+0000 7fec4be00640 1 -- 172.21.15.123:0/2601599654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fec4c09aa50 msgr2=0x7fec4c1e1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.175+0000 7fec4be00640 1 --2- 172.21.15.123:0/2601599654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fec4c09aa50 0x7fec4c1e1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.175+0000 7fec4be00640 1 -- 172.21.15.123:0/2601599654 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec4c1d5ae0 con 0x7fec4c06dc70 2024-04-17T05:27:23.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.175+0000 7f0ce5600640 1 -- 172.21.15.123:0/2428543320 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc00f040 con 0x7f0ce80b4dd0 2024-04-17T05:27:23.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.175+0000 7f0ce5600640 1 -- 172.21.15.123:0/2428543320 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cdc004230 con 0x7f0ce80b4dd0 2024-04-17T05:27:23.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.175+0000 7f0ce5600640 1 -- 172.21.15.123:0/2428543320 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc00ee40 con 0x7f0ce80b4dd0 2024-04-17T05:27:23.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.175+0000 7f0cf0000640 1 -- 172.21.15.123:0/2428543320 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ce808fbf0 con 0x7f0ce80b4dd0 2024-04-17T05:27:23.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.175+0000 7f00bd200640 1 -- 172.21.15.123:0/4289521196 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00b80b3e40 msgr2=0x7f00b80b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.175+0000 7f00bd200640 1 --2- 172.21.15.123:0/4289521196 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f00b80b3e40 0x7f00b80b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.175+0000 7f00bd200640 1 -- 172.21.15.123:0/4289521196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f00b806c4f0 msgr2=0x7f00b8071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.175+0000 7f00bd200640 1 --2- 172.21.15.123:0/4289521196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f00b806c4f0 0x7f00b8071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.175+0000 7f00bd200640 1 -- 172.21.15.123:0/4289521196 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b8144d20 con 0x7f00b80b4470 2024-04-17T05:27:23.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.176+0000 7f2dd6a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2dd80b4dd0 0x7f2dd80b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.175+0000 7f0cf0000640 1 -- 172.21.15.123:0/2428543320 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ce81e1720 con 0x7f0ce80b4dd0 2024-04-17T05:27:23.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.176+0000 7f2dd6a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2dd80b4dd0 0x7f2dd80b2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.123:44614/0 (socket says 172.21.15.123:44614) 2024-04-17T05:27:23.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.176+0000 7f2dd6000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2dd80b9b20 0x7f2dd814a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.176+0000 7f2dd6000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2dd80b9b20 0x7f2dd814a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.123:59482/0 (socket says 172.21.15.123:59482) 2024-04-17T05:27:23.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.176+0000 7f00b7e00640 1 --2- 172.21.15.123:0/4289521196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f00b806c4f0 0x7f00b8071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:23.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.176+0000 7f1a53e00640 1 --2- 172.21.15.123:0/425617460 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a540b61f0 0x7f1a541e4c60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c00c750 tx=0x7f1a4c00cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.176+0000 7f2dd6a00640 1 -- 172.21.15.123:0/3896699917 learned_addr learned my addr 172.21.15.123:0/3896699917 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:23.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.176+0000 7f2ddd600640 1 -- 172.21.15.123:0/3896699917 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd80b8400 con 0x7f2dd8154f20 2024-04-17T05:27:23.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.176+0000 7f00bd200640 1 --2- 172.21.15.123:0/4289521196 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00b80b4470 0x7f00b80b1dd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f00a400c3e0 tx=0x7f00a400c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.177+0000 7fec4be00640 1 --2- 172.21.15.123:0/2601599654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec4c06dc70 0x7fec4c072470 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fec3c0090b0 tx=0x7fec3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.176+0000 7f1a4b400640 1 -- 172.21.15.123:0/425617460 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c016020 con 0x7f1a540b61f0 2024-04-17T05:27:23.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.177+0000 7f1a59200640 1 -- 172.21.15.123:0/425617460 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a5413fb10 con 0x7f1a540b61f0 2024-04-17T05:27:23.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.177+0000 7f1a59200640 1 -- 172.21.15.123:0/425617460 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a540b3d70 con 0x7f1a540b61f0 2024-04-17T05:27:23.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.177+0000 7f0cf0000640 1 -- 172.21.15.123:0/2428543320 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0ce81e1b20 con 0x7f0ce80b4dd0 2024-04-17T05:27:23.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.177+0000 7f1a4b400640 1 -- 172.21.15.123:0/425617460 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a4c00a850 con 0x7f1a540b61f0 2024-04-17T05:27:23.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.177+0000 7fec43e00640 1 -- 172.21.15.123:0/2601599654 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec3c0326d0 con 0x7fec4c06dc70 2024-04-17T05:27:23.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.177+0000 7fec43e00640 1 -- 172.21.15.123:0/2601599654 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec3c032870 con 0x7fec4c06dc70 2024-04-17T05:27:23.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.177+0000 7fec51800640 1 -- 172.21.15.123:0/2601599654 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec4c073150 con 0x7fec4c06dc70 2024-04-17T05:27:23.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.177+0000 7f1a4b400640 1 -- 172.21.15.123:0/425617460 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c016020 con 0x7f1a540b61f0 2024-04-17T05:27:23.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.178+0000 7fec51800640 1 -- 172.21.15.123:0/2601599654 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec4c1d65c0 con 0x7fec4c06dc70 2024-04-17T05:27:23.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.178+0000 7f1a59200640 1 -- 172.21.15.123:0/425617460 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1a54075b30 con 0x7f1a540b61f0 2024-04-17T05:27:23.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.178+0000 7f00afe00640 1 -- 172.21.15.123:0/4289521196 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a4017070 con 0x7f00b80b4470 2024-04-17T05:27:23.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.178+0000 7f00afe00640 1 -- 172.21.15.123:0/4289521196 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00a40052d0 con 0x7f00b80b4470 2024-04-17T05:27:23.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.178+0000 7f00afe00640 1 -- 172.21.15.123:0/4289521196 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a4003830 con 0x7f00b80b4470 2024-04-17T05:27:23.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.178+0000 7f2dd7400640 1 --2- 172.21.15.123:0/3896699917 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dd8154f20 0x7f2dd814a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.178+0000 7f00bdc00640 1 -- 172.21.15.123:0/4289521196 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00b8149f30 con 0x7f00b80b4470 2024-04-17T05:27:23.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.178+0000 7fec43e00640 1 -- 172.21.15.123:0/2601599654 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec3c0326d0 con 0x7fec4c06dc70 2024-04-17T05:27:23.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.178+0000 7f2ddd600640 1 -- 172.21.15.123:0/3896699917 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd80b6cb0 con 0x7f2dd80b4dd0 2024-04-17T05:27:23.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.178+0000 7f2ddd600640 1 -- 172.21.15.123:0/3896699917 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f2dd8157850 con 0x7f2dd80b9b20 2024-04-17T05:27:23.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.179+0000 7f00bdc00640 1 -- 172.21.15.123:0/4289521196 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00b80709b0 con 0x7f00b80b4470 2024-04-17T05:27:23.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.180+0000 7f070be00640 1 -- 172.21.15.123:0/668578759 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f070c047020 con 0x7f071409b6f0 2024-04-17T05:27:23.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.180+0000 7f00bdc00640 1 -- 172.21.15.123:0/4289521196 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f00b80b4850 con 0x7f00b80b4470 2024-04-17T05:27:23.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.180+0000 7f0ce5600640 1 -- 172.21.15.123:0/2428543320 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0cdc00c6d0 con 0x7f0ce80b4dd0 2024-04-17T05:27:23.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.180+0000 7f2dd7400640 1 -- 172.21.15.123:0/3896699917 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2dd80b9b20 msgr2=0x7f2dd814a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.180+0000 7f2dd7400640 1 --2- 172.21.15.123:0/3896699917 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2dd80b9b20 0x7f2dd814a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.180+0000 7f2dd7400640 1 -- 172.21.15.123:0/3896699917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2dd80b4dd0 msgr2=0x7f2dd80b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.180+0000 7f2dd7400640 1 --2- 172.21.15.123:0/3896699917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2dd80b4dd0 0x7f2dd80b2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.180+0000 7f2dd7400640 1 -- 172.21.15.123:0/3896699917 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd814f6e0 con 0x7f2dd8154f20 2024-04-17T05:27:23.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.180+0000 7f2dd7400640 1 --2- 172.21.15.123:0/3896699917 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dd8154f20 0x7f2dd814a9d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8033000 tx=0x7f2dc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.180+0000 7fec51800640 1 -- 172.21.15.123:0/2601599654 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fec24001030 con 0x7fec4c06dc70 2024-04-17T05:27:23.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.181+0000 7f070be00640 1 --2- 172.21.15.123:0/668578759 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f06f406c9c0 0x7f06f406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.181+0000 7f2dcea00640 1 -- 172.21.15.123:0/3896699917 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8034050 con 0x7f2dd8154f20 2024-04-17T05:27:23.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.181+0000 7f070be00640 1 -- 172.21.15.123:0/668578759 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f070c0ae420 con 0x7f071409b6f0 2024-04-17T05:27:23.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.182+0000 7f070be00640 1 --2- 172.21.15.123:0/668578759 >> [v2:172.21.15.123:6819/2231878927,v1:172.21.15.123:6822/2231878927] conn(0x7f06f4076140 0x7f06f4078580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.182+0000 7f070be00640 1 -- 172.21.15.123:0/668578759 --> [v2:172.21.15.123:6819/2231878927,v1:172.21.15.123:6822/2231878927] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f070c0091a0 con 0x7f06f4076140 2024-04-17T05:27:23.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.182+0000 7f070be00640 1 -- 172.21.15.123:0/668578759 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f070c0ae810 con 0x7f071409b6f0 2024-04-17T05:27:23.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.182+0000 7f0713e00640 1 --2- 172.21.15.123:0/668578759 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f06f406c9c0 0x7f06f406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.182+0000 7f0ce5600640 1 --2- 172.21.15.123:0/2428543320 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f0ccc06c970 0x7f0ccc06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.182+0000 7f0ce5600640 1 -- 172.21.15.123:0/2428543320 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0cdc08b9b0 con 0x7f0ce80b4dd0 2024-04-17T05:27:23.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.182+0000 7f0ce5600640 1 --2- 172.21.15.123:0/2428543320 >> [v2:172.21.15.164:6800/606484349,v1:172.21.15.164:6801/606484349] conn(0x7f0ccc0760e0 0x7f0ccc078520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.182+0000 7f0ce5600640 1 -- 172.21.15.123:0/2428543320 --> [v2:172.21.15.164:6800/606484349,v1:172.21.15.164:6801/606484349] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0cdc00fe50 con 0x7f0ccc0760e0 2024-04-17T05:27:23.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.182+0000 7f0ce5600640 1 -- 172.21.15.123:0/2428543320 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0cdc0902c0 con 0x7f0ce80b4dd0 2024-04-17T05:27:23.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.183+0000 7f0cecc00640 1 --2- 172.21.15.123:0/2428543320 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f0ccc06c970 0x7f0ccc06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.183+0000 7f0cee000640 1 --2- 172.21.15.123:0/2428543320 >> [v2:172.21.15.164:6800/606484349,v1:172.21.15.164:6801/606484349] conn(0x7f0ccc0760e0 0x7f0ccc078520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.183+0000 7f2ddd600640 1 -- 172.21.15.123:0/3896699917 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dd80b25f0 con 0x7f2dd8154f20 2024-04-17T05:27:23.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.183+0000 7f2dcea00640 1 -- 172.21.15.123:0/3896699917 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dc8003820 con 0x7f2dd8154f20 2024-04-17T05:27:23.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.183+0000 7f2dcea00640 1 -- 172.21.15.123:0/3896699917 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8003bf0 con 0x7f2dd8154f20 2024-04-17T05:27:23.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.183+0000 7f0713e00640 1 --2- 172.21.15.123:0/668578759 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f06f406c9c0 0x7f06f406ee80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f07040011e0 tx=0x7f07040016f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.183+0000 7f2ddd600640 1 -- 172.21.15.123:0/3896699917 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dd80b2310 con 0x7f2dd8154f20 2024-04-17T05:27:23.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.184+0000 7fec43e00640 1 -- 172.21.15.123:0/2601599654 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fec3c032a20 con 0x7fec4c06dc70 2024-04-17T05:27:23.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.184+0000 7f1a4b400640 1 -- 172.21.15.123:0/425617460 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1a4c019020 con 0x7f1a540b61f0 2024-04-17T05:27:23.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.184+0000 7f0cecc00640 1 --2- 172.21.15.123:0/2428543320 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f0ccc06c970 0x7f0ccc06ee30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0ce808e210 tx=0x7f0cd8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.184+0000 7f2ddd600640 1 -- 172.21.15.123:0/3896699917 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2dd8075bd0 con 0x7f2dd8154f20 2024-04-17T05:27:23.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.184+0000 7f0cee000640 1 --2- 172.21.15.123:0/2428543320 >> [v2:172.21.15.164:6800/606484349,v1:172.21.15.164:6801/606484349] conn(0x7f0ccc0760e0 0x7f0ccc078520 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.185+0000 7f1a4b400640 1 --2- 172.21.15.123:0/425617460 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f1a3406caf0 0x7f1a3406efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.185+0000 7f1a4b400640 1 -- 172.21.15.123:0/425617460 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f1a4c08bc20 con 0x7f1a540b61f0 2024-04-17T05:27:23.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.185+0000 7f1a4b400640 1 --2- 172.21.15.123:0/425617460 >> [v2:172.21.15.164:6802/1376989593,v1:172.21.15.164:6805/1376989593] conn(0x7f1a34076270 0x7f1a340786b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.185+0000 7f1a4b400640 1 -- 172.21.15.123:0/425617460 --> [v2:172.21.15.164:6802/1376989593,v1:172.21.15.164:6805/1376989593] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1a4c012e50 con 0x7f1a34076270 2024-04-17T05:27:23.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.185+0000 7f1a4b400640 1 -- 172.21.15.123:0/425617460 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1a4c08c010 con 0x7f1a540b61f0 2024-04-17T05:27:23.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.185+0000 7f00afe00640 1 -- 172.21.15.123:0/4289521196 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f00a401a070 con 0x7f00b80b4470 2024-04-17T05:27:23.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.185+0000 7fec43e00640 1 --2- 172.21.15.123:0/2601599654 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fec2c06cb20 0x7fec2c06efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.186+0000 7f0713400640 1 --2- 172.21.15.123:0/668578759 >> [v2:172.21.15.123:6819/2231878927,v1:172.21.15.123:6822/2231878927] conn(0x7f06f4076140 0x7f06f4078580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.186+0000 7f1a53400640 1 --2- 172.21.15.123:0/425617460 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f1a3406caf0 0x7f1a3406efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.186+0000 7f0713400640 1 --2- 172.21.15.123:0/668578759 >> [v2:172.21.15.123:6819/2231878927,v1:172.21.15.123:6822/2231878927] conn(0x7f06f4076140 0x7f06f4078580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.186+0000 7f2dcea00640 1 -- 172.21.15.123:0/3896699917 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2dc8037070 con 0x7f2dd8154f20 2024-04-17T05:27:23.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.186+0000 7f1a52a00640 1 --2- 172.21.15.123:0/425617460 >> [v2:172.21.15.164:6802/1376989593,v1:172.21.15.164:6805/1376989593] conn(0x7f1a34076270 0x7f1a340786b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.186+0000 7f00afe00640 1 --2- 172.21.15.123:0/4289521196 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f009806c9c0 0x7f009806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.186+0000 7f00afe00640 1 -- 172.21.15.123:0/4289521196 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f00a408b8a0 con 0x7f00b80b4470 2024-04-17T05:27:23.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.187+0000 7f00afe00640 1 --2- 172.21.15.123:0/4289521196 >> [v2:172.21.15.123:6808/2898088574,v1:172.21.15.123:6809/2898088574] conn(0x7f0098076140 0x7f0098078580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.187+0000 7f1a53400640 1 --2- 172.21.15.123:0/425617460 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f1a3406caf0 0x7f1a3406efb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1a440090b0 tx=0x7f1a4403b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.187+0000 7f2dcea00640 1 --2- 172.21.15.123:0/3896699917 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f2db806c8f0 0x7f2db806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.188+0000 7f070be00640 1 -- 172.21.15.123:0/668578759 <== osd.1 v2:172.21.15.123:6819/2231878927 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f070c0091a0 con 0x7f06f4076140 2024-04-17T05:27:23.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.188+0000 7f2dcea00640 1 -- 172.21.15.123:0/3896699917 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2dc80ae6a0 con 0x7f2dd8154f20 2024-04-17T05:27:23.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.187+0000 7fec43e00640 1 -- 172.21.15.123:0/2601599654 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fec3c0adbe0 con 0x7fec4c06dc70 2024-04-17T05:27:23.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.187+0000 7fec43e00640 1 --2- 172.21.15.123:0/2601599654 >> [v2:172.21.15.164:6816/295402697,v1:172.21.15.164:6818/295402697] conn(0x7fec2c076220 0x7fec2c078660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.187+0000 7fec43e00640 1 -- 172.21.15.123:0/2601599654 --> [v2:172.21.15.164:6816/295402697,v1:172.21.15.164:6818/295402697] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fec3c04ae80 con 0x7fec2c076220 2024-04-17T05:27:23.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.187+0000 7fec43e00640 1 -- 172.21.15.123:0/2601599654 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fec3c0adfd0 con 0x7fec4c06dc70 2024-04-17T05:27:23.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.188+0000 7f0ce5600640 1 -- 172.21.15.123:0/2428543320 <== osd.4 v2:172.21.15.164:6800/606484349 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0cdc00fe50 con 0x7f0ccc0760e0 2024-04-17T05:27:23.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.188+0000 7f2dcea00640 1 --2- 172.21.15.123:0/3896699917 >> [v2:172.21.15.164:6817/1594306924,v1:172.21.15.164:6821/1594306924] conn(0x7f2db8075ff0 0x7f2db8078430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.188+0000 7fec4b400640 1 --2- 172.21.15.123:0/2601599654 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fec2c06cb20 0x7fec2c06efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.188+0000 7f2dcea00640 1 -- 172.21.15.123:0/3896699917 --> [v2:172.21.15.164:6817/1594306924,v1:172.21.15.164:6821/1594306924] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2dc800af30 con 0x7f2db8075ff0 2024-04-17T05:27:23.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.188+0000 7f00b7400640 1 --2- 172.21.15.123:0/4289521196 >> [v2:172.21.15.123:6808/2898088574,v1:172.21.15.123:6809/2898088574] conn(0x7f0098076140 0x7f0098078580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.188+0000 7f00b7e00640 1 --2- 172.21.15.123:0/4289521196 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f009806c9c0 0x7f009806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.188+0000 7f2dcea00640 1 -- 172.21.15.123:0/3896699917 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2dc80aea50 con 0x7f2dd8154f20 2024-04-17T05:27:23.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.188+0000 7f2dd6a00640 1 --2- 172.21.15.123:0/3896699917 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f2db806c8f0 0x7f2db806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.188+0000 7f00afe00640 1 -- 172.21.15.123:0/4289521196 --> [v2:172.21.15.123:6808/2898088574,v1:172.21.15.123:6809/2898088574] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f00a4007630 con 0x7f0098076140 2024-04-17T05:27:23.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.189+0000 7fec50e00640 1 --2- 172.21.15.123:0/2601599654 >> [v2:172.21.15.164:6816/295402697,v1:172.21.15.164:6818/295402697] conn(0x7fec2c076220 0x7fec2c078660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.189+0000 7f00afe00640 1 -- 172.21.15.123:0/4289521196 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f00a408bc90 con 0x7f00b80b4470 2024-04-17T05:27:23.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.189+0000 7f1a52a00640 1 --2- 172.21.15.123:0/425617460 >> [v2:172.21.15.164:6802/1376989593,v1:172.21.15.164:6805/1376989593] conn(0x7f1a34076270 0x7f1a340786b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.189+0000 7f2dd6000640 1 --2- 172.21.15.123:0/3896699917 >> [v2:172.21.15.164:6817/1594306924,v1:172.21.15.164:6821/1594306924] conn(0x7f2db8075ff0 0x7f2db8078430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.190+0000 7f2dd6a00640 1 --2- 172.21.15.123:0/3896699917 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f2db806c8f0 0x7f2db806edb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0007fd0 tx=0x7f2dd0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.190+0000 7fec4b400640 1 --2- 172.21.15.123:0/2601599654 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fec2c06cb20 0x7fec2c06efe0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fec38006fd0 tx=0x7fec38008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.190+0000 7f2dd6000640 1 --2- 172.21.15.123:0/3896699917 >> [v2:172.21.15.164:6817/1594306924,v1:172.21.15.164:6821/1594306924] conn(0x7f2db8075ff0 0x7f2db8078430 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.190+0000 7f00b7e00640 1 --2- 172.21.15.123:0/4289521196 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f009806c9c0 0x7f009806ee80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f00b0036000 tx=0x7f00b0030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.191+0000 7f00b7400640 1 --2- 172.21.15.123:0/4289521196 >> [v2:172.21.15.123:6808/2898088574,v1:172.21.15.123:6809/2898088574] conn(0x7f0098076140 0x7f0098078580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.190+0000 7fec50e00640 1 --2- 172.21.15.123:0/2601599654 >> [v2:172.21.15.164:6816/295402697,v1:172.21.15.164:6818/295402697] conn(0x7fec2c076220 0x7fec2c078660 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.192+0000 7f00afe00640 1 -- 172.21.15.123:0/4289521196 <== osd.3 v2:172.21.15.123:6808/2898088574 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f00a4007630 con 0x7f0098076140 2024-04-17T05:27:23.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.193+0000 7f1a4b400640 1 -- 172.21.15.123:0/425617460 <== osd.5 v2:172.21.15.164:6802/1376989593 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1a4c012e50 con 0x7f1a34076270 2024-04-17T05:27:23.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.193+0000 7fec43e00640 1 -- 172.21.15.123:0/2601599654 <== osd.7 v2:172.21.15.164:6816/295402697 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fec3c04ae80 con 0x7fec2c076220 2024-04-17T05:27:23.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.194+0000 7f8daa400640 1 -- 172.21.15.123:0/351795114 --> [v2:172.21.15.123:6800/840753170,v1:172.21.15.123:6801/840753170] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8d80002dd0 con 0x7f8d84076130 2024-04-17T05:27:23.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.194+0000 7f2dcea00640 1 -- 172.21.15.123:0/3896699917 <== osd.6 v2:172.21.15.164:6817/1594306924 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2dc800af30 con 0x7f2db8075ff0 2024-04-17T05:27:23.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.197+0000 7f8d97400640 1 -- 172.21.15.123:0/351795114 <== osd.0 v2:172.21.15.123:6800/840753170 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8d80002dd0 con 0x7f8d84076130 2024-04-17T05:27:23.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.198+0000 7f8daa400640 1 -- 172.21.15.123:0/351795114 >> [v2:172.21.15.123:6800/840753170,v1:172.21.15.123:6801/840753170] conn(0x7f8d84076130 msgr2=0x7f8d84078570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.198+0000 7f8daa400640 1 --2- 172.21.15.123:0/351795114 >> [v2:172.21.15.123:6800/840753170,v1:172.21.15.123:6801/840753170] conn(0x7f8d84076130 0x7f8d84078570 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.199+0000 7f8daa400640 1 -- 172.21.15.123:0/351795114 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8d8406c9c0 msgr2=0x7f8d8406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.199+0000 7f8daa400640 1 --2- 172.21.15.123:0/351795114 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8d8406c9c0 0x7f8d8406ee80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c007830 tx=0x7f8da40ab000 comp rx=0 tx=0).stop 2024-04-17T05:27:23.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.199+0000 7f8daa400640 1 -- 172.21.15.123:0/351795114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d9c007fe0 msgr2=0x7f8d9c039170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.199+0000 7f8daa400640 1 --2- 172.21.15.123:0/351795114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d9c007fe0 0x7f8d9c039170 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8d9000c780 tx=0x7f8d9000cc40 comp rx=0 tx=0).stop 2024-04-17T05:27:23.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.199+0000 7f8da3e00640 1 -- 172.21.15.123:0/351795114 reap_dead start 2024-04-17T05:27:23.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.199+0000 7f8daa400640 1 -- 172.21.15.123:0/351795114 shutdown_connections 2024-04-17T05:27:23.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.199+0000 7f8daa400640 1 -- 172.21.15.123:0/351795114 >> 172.21.15.123:0/351795114 conn(0x7f8d9c00b5c0 msgr2=0x7f8d9c01dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:23.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.200+0000 7f8daa400640 1 -- 172.21.15.123:0/351795114 shutdown_connections 2024-04-17T05:27:23.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.200+0000 7f8daa400640 1 -- 172.21.15.123:0/351795114 wait complete. 2024-04-17T05:27:23.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.204+0000 7f2fe6800640 1 -- 172.21.15.123:0/3113592514 --> [v2:172.21.15.123:6816/754360844,v1:172.21.15.123:6817/754360844] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2fe00b2810 con 0x7f2fc0076140 2024-04-17T05:27:23.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.206+0000 7f2fdd600640 1 -- 172.21.15.123:0/3113592514 <== osd.2 v2:172.21.15.123:6816/754360844 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2fe00b2810 con 0x7f2fc0076140 2024-04-17T05:27:23.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.207+0000 7f2fe6800640 1 -- 172.21.15.123:0/3113592514 >> [v2:172.21.15.123:6816/754360844,v1:172.21.15.123:6817/754360844] conn(0x7f2fc0076140 msgr2=0x7f2fc0078580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.207+0000 7f2fe6800640 1 --2- 172.21.15.123:0/3113592514 >> [v2:172.21.15.123:6816/754360844,v1:172.21.15.123:6817/754360844] conn(0x7f2fc0076140 0x7f2fc0078580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.207+0000 7f2fe6800640 1 -- 172.21.15.123:0/3113592514 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f2fc006c9c0 msgr2=0x7f2fc006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.207+0000 7f2fe6800640 1 --2- 172.21.15.123:0/3113592514 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f2fc006c9c0 0x7f2fc006ee80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4009a00 tx=0x7f2fd4008040 comp rx=0 tx=0).stop 2024-04-17T05:27:23.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.207+0000 7f2fe6800640 1 -- 172.21.15.123:0/3113592514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2fe00b96a0 msgr2=0x7f2fe01e20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.207+0000 7f2fe6800640 1 --2- 172.21.15.123:0/3113592514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2fe00b96a0 0x7f2fe01e20b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2fd800c7a0 tx=0x7f2fd800cc60 comp rx=0 tx=0).stop 2024-04-17T05:27:23.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.207+0000 7f2fe5e00640 1 -- 172.21.15.123:0/3113592514 reap_dead start 2024-04-17T05:27:23.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.208+0000 7f2fe6800640 1 -- 172.21.15.123:0/3113592514 shutdown_connections 2024-04-17T05:27:23.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.208+0000 7f2fe6800640 1 -- 172.21.15.123:0/3113592514 >> 172.21.15.123:0/3113592514 conn(0x7f2fe006c260 msgr2=0x7f2fe00676c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:23.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.208+0000 7f2fe6800640 1 -- 172.21.15.123:0/3113592514 shutdown_connections 2024-04-17T05:27:23.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.208+0000 7f2fe6800640 1 -- 172.21.15.123:0/3113592514 wait complete. 2024-04-17T05:27:23.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.215+0000 7f0cf0000640 1 -- 172.21.15.123:0/2428543320 --> [v2:172.21.15.164:6800/606484349,v1:172.21.15.164:6801/606484349] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0ce8075bd0 con 0x7f0ccc0760e0 2024-04-17T05:27:23.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.216+0000 7f0ce5600640 1 -- 172.21.15.123:0/2428543320 <== osd.4 v2:172.21.15.164:6800/606484349 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0ce8075bd0 con 0x7f0ccc0760e0 2024-04-17T05:27:23.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.217+0000 7f0cf0000640 1 -- 172.21.15.123:0/2428543320 >> [v2:172.21.15.164:6800/606484349,v1:172.21.15.164:6801/606484349] conn(0x7f0ccc0760e0 msgr2=0x7f0ccc078520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.217+0000 7f0cf0000640 1 --2- 172.21.15.123:0/2428543320 >> [v2:172.21.15.164:6800/606484349,v1:172.21.15.164:6801/606484349] conn(0x7f0ccc0760e0 0x7f0ccc078520 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.217+0000 7f0cf0000640 1 -- 172.21.15.123:0/2428543320 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f0ccc06c970 msgr2=0x7f0ccc06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.217+0000 7f0cf0000640 1 --2- 172.21.15.123:0/2428543320 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f0ccc06c970 0x7f0ccc06ee30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0ce808e210 tx=0x7f0cd8009190 comp rx=0 tx=0).stop 2024-04-17T05:27:23.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.217+0000 7f0cf0000640 1 -- 172.21.15.123:0/2428543320 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ce80b4dd0 msgr2=0x7f0ce81e1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.217+0000 7f0cf0000640 1 --2- 172.21.15.123:0/2428543320 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ce80b4dd0 0x7f0ce81e1f20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc00e730 tx=0x7f0cdc00ebf0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.218+0000 7f0cee000640 1 -- 172.21.15.123:0/2428543320 reap_dead start 2024-04-17T05:27:23.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.218+0000 7f0719800640 1 -- 172.21.15.123:0/668578759 --> [v2:172.21.15.123:6819/2231878927,v1:172.21.15.123:6822/2231878927] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0714073040 con 0x7f06f4076140 2024-04-17T05:27:23.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.218+0000 7f0cf0000640 1 -- 172.21.15.123:0/2428543320 shutdown_connections 2024-04-17T05:27:23.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.218+0000 7f0cf0000640 1 -- 172.21.15.123:0/2428543320 >> 172.21.15.123:0/2428543320 conn(0x7f0ce806bda0 msgr2=0x7f0ce8071e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:23.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.219+0000 7f0cf0000640 1 -- 172.21.15.123:0/2428543320 shutdown_connections 2024-04-17T05:27:23.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.219+0000 7f070be00640 1 -- 172.21.15.123:0/668578759 <== osd.1 v2:172.21.15.123:6819/2231878927 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0714073040 con 0x7f06f4076140 2024-04-17T05:27:23.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.219+0000 7f0cf0000640 1 -- 172.21.15.123:0/2428543320 wait complete. 2024-04-17T05:27:23.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.219+0000 7f0719800640 1 -- 172.21.15.123:0/668578759 >> [v2:172.21.15.123:6819/2231878927,v1:172.21.15.123:6822/2231878927] conn(0x7f06f4076140 msgr2=0x7f06f4078580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.219+0000 7f0719800640 1 --2- 172.21.15.123:0/668578759 >> [v2:172.21.15.123:6819/2231878927,v1:172.21.15.123:6822/2231878927] conn(0x7f06f4076140 0x7f06f4078580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.220+0000 7f0719800640 1 -- 172.21.15.123:0/668578759 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f06f406c9c0 msgr2=0x7f06f406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.220+0000 7f0719800640 1 --2- 172.21.15.123:0/668578759 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f06f406c9c0 0x7f06f406ee80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f07040011e0 tx=0x7f07040016f0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.220+0000 7f0719800640 1 -- 172.21.15.123:0/668578759 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f071409b6f0 msgr2=0x7f07140b1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.220+0000 7f0719800640 1 --2- 172.21.15.123:0/668578759 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f071409b6f0 0x7f07140b1f90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f070c009eb0 tx=0x7f070c004a40 comp rx=0 tx=0).stop 2024-04-17T05:27:23.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.220+0000 7f0718e00640 1 -- 172.21.15.123:0/668578759 reap_dead start 2024-04-17T05:27:23.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.221+0000 7f0719800640 1 -- 172.21.15.123:0/668578759 shutdown_connections 2024-04-17T05:27:23.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.221+0000 7f0719800640 1 -- 172.21.15.123:0/668578759 >> 172.21.15.123:0/668578759 conn(0x7f07140b9630 msgr2=0x7f0714142180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:23.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.221+0000 7f0719800640 1 -- 172.21.15.123:0/668578759 shutdown_connections 2024-04-17T05:27:23.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.221+0000 7f0719800640 1 -- 172.21.15.123:0/668578759 wait complete. 2024-04-17T05:27:23.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.221+0000 7f1a59200640 1 -- 172.21.15.123:0/425617460 --> [v2:172.21.15.164:6802/1376989593,v1:172.21.15.164:6805/1376989593] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1a540b72c0 con 0x7f1a34076270 2024-04-17T05:27:23.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.223+0000 7f1a4b400640 1 -- 172.21.15.123:0/425617460 <== osd.5 v2:172.21.15.164:6802/1376989593 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1a540b72c0 con 0x7f1a34076270 2024-04-17T05:27:23.245 INFO:teuthology.orchestra.run.smithi123.stdout:60129542154 2024-04-17T05:27:23.245 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-17T05:27:23.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.224+0000 7f1a59200640 1 -- 172.21.15.123:0/425617460 >> [v2:172.21.15.164:6802/1376989593,v1:172.21.15.164:6805/1376989593] conn(0x7f1a34076270 msgr2=0x7f1a340786b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.224+0000 7f1a59200640 1 --2- 172.21.15.123:0/425617460 >> [v2:172.21.15.164:6802/1376989593,v1:172.21.15.164:6805/1376989593] conn(0x7f1a34076270 0x7f1a340786b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.224+0000 7f1a59200640 1 -- 172.21.15.123:0/425617460 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f1a3406caf0 msgr2=0x7f1a3406efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.224+0000 7f1a59200640 1 --2- 172.21.15.123:0/425617460 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f1a3406caf0 0x7f1a3406efb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1a440090b0 tx=0x7f1a4403b040 comp rx=0 tx=0).stop 2024-04-17T05:27:23.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.224+0000 7f1a59200640 1 -- 172.21.15.123:0/425617460 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a540b61f0 msgr2=0x7f1a541e4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.224+0000 7f1a59200640 1 --2- 172.21.15.123:0/425617460 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1a540b61f0 0x7f1a541e4c60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c00c750 tx=0x7f1a4c00cc10 comp rx=0 tx=0).stop 2024-04-17T05:27:23.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.224+0000 7f1a53e00640 1 -- 172.21.15.123:0/425617460 reap_dead start 2024-04-17T05:27:23.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.224+0000 7f1a59200640 1 -- 172.21.15.123:0/425617460 shutdown_connections 2024-04-17T05:27:23.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.224+0000 7f1a59200640 1 -- 172.21.15.123:0/425617460 >> 172.21.15.123:0/425617460 conn(0x7f1a5406c260 msgr2=0x7f1a54152740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:23.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.225+0000 7f1a59200640 1 -- 172.21.15.123:0/425617460 shutdown_connections 2024-04-17T05:27:23.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.227+0000 7f1a59200640 1 -- 172.21.15.123:0/425617460 wait complete. 2024-04-17T05:27:23.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.227+0000 7f00bdc00640 1 -- 172.21.15.123:0/4289521196 --> [v2:172.21.15.123:6808/2898088574,v1:172.21.15.123:6809/2898088574] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f00b8075b30 con 0x7f0098076140 2024-04-17T05:27:23.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.228+0000 7f00afe00640 1 -- 172.21.15.123:0/4289521196 <== osd.3 v2:172.21.15.123:6808/2898088574 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f00b8075b30 con 0x7f0098076140 2024-04-17T05:27:23.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.228+0000 7fec51800640 1 -- 172.21.15.123:0/2601599654 --> [v2:172.21.15.164:6816/295402697,v1:172.21.15.164:6818/295402697] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fec24002dd0 con 0x7fec2c076220 2024-04-17T05:27:23.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.229+0000 7f00bdc00640 1 -- 172.21.15.123:0/4289521196 >> [v2:172.21.15.123:6808/2898088574,v1:172.21.15.123:6809/2898088574] conn(0x7f0098076140 msgr2=0x7f0098078580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.229+0000 7f00bdc00640 1 --2- 172.21.15.123:0/4289521196 >> [v2:172.21.15.123:6808/2898088574,v1:172.21.15.123:6809/2898088574] conn(0x7f0098076140 0x7f0098078580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.229+0000 7f00bdc00640 1 -- 172.21.15.123:0/4289521196 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f009806c9c0 msgr2=0x7f009806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.229+0000 7f2ddd600640 1 -- 172.21.15.123:0/3896699917 --> [v2:172.21.15.164:6817/1594306924,v1:172.21.15.164:6821/1594306924] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2dd814ba80 con 0x7f2db8075ff0 2024-04-17T05:27:23.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.229+0000 7f00bdc00640 1 --2- 172.21.15.123:0/4289521196 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f009806c9c0 0x7f009806ee80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f00b0036000 tx=0x7f00b0030000 comp rx=0 tx=0).stop 2024-04-17T05:27:23.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.229+0000 7f00bdc00640 1 -- 172.21.15.123:0/4289521196 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00b80b4470 msgr2=0x7f00b80b1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.229+0000 7f00bdc00640 1 --2- 172.21.15.123:0/4289521196 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00b80b4470 0x7f00b80b1dd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f00a400c3e0 tx=0x7f00a400c8a0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.229+0000 7fec43e00640 1 -- 172.21.15.123:0/2601599654 <== osd.7 v2:172.21.15.164:6816/295402697 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fec24002dd0 con 0x7fec2c076220 2024-04-17T05:27:23.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.229+0000 7f00bd200640 1 -- 172.21.15.123:0/4289521196 reap_dead start 2024-04-17T05:27:23.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.230+0000 7f00bdc00640 1 -- 172.21.15.123:0/4289521196 shutdown_connections 2024-04-17T05:27:23.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.230+0000 7fec51800640 1 -- 172.21.15.123:0/2601599654 >> [v2:172.21.15.164:6816/295402697,v1:172.21.15.164:6818/295402697] conn(0x7fec2c076220 msgr2=0x7fec2c078660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.230+0000 7fec51800640 1 --2- 172.21.15.123:0/2601599654 >> [v2:172.21.15.164:6816/295402697,v1:172.21.15.164:6818/295402697] conn(0x7fec2c076220 0x7fec2c078660 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.230+0000 7f00bdc00640 1 -- 172.21.15.123:0/4289521196 >> 172.21.15.123:0/4289521196 conn(0x7f00b806c040 msgr2=0x7f00b809b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:23.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.230+0000 7fec51800640 1 -- 172.21.15.123:0/2601599654 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fec2c06cb20 msgr2=0x7fec2c06efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.230+0000 7fec51800640 1 --2- 172.21.15.123:0/2601599654 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fec2c06cb20 0x7fec2c06efe0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fec38006fd0 tx=0x7fec38008040 comp rx=0 tx=0).stop 2024-04-17T05:27:23.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.230+0000 7fec51800640 1 -- 172.21.15.123:0/2601599654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec4c06dc70 msgr2=0x7fec4c072470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.230+0000 7fec51800640 1 --2- 172.21.15.123:0/2601599654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec4c06dc70 0x7fec4c072470 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fec3c0090b0 tx=0x7fec3c0046c0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.230+0000 7f00bdc00640 1 -- 172.21.15.123:0/4289521196 shutdown_connections 2024-04-17T05:27:23.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.231+0000 7fec50e00640 1 -- 172.21.15.123:0/2601599654 reap_dead start 2024-04-17T05:27:23.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.231+0000 7f00bdc00640 1 -- 172.21.15.123:0/4289521196 wait complete. 2024-04-17T05:27:23.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.231+0000 7fec51800640 1 -- 172.21.15.123:0/2601599654 shutdown_connections 2024-04-17T05:27:23.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.231+0000 7fec51800640 1 -- 172.21.15.123:0/2601599654 >> 172.21.15.123:0/2601599654 conn(0x7fec4c06c430 msgr2=0x7fec4c0b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:23.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.231+0000 7f2dcea00640 1 -- 172.21.15.123:0/3896699917 <== osd.6 v2:172.21.15.164:6817/1594306924 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2dd814ba80 con 0x7f2db8075ff0 2024-04-17T05:27:23.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.231+0000 7fec51800640 1 -- 172.21.15.123:0/2601599654 shutdown_connections 2024-04-17T05:27:23.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.231+0000 7fec51800640 1 -- 172.21.15.123:0/2601599654 wait complete. 2024-04-17T05:27:23.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.232+0000 7f2ddd600640 1 -- 172.21.15.123:0/3896699917 >> [v2:172.21.15.164:6817/1594306924,v1:172.21.15.164:6821/1594306924] conn(0x7f2db8075ff0 msgr2=0x7f2db8078430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.232+0000 7f2ddd600640 1 --2- 172.21.15.123:0/3896699917 >> [v2:172.21.15.164:6817/1594306924,v1:172.21.15.164:6821/1594306924] conn(0x7f2db8075ff0 0x7f2db8078430 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.232+0000 7f2ddd600640 1 -- 172.21.15.123:0/3896699917 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f2db806c8f0 msgr2=0x7f2db806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.232+0000 7f2ddd600640 1 --2- 172.21.15.123:0/3896699917 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f2db806c8f0 0x7f2db806edb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0007fd0 tx=0x7f2dd0009040 comp rx=0 tx=0).stop 2024-04-17T05:27:23.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.232+0000 7f2ddd600640 1 -- 172.21.15.123:0/3896699917 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dd8154f20 msgr2=0x7f2dd814a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.255 INFO:teuthology.orchestra.run.smithi123.stdout:60129542154 2024-04-17T05:27:23.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.232+0000 7f2ddd600640 1 --2- 172.21.15.123:0/3896699917 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2dd8154f20 0x7f2dd814a9d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8033000 tx=0x7f2dc80046c0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.232+0000 7f2dd7400640 1 -- 172.21.15.123:0/3896699917 reap_dead start 2024-04-17T05:27:23.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.232+0000 7f2ddd600640 1 -- 172.21.15.123:0/3896699917 shutdown_connections 2024-04-17T05:27:23.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.232+0000 7f2ddd600640 1 -- 172.21.15.123:0/3896699917 >> 172.21.15.123:0/3896699917 conn(0x7f2dd806bda0 msgr2=0x7f2dd809da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:23.256 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-17T05:27:23.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.232+0000 7f2ddd600640 1 -- 172.21.15.123:0/3896699917 shutdown_connections 2024-04-17T05:27:23.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.233+0000 7f2ddd600640 1 -- 172.21.15.123:0/3896699917 wait complete. 2024-04-17T05:27:23.257 INFO:teuthology.orchestra.run.smithi123.stdout:60129542154 2024-04-17T05:27:23.257 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-17T05:27:23.258 INFO:teuthology.orchestra.run.smithi123.stdout:60129542155 2024-04-17T05:27:23.259 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-17T05:27:23.259 INFO:teuthology.orchestra.run.smithi123.stdout:60129542155 2024-04-17T05:27:23.260 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-17T05:27:23.260 INFO:teuthology.orchestra.run.smithi123.stdout:60129542155 2024-04-17T05:27:23.261 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-17T05:27:23.261 INFO:teuthology.orchestra.run.smithi123.stdout:60129542156 2024-04-17T05:27:23.262 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-17T05:27:23.262 INFO:teuthology.orchestra.run.smithi123.stdout:60129542154 2024-04-17T05:27:23.263 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-17T05:27:23.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.585+0000 7f89f5a00640 1 Processor -- start 2024-04-17T05:27:23.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.586+0000 7f89f5a00640 1 -- start start 2024-04-17T05:27:23.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.587+0000 7f8b6fe00640 1 Processor -- start 2024-04-17T05:27:23.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.587+0000 7f8b6fe00640 1 -- start start 2024-04-17T05:27:23.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.587+0000 7f89f5a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f89f006d040 0x7f89f014b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.587+0000 7f89f5a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89f00aeca0 0x7f89f014bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.588+0000 7f89f5a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89f006d420 con 0x7f89f014a6d0 2024-04-17T05:27:23.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.588+0000 7f89f5a00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f89f00b3d50 con 0x7f89f006d040 2024-04-17T05:27:23.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.588+0000 7f89f5a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f89f00af1c0 con 0x7f89f00aeca0 2024-04-17T05:27:23.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.588+0000 7f89ef400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f89f014a6d0 0x7f89f014ab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54964/0 (socket says 172.21.15.123:54964) 2024-04-17T05:27:23.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.588+0000 7f89ef400640 1 -- 172.21.15.123:0/411740941 learned_addr learned my addr 172.21.15.123:0/411740941 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:27:23.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.588+0000 7f89eea00640 1 --2- 172.21.15.123:0/411740941 >> v2:172.21.15.123:3300/0 conn(0x7f89f006d040 0x7f89f014b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.589+0000 7f89ee000640 1 --2- 172.21.15.123:0/411740941 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89f00aeca0 0x7f89f014bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.589+0000 7fc9bd000640 1 Processor -- start 2024-04-17T05:27:23.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.589+0000 7f89ed600640 1 -- 172.21.15.123:0/411740941 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3778105589 0 0) 0x7f89f006d420 con 0x7f89f014a6d0 2024-04-17T05:27:23.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.589+0000 7f89ed600640 1 -- 172.21.15.123:0/411740941 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89d4003520 con 0x7f89f014a6d0 2024-04-17T05:27:23.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.589+0000 7f89eea00640 1 -- 172.21.15.123:0/411740941 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89f00aeca0 msgr2=0x7f89f014bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:23.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.589+0000 7f89eea00640 1 --2- 172.21.15.123:0/411740941 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89f00aeca0 0x7f89f014bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.589+0000 7f89eea00640 1 -- 172.21.15.123:0/411740941 >> v1:172.21.15.123:6789/0 conn(0x7f89f014a6d0 legacy=0x7f89f014ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.589+0000 7f89eea00640 1 -- 172.21.15.123:0/411740941 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f00af4a0 con 0x7f89f006d040 2024-04-17T05:27:23.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.590+0000 7f8b6fe00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f8b60006e90 0x7f8b60036590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.590+0000 7f8b6fe00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8b60033c40 0x7f8b600c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.590+0000 7f8b6fe00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b60029d70 con 0x7f8b600337c0 2024-04-17T05:27:23.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.590+0000 7f8b6fe00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f8b60029fe0 con 0x7f8b60033c40 2024-04-17T05:27:23.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.590+0000 7f8b6fe00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f8b60037010 con 0x7f8b60006e90 2024-04-17T05:27:23.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.591+0000 7f042ea00640 1 Processor -- start 2024-04-17T05:27:23.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.591+0000 7f042ea00640 1 -- start start 2024-04-17T05:27:23.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.590+0000 7fc9bd000640 1 -- start start 2024-04-17T05:27:23.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.591+0000 7f8b6de00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8b60033c40 0x7f8b600c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.591+0000 7fc9bd000640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc9b000c360 0x7fc9b0007ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.591+0000 7f8b6ca00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8b600337c0 0x7f8b600355f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54968/0 (socket says 172.21.15.123:54968) 2024-04-17T05:27:23.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.591+0000 7f8b6ca00640 1 -- 172.21.15.123:0/1629544246 learned_addr learned my addr 172.21.15.123:0/1629544246 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:27:23.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.592+0000 7fc9bd000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9b00ce5d0 con 0x7fc9b003ba90 2024-04-17T05:27:23.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.592+0000 7fc9bd000640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9b000c740 con 0x7fc9b003bef0 2024-04-17T05:27:23.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.592+0000 7fc9bd000640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7fc9b00d0b40 con 0x7fc9b000c360 2024-04-17T05:27:23.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.592+0000 7f8b6d400640 1 --2- 172.21.15.123:0/1629544246 >> v2:172.21.15.164:3300/0 conn(0x7f8b60006e90 0x7f8b60036590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.593+0000 7f042ea00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f042003a370 0x7f042003ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.593+0000 7f042ea00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f04200c6910 0x7f04200d6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.593+0000 7f8b6d400640 1 -- 172.21.15.123:0/1629544246 >> v2:172.21.15.123:3300/0 conn(0x7f8b60033c40 msgr2=0x7f8b600c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:23.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.593+0000 7fc9b7400640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc9b000c360 0x7fc9b0007ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.593+0000 7f042ea00640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04200cc730 con 0x7f04200ccef0 2024-04-17T05:27:23.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.593+0000 7f042ea00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f04200cca60 con 0x7f04200c6910 2024-04-17T05:27:23.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.593+0000 7f042ea00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f042003a750 con 0x7f042003a370 2024-04-17T05:27:23.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.593+0000 7fc9b7400640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc9b000c360 0x7fc9b0007ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.123:44638/0 (socket says 172.21.15.123:44638) 2024-04-17T05:27:23.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.593+0000 7fc9b7400640 1 -- 172.21.15.123:0/32707829 learned_addr learned my addr 172.21.15.123:0/32707829 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:23.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.593+0000 7f89eea00640 1 --2- 172.21.15.123:0/411740941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89f006d040 0x7f89f014b7e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f89d80097a0 tx=0x7f89d802b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12334a2101c2a4dc server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.593+0000 7f042e000640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f04200c6910 0x7f04200d6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.593+0000 7f042d600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f042003a370 0x7f042003ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.593+0000 7f042d600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f042003a370 0x7f042003ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.123:59502/0 (socket says 172.21.15.123:59502) 2024-04-17T05:27:23.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.593+0000 7f042d600640 1 -- 172.21.15.123:0/1778643638 learned_addr learned my addr 172.21.15.123:0/1778643638 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:23.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.593+0000 7f042e000640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f04200c6910 0x7f04200d6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.123:44646/0 (socket says 172.21.15.123:44646) 2024-04-17T05:27:23.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.593+0000 7f8b67e00640 1 -- 172.21.15.123:0/1629544246 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1113835662 0 0) 0x7f8b60029d70 con 0x7f8b600337c0 2024-04-17T05:27:23.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.593+0000 7f8b6d400640 1 --2- 172.21.15.123:0/1629544246 >> v2:172.21.15.123:3300/0 conn(0x7f8b60033c40 0x7f8b600c85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.593+0000 7f8b6d400640 1 -- 172.21.15.123:0/1629544246 >> v1:172.21.15.123:6789/0 conn(0x7f8b600337c0 legacy=0x7f8b600355f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.593+0000 7f8b6d400640 1 -- 172.21.15.123:0/1629544246 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b600c2be0 con 0x7f8b60006e90 2024-04-17T05:27:23.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.594+0000 7f8b6de00640 1 --2- 172.21.15.123:0/1629544246 >> v2:172.21.15.123:3300/0 conn(0x7f8b60033c40 0x7f8b600c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T05:27:23.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.594+0000 7fc9b6000640 1 -- 172.21.15.123:0/32707829 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1983732037 0 0) 0x7fc9b000c740 con 0x7fc9b003bef0 2024-04-17T05:27:23.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.594+0000 7fc9b6000640 1 -- 172.21.15.123:0/32707829 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9a0003520 con 0x7fc9b003bef0 2024-04-17T05:27:23.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.594+0000 7f89ed600640 1 -- 172.21.15.123:0/411740941 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d8037070 con 0x7f89f006d040 2024-04-17T05:27:23.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.594+0000 7f89ed600640 1 -- 172.21.15.123:0/411740941 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89d8030710 con 0x7f89f006d040 2024-04-17T05:27:23.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.594+0000 7f89ed600640 1 -- 172.21.15.123:0/411740941 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d8030b20 con 0x7f89f006d040 2024-04-17T05:27:23.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.594+0000 7f042e000640 1 -- 172.21.15.123:0/1778643638 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f042003a370 msgr2=0x7f042003ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:23.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.594+0000 7f042e000640 1 --2- 172.21.15.123:0/1778643638 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f042003a370 0x7f042003ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.594+0000 7f042e000640 1 -- 172.21.15.123:0/1778643638 >> v1:172.21.15.164:6789/0 conn(0x7f04200ccef0 legacy=0x7f04200c6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.594+0000 7f042e000640 1 -- 172.21.15.123:0/1778643638 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f042003b4f0 con 0x7f04200c6910 2024-04-17T05:27:23.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.595+0000 7f89f5a00640 1 -- 172.21.15.123:0/411740941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89f006d040 msgr2=0x7f89f014b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.595+0000 7f89f5a00640 1 --2- 172.21.15.123:0/411740941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89f006d040 0x7f89f014b7e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f89d80097a0 tx=0x7f89d802b730 comp rx=0 tx=0).stop 2024-04-17T05:27:23.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.595+0000 7f89f5a00640 1 -- 172.21.15.123:0/411740941 shutdown_connections 2024-04-17T05:27:23.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.596+0000 7f89f5a00640 1 --2- 172.21.15.123:0/411740941 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89f00aeca0 0x7f89f014bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.596+0000 7f89f5a00640 1 --2- 172.21.15.123:0/411740941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89f006d040 0x7f89f014b7e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.596+0000 7f89f5a00640 1 -- 172.21.15.123:0/411740941 >> 172.21.15.123:0/411740941 conn(0x7f89f006c040 msgr2=0x7f89f00b9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:23.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.596+0000 7f8b6d400640 1 --2- 172.21.15.123:0/1629544246 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b60006e90 0x7f8b60036590 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8b60007720 tx=0x7f8b5c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50053af7ceb14c5e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.595+0000 7fc9b7400640 1 -- 172.21.15.123:0/32707829 >> v1:172.21.15.164:6789/0 conn(0x7fc9b003bef0 legacy=0x7fc9b00db3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.595+0000 7fc9b7400640 1 -- 172.21.15.123:0/32707829 >> v1:172.21.15.123:6789/0 conn(0x7fc9b003ba90 legacy=0x7fc9b00d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.595+0000 7fc9b7400640 1 -- 172.21.15.123:0/32707829 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b001d410 con 0x7fc9b000c360 2024-04-17T05:27:23.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.596+0000 7f89f5a00640 1 -- 172.21.15.123:0/411740941 shutdown_connections 2024-04-17T05:27:23.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.596+0000 7f042e000640 1 --2- 172.21.15.123:0/1778643638 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f04200c6910 0x7f04200d6ea0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f041c0097a0 tx=0x7f041c02b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab206d2a8f3f0a82 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.596+0000 7f8b67e00640 1 -- 172.21.15.123:0/1629544246 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c035020 con 0x7f8b60006e90 2024-04-17T05:27:23.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.597+0000 7f0427e00640 1 -- 172.21.15.123:0/1778643638 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041c038070 con 0x7f04200c6910 2024-04-17T05:27:23.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.597+0000 7f0427e00640 1 -- 172.21.15.123:0/1778643638 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f041c031710 con 0x7f04200c6910 2024-04-17T05:27:23.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.597+0000 7f8b67e00640 1 -- 172.21.15.123:0/1629544246 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b5c031830 con 0x7f8b60006e90 2024-04-17T05:27:23.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.597+0000 7f8b67e00640 1 -- 172.21.15.123:0/1629544246 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c031c00 con 0x7f8b60006e90 2024-04-17T05:27:23.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.597+0000 7f56e9000640 1 Processor -- start 2024-04-17T05:27:23.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.596+0000 7f89f5a00640 1 -- 172.21.15.123:0/411740941 wait complete. 2024-04-17T05:27:23.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.598+0000 7f56e9000640 1 -- start start 2024-04-17T05:27:23.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.598+0000 7f8b6fe00640 1 -- 172.21.15.123:0/1629544246 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b60006e90 msgr2=0x7f8b60036590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.598+0000 7f8b6fe00640 1 --2- 172.21.15.123:0/1629544246 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b60006e90 0x7f8b60036590 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8b60007720 tx=0x7f8b5c02b8d0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.598+0000 7f8b6fe00640 1 -- 172.21.15.123:0/1629544246 shutdown_connections 2024-04-17T05:27:23.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.598+0000 7f8b6fe00640 1 --2- 172.21.15.123:0/1629544246 >> v2:172.21.15.123:3300/0 conn(0x7f8b60033c40 0x7f8b600c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.598+0000 7f8b6fe00640 1 --2- 172.21.15.123:0/1629544246 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b60006e90 0x7f8b60036590 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.598+0000 7f8b6fe00640 1 -- 172.21.15.123:0/1629544246 >> 172.21.15.123:0/1629544246 conn(0x7f8b6003a890 msgr2=0x7f8b6003aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:23.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.598+0000 7f89f5a00640 1 Processor -- start 2024-04-17T05:27:23.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.597+0000 7f0427e00640 1 -- 172.21.15.123:0/1778643638 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041c031b20 con 0x7f04200c6910 2024-04-17T05:27:23.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.599+0000 7f89f5a00640 1 -- start start 2024-04-17T05:27:23.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.599+0000 7f042ea00640 1 -- 172.21.15.123:0/1778643638 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f04200c6910 msgr2=0x7f04200d6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.599+0000 7f042ea00640 1 --2- 172.21.15.123:0/1778643638 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f04200c6910 0x7f04200d6ea0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f041c0097a0 tx=0x7f041c02b7b0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.599+0000 7f042ea00640 1 -- 172.21.15.123:0/1778643638 shutdown_connections 2024-04-17T05:27:23.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.599+0000 7f042ea00640 1 --2- 172.21.15.123:0/1778643638 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f04200c6910 0x7f04200d6ea0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.599+0000 7f042ea00640 1 --2- 172.21.15.123:0/1778643638 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f042003a370 0x7f042003ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.599+0000 7f042ea00640 1 -- 172.21.15.123:0/1778643638 >> 172.21.15.123:0/1778643638 conn(0x7f042003ec80 msgr2=0x7f042003f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:23.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.599+0000 7f042ea00640 1 -- 172.21.15.123:0/1778643638 shutdown_connections 2024-04-17T05:27:23.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.599+0000 7f042ea00640 1 -- 172.21.15.123:0/1778643638 wait complete. 2024-04-17T05:27:23.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.599+0000 7fc9b7400640 1 --2- 172.21.15.123:0/32707829 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9b000c360 0x7fc9b0007ff0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc9b802db60 tx=0x7fc9b80a7130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=354b455cec42648 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.598+0000 7f8b6fe00640 1 -- 172.21.15.123:0/1629544246 shutdown_connections 2024-04-17T05:27:23.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.599+0000 7f8b6fe00640 1 -- 172.21.15.123:0/1629544246 wait complete. 2024-04-17T05:27:23.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.600+0000 7f89f5a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89f006d040 0x7f89f00b2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.600+0000 7f89f5a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89f00aeca0 0x7f89f01e16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.600+0000 7f89f5a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89f014a6d0 0x7f89f00b0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.600+0000 7f56e9000640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f56e409df90 0x7f56e406d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.600+0000 7f56e9000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f56e40b5480 0x7f56e409cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.600+0000 7f89f5a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f89f00b5940 con 0x7f89f006d040 2024-04-17T05:27:23.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.600+0000 7f89f5a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f89f006df30 con 0x7f89f014a6d0 2024-04-17T05:27:23.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.600+0000 7f89f5a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f89f00b5ac0 con 0x7f89f00aeca0 2024-04-17T05:27:23.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.600+0000 7fc70a200640 1 Processor -- start 2024-04-17T05:27:23.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.600+0000 7fc70a200640 1 -- start start 2024-04-17T05:27:23.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.600+0000 7fc9b6000640 1 -- 172.21.15.123:0/32707829 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b80b4070 con 0x7fc9b000c360 2024-04-17T05:27:23.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.600+0000 7f56e9000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56e40b3db0 0x7f56e40b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.600+0000 7f56e9000640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f56e409c520 con 0x7f56e40b5480 2024-04-17T05:27:23.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.600+0000 7f56e9000640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f56e406d5a0 con 0x7f56e409df90 2024-04-17T05:27:23.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.600+0000 7f56e9000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f56e409e370 con 0x7f56e40b3db0 2024-04-17T05:27:23.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.600+0000 7f56e1400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f56e40b5480 0x7f56e409cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.600+0000 7f89eea00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89f006d040 0x7f89f00b2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.600+0000 7f89ee000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89f00aeca0 0x7f89f01e16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.600+0000 7f89ee000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89f00aeca0 0x7f89f01e16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.123:59514/0 (socket says 172.21.15.123:59514) 2024-04-17T05:27:23.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.600+0000 7f56e1400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f56e40b5480 0x7f56e409cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38246/0 (socket says 172.21.15.123:38246) 2024-04-17T05:27:23.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.600+0000 7f56e1400640 1 -- 172.21.15.123:0/3984478366 learned_addr learned my addr 172.21.15.123:0/3984478366 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:23.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.600+0000 7f89ee000640 1 -- 172.21.15.123:0/1732410832 learned_addr learned my addr 172.21.15.123:0/1732410832 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:23.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.600+0000 7fc9b6000640 1 -- 172.21.15.123:0/32707829 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b80af440 con 0x7fc9b000c360 2024-04-17T05:27:23.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.600+0000 7fc9b6000640 1 -- 172.21.15.123:0/32707829 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b80af870 con 0x7fc9b000c360 2024-04-17T05:27:23.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.601+0000 7f56e1e00640 1 --2- 172.21.15.123:0/3984478366 >> v2:172.21.15.164:3300/0 conn(0x7f56e409df90 0x7f56e406d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.601+0000 7f56e2800640 1 --2- 172.21.15.123:0/3984478366 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56e40b3db0 0x7f56e40b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.601+0000 7f89ef400640 1 --2- 172.21.15.123:0/1732410832 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89f014a6d0 0x7f89f00b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.601+0000 7f56e1400640 1 -- 172.21.15.123:0/3984478366 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56e40b3db0 msgr2=0x7f56e40b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:23.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.601+0000 7f56e1400640 1 --2- 172.21.15.123:0/3984478366 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56e40b3db0 0x7f56e40b41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.601+0000 7f56e1400640 1 -- 172.21.15.123:0/3984478366 >> v2:172.21.15.164:3300/0 conn(0x7f56e409df90 msgr2=0x7f56e406d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:23.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.601+0000 7f56e1400640 1 --2- 172.21.15.123:0/3984478366 >> v2:172.21.15.164:3300/0 conn(0x7f56e409df90 0x7f56e406d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.601+0000 7f56e1400640 1 -- 172.21.15.123:0/3984478366 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e409d520 con 0x7f56e40b5480 2024-04-17T05:27:23.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.602+0000 7f89ee000640 1 -- 172.21.15.123:0/1732410832 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89f014a6d0 msgr2=0x7f89f00b0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.602+0000 7f042ea00640 1 Processor -- start 2024-04-17T05:27:23.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.602+0000 7f8b6fe00640 1 Processor -- start 2024-04-17T05:27:23.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.602+0000 7f89ee000640 1 --2- 172.21.15.123:0/1732410832 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89f014a6d0 0x7f89f00b0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.602+0000 7f89ee000640 1 -- 172.21.15.123:0/1732410832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89f006d040 msgr2=0x7f89f00b2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.602+0000 7f89ee000640 1 --2- 172.21.15.123:0/1732410832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89f006d040 0x7f89f00b2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.602+0000 7f89ee000640 1 -- 172.21.15.123:0/1732410832 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f01e51d0 con 0x7f89f00aeca0 2024-04-17T05:27:23.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.602+0000 7f89eea00640 1 --2- 172.21.15.123:0/1732410832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89f006d040 0x7f89f00b2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T05:27:23.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.602+0000 7fc9bd000640 1 -- 172.21.15.123:0/32707829 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9b000c360 msgr2=0x7fc9b0007ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.602+0000 7fc9bd000640 1 --2- 172.21.15.123:0/32707829 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9b000c360 0x7fc9b0007ff0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc9b802db60 tx=0x7fc9b80a7130 comp rx=0 tx=0).stop 2024-04-17T05:27:23.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.602+0000 7f8b6fe00640 1 -- start start 2024-04-17T05:27:23.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.602+0000 7fc9bd000640 1 -- 172.21.15.123:0/32707829 shutdown_connections 2024-04-17T05:27:23.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.602+0000 7fc9bd000640 1 --2- 172.21.15.123:0/32707829 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9b000c360 0x7fc9b0007ff0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.602+0000 7fc9bd000640 1 -- 172.21.15.123:0/32707829 >> 172.21.15.123:0/32707829 conn(0x7fc9b000b5d0 msgr2=0x7fc9b000b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:23.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.602+0000 7fc70a200640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc704147390 0x7fc7041444a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.602+0000 7fc70a200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc7041449e0 0x7fc70414e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.602+0000 7fc70a200640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc704144df0 con 0x7fc70406d040 2024-04-17T05:27:23.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.602+0000 7fc70a200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc7040ae950 con 0x7fc7041449e0 2024-04-17T05:27:23.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.602+0000 7fc70a200640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7fc70406d420 con 0x7fc704147390 2024-04-17T05:27:23.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.603+0000 7f042ea00640 1 -- start start 2024-04-17T05:27:23.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.603+0000 7fc9bd000640 1 -- 172.21.15.123:0/32707829 shutdown_connections 2024-04-17T05:27:23.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.603+0000 7fc9bd000640 1 -- 172.21.15.123:0/32707829 wait complete. 2024-04-17T05:27:23.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.603+0000 7fc709800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc7041449e0 0x7fc70414e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.602+0000 7f89ee000640 1 --2- 172.21.15.123:0/1732410832 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89f00aeca0 0x7f89f01e16b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f89e000d800 tx=0x7f89e000dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.604+0000 7f89e6a00640 1 -- 172.21.15.123:0/1732410832 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e000b6c0 con 0x7f89f00aeca0 2024-04-17T05:27:23.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.604+0000 7f89e6a00640 1 -- 172.21.15.123:0/1732410832 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e0019070 con 0x7f89f00aeca0 2024-04-17T05:27:23.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.604+0000 7f89e6a00640 1 -- 172.21.15.123:0/1732410832 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e000ba80 con 0x7f89f00aeca0 2024-04-17T05:27:23.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.604+0000 7f89f5a00640 1 -- 172.21.15.123:0/1732410832 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89f00b3070 con 0x7f89f00aeca0 2024-04-17T05:27:23.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.604+0000 7f042ea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f042003a370 0x7f04200ca600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.604+0000 7f042ea00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04200c6910 0x7f0420163290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.604+0000 7f042ea00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f04200ccef0 0x7f04201637d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.604+0000 7f042ea00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0420039390 con 0x7f04200c6910 2024-04-17T05:27:23.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.604+0000 7f042ea00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f0420039210 con 0x7f042003a370 2024-04-17T05:27:23.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.604+0000 7f042ea00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f04200cd350 con 0x7f04200ccef0 2024-04-17T05:27:23.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.604+0000 7f8b6fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b60006e90 0x7f8b600c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.604+0000 7f8b6fe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b600337c0 0x7f8b60167e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.603+0000 7f56e1400640 1 --2- 172.21.15.123:0/3984478366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56e40b5480 0x7f56e409cba0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f56e4050880 tx=0x7f56d002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9cccc1401a4474 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.603+0000 7fc703e00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc704147390 0x7fc7041444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.603+0000 7fc703e00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc704147390 0x7fc7041444a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.123:44670/0 (socket says 172.21.15.123:44670) 2024-04-17T05:27:23.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.603+0000 7fc703e00640 1 -- 172.21.15.123:0/1726920582 learned_addr learned my addr 172.21.15.123:0/1726920582 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:23.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.604+0000 7f8b6fe00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b60033c40 0x7f8b601683a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.604+0000 7f8b6fe00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8b600c8c70 con 0x7f8b600337c0 2024-04-17T05:27:23.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.604+0000 7f8b6fe00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8b600c8af0 con 0x7f8b60006e90 2024-04-17T05:27:23.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.604+0000 7f8b6fe00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f8b600c8df0 con 0x7f8b60033c40 2024-04-17T05:27:23.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.604+0000 7f042cc00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04200c6910 0x7f0420163290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.604+0000 7f042e000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f04200ccef0 0x7f04201637d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.604+0000 7f89f5a00640 1 -- 172.21.15.123:0/1732410832 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f89f00b35d0 con 0x7f89f00aeca0 2024-04-17T05:27:23.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.604+0000 7f042e000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f04200ccef0 0x7f04201637d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.123:59536/0 (socket says 172.21.15.123:59536) 2024-04-17T05:27:23.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.604+0000 7f042e000640 1 -- 172.21.15.123:0/3495038468 learned_addr learned my addr 172.21.15.123:0/3495038468 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:23.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.605+0000 7f8b6de00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b60033c40 0x7f8b601683a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.605+0000 7f8b6de00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b60033c40 0x7f8b601683a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.123:59544/0 (socket says 172.21.15.123:59544) 2024-04-17T05:27:23.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.605+0000 7f8b6de00640 1 -- 172.21.15.123:0/3116896377 learned_addr learned my addr 172.21.15.123:0/3116896377 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:23.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.605+0000 7f8b6ca00640 1 --2- 172.21.15.123:0/3116896377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b600337c0 0x7f8b60167e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.605+0000 7f56e0a00640 1 -- 172.21.15.123:0/3984478366 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d0038070 con 0x7f56e40b5480 2024-04-17T05:27:23.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.605+0000 7f56e0a00640 1 -- 172.21.15.123:0/3984478366 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d002f050 con 0x7f56e40b5480 2024-04-17T05:27:23.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.605+0000 7f56e0a00640 1 -- 172.21.15.123:0/3984478366 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d0031970 con 0x7f56e40b5480 2024-04-17T05:27:23.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.605+0000 7fc867e00640 1 Processor -- start 2024-04-17T05:27:23.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.605+0000 7fc867e00640 1 -- start start 2024-04-17T05:27:23.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.605+0000 7f042d600640 1 --2- 172.21.15.123:0/3495038468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f042003a370 0x7f04200ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.605+0000 7f042e000640 1 -- 172.21.15.123:0/3495038468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f042003a370 msgr2=0x7f04200ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.605+0000 7f042e000640 1 --2- 172.21.15.123:0/3495038468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f042003a370 0x7f04200ca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.605+0000 7f042e000640 1 -- 172.21.15.123:0/3495038468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04200c6910 msgr2=0x7f0420163290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.605+0000 7f042e000640 1 --2- 172.21.15.123:0/3495038468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04200c6910 0x7f0420163290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.605+0000 7f042e000640 1 -- 172.21.15.123:0/3495038468 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04200d0620 con 0x7f04200ccef0 2024-04-17T05:27:23.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.606+0000 7f8b6ca00640 1 -- 172.21.15.123:0/3116896377 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b60033c40 msgr2=0x7f8b601683a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.606+0000 7f8b6d400640 1 --2- 172.21.15.123:0/3116896377 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b60006e90 0x7f8b600c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.606+0000 7fc703400640 1 -- 172.21.15.123:0/1726920582 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3690127661 0 0) 0x7fc704144df0 con 0x7fc70406d040 2024-04-17T05:27:23.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.606+0000 7fc703400640 1 -- 172.21.15.123:0/1726920582 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6e8003520 con 0x7fc70406d040 2024-04-17T05:27:23.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.606+0000 7f56e9000640 1 -- 172.21.15.123:0/3984478366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56e40b5480 msgr2=0x7f56e409cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.606+0000 7f56e9000640 1 --2- 172.21.15.123:0/3984478366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56e40b5480 0x7f56e409cba0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f56e4050880 tx=0x7f56d002b7f0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.606+0000 7f89f5a00640 1 -- 172.21.15.123:0/1732410832 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89f0075b30 con 0x7f89f00aeca0 2024-04-17T05:27:23.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.606+0000 7f56e9000640 1 -- 172.21.15.123:0/3984478366 shutdown_connections 2024-04-17T05:27:23.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.606+0000 7f56e9000640 1 --2- 172.21.15.123:0/3984478366 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56e40b3db0 0x7f56e40b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.606+0000 7f56e9000640 1 --2- 172.21.15.123:0/3984478366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56e40b5480 0x7f56e409cba0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.606+0000 7f56e9000640 1 --2- 172.21.15.123:0/3984478366 >> v2:172.21.15.164:3300/0 conn(0x7f56e409df90 0x7f56e406d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.606+0000 7f56e9000640 1 -- 172.21.15.123:0/3984478366 >> 172.21.15.123:0/3984478366 conn(0x7f56e40b93b0 msgr2=0x7f56e40b97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:23.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.606+0000 7fc867e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc86814c350 0x7fc86814c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.606+0000 7fc867e00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc86814cd00 con 0x7fc8680b1ed0 2024-04-17T05:27:23.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.606+0000 7fc867e00640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8680b3980 con 0x7fc8680b22b0 2024-04-17T05:27:23.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.606+0000 7fc867e00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc8680b3750 con 0x7fc86814c350 2024-04-17T05:27:23.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.606+0000 7f042e000640 1 --2- 172.21.15.123:0/3495038468 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f04200ccef0 0x7f04201637d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f041c0097a0 tx=0x7f041c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.607+0000 7f56e9000640 1 -- 172.21.15.123:0/3984478366 shutdown_connections 2024-04-17T05:27:23.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.607+0000 7fc703e00640 1 -- 172.21.15.123:0/1726920582 >> v2:172.21.15.123:3300/0 conn(0x7fc7041449e0 msgr2=0x7fc70414e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:23.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.607+0000 7fc703e00640 1 --2- 172.21.15.123:0/1726920582 >> v2:172.21.15.123:3300/0 conn(0x7fc7041449e0 0x7fc70414e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.607+0000 7fc703e00640 1 -- 172.21.15.123:0/1726920582 >> v1:172.21.15.164:6789/0 conn(0x7fc70406d040 legacy=0x7fc7040b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.607+0000 7fc703400640 1 -- 172.21.15.123:0/1726920582 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2699541337 0 0) 0x7fc6e8003520 con 0x7fc70406d040 2024-04-17T05:27:23.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.607+0000 7fc703e00640 1 -- 172.21.15.123:0/1726920582 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7040aec30 con 0x7fc704147390 2024-04-17T05:27:23.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.606+0000 7f8b6ca00640 1 --2- 172.21.15.123:0/3116896377 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b60033c40 0x7f8b601683a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.606+0000 7f8b6ca00640 1 -- 172.21.15.123:0/3116896377 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b60006e90 msgr2=0x7f8b600c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.606+0000 7f8b6ca00640 1 --2- 172.21.15.123:0/3116896377 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b60006e90 0x7f8b600c4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.606+0000 7f8b6ca00640 1 -- 172.21.15.123:0/3116896377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b6002e340 con 0x7f8b600337c0 2024-04-17T05:27:23.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.607+0000 7f8b6d400640 1 --2- 172.21.15.123:0/3116896377 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b60006e90 0x7f8b600c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:23.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.607+0000 7f56e9000640 1 -- 172.21.15.123:0/3984478366 wait complete. 2024-04-17T05:27:23.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.607+0000 7fc867400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc86814c350 0x7fc86814c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.607+0000 7fc867400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc86814c350 0x7fc86814c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38274/0 (socket says 172.21.15.123:38274) 2024-04-17T05:27:23.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.607+0000 7fc867400640 1 -- 172.21.15.123:0/1836808294 learned_addr learned my addr 172.21.15.123:0/1836808294 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:23.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.607+0000 7f0425600640 1 -- 172.21.15.123:0/3495038468 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041c042070 con 0x7f04200ccef0 2024-04-17T05:27:23.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.607+0000 7fc867400640 1 -- 172.21.15.123:0/1836808294 >> v1:172.21.15.164:6789/0 conn(0x7fc8680b22b0 legacy=0x7fc8680b9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:23.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.607+0000 7fc867400640 1 -- 172.21.15.123:0/1836808294 >> v1:172.21.15.123:6789/0 conn(0x7fc8680b1ed0 legacy=0x7fc8680b7280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T05:27:23.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.607+0000 7fc867400640 1 -- 172.21.15.123:0/1836808294 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8680b3c60 con 0x7fc86814c350 2024-04-17T05:27:23.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.608+0000 7f042ea00640 1 -- 172.21.15.123:0/3495038468 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04200c9b00 con 0x7f04200ccef0 2024-04-17T05:27:23.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.608+0000 7f0425600640 1 -- 172.21.15.123:0/3495038468 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f041c03d870 con 0x7f04200ccef0 2024-04-17T05:27:23.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.608+0000 7f0425600640 1 -- 172.21.15.123:0/3495038468 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041c038040 con 0x7f04200ccef0 2024-04-17T05:27:23.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.608+0000 7f8b6ca00640 1 --2- 172.21.15.123:0/3116896377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b600337c0 0x7f8b60167e60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8b5400c450 tx=0x7f8b5400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.608+0000 7f8b65600640 1 -- 172.21.15.123:0/3116896377 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b54018070 con 0x7f8b600337c0 2024-04-17T05:27:23.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.609+0000 7f56e9000640 1 Processor -- start 2024-04-17T05:27:23.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.609+0000 7fc9bd000640 1 Processor -- start 2024-04-17T05:27:23.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.609+0000 7f8b65600640 1 -- 172.21.15.123:0/3116896377 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b540074e0 con 0x7f8b600337c0 2024-04-17T05:27:23.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.609+0000 7f8b65600640 1 -- 172.21.15.123:0/3116896377 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b54018070 con 0x7f8b600337c0 2024-04-17T05:27:23.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.609+0000 7f56e9000640 1 -- start start 2024-04-17T05:27:23.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.609+0000 7fc867400640 1 --2- 172.21.15.123:0/1836808294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc86814c350 0x7fc86814c7c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc860009e50 tx=0x7fc86002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2605850c50ae43c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.609+0000 7fc9bd000640 1 -- start start 2024-04-17T05:27:23.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.608+0000 7f042ea00640 1 -- 172.21.15.123:0/3495038468 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f04200d0240 con 0x7f04200ccef0 2024-04-17T05:27:23.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.608+0000 7f042cc00640 1 --2- 172.21.15.123:0/3495038468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04200c6910 0x7f0420163290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T05:27:23.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.609+0000 7f8b6fe00640 1 -- 172.21.15.123:0/3116896377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b6002b790 con 0x7f8b600337c0 2024-04-17T05:27:23.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.608+0000 7f89e6a00640 1 -- 172.21.15.123:0/1732410832 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f89e000bc20 con 0x7f89f00aeca0 2024-04-17T05:27:23.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.610+0000 7f89e6a00640 1 --2- 172.21.15.123:0/1732410832 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f89cc06c9c0 0x7f89cc06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.609+0000 7fc703e00640 1 --2- 172.21.15.123:0/1726920582 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc704147390 0x7fc7041444a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc7040b3890 tx=0x7fc6f002b770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7f01b7c897b715a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.609+0000 7fc703400640 1 -- 172.21.15.123:0/1726920582 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f0037070 con 0x7fc704147390 2024-04-17T05:27:23.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.610+0000 7fc703400640 1 -- 172.21.15.123:0/1726920582 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6f0030510 con 0x7fc704147390 2024-04-17T05:27:23.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.610+0000 7fc703400640 1 -- 172.21.15.123:0/1726920582 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc001a10 con 0x7fc704147390 2024-04-17T05:27:23.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.610+0000 7f8b6fe00640 1 -- 172.21.15.123:0/3116896377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b6002c790 con 0x7f8b600337c0 2024-04-17T05:27:23.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.610+0000 7f56e9000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56e409df90 0x7f56e41d2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.610+0000 7f56e9000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56e40b3db0 0x7f56e4099e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.610+0000 7f56e9000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56e40b5480 0x7f56e40b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.610+0000 7f56e9000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f56e409d0e0 con 0x7f56e40b5480 2024-04-17T05:27:23.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.610+0000 7f56e9000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f56e40b5b60 con 0x7f56e409df90 2024-04-17T05:27:23.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.610+0000 7f56e9000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f56e409d260 con 0x7f56e40b3db0 2024-04-17T05:27:23.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.611+0000 7fc9bd000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9b000c360 0x7fc9b00388d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.611+0000 7fc9bd000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9b003ba90 0x7fc9b0034a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.611+0000 7fc9bd000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9b003bef0 0x7fc9b0034fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.611+0000 7f56e1e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56e409df90 0x7f56e41d2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.611+0000 7f041aa00640 1 -- 172.21.15.123:0/3495038468 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0420005390 con 0x7f04200ccef0 2024-04-17T05:27:23.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.611+0000 7fc865600640 1 -- 172.21.15.123:0/1836808294 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86002c9f0 con 0x7fc86814c350 2024-04-17T05:27:23.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.611+0000 7fc865600640 1 -- 172.21.15.123:0/1836808294 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc86002cb90 con 0x7fc86814c350 2024-04-17T05:27:23.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.611+0000 7fc865600640 1 -- 172.21.15.123:0/1836808294 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8600343f0 con 0x7fc86814c350 2024-04-17T05:27:23.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.611+0000 7fc9bd000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b00d0d90 con 0x7fc9b000c360 2024-04-17T05:27:23.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.611+0000 7fc9bd000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b0009730 con 0x7fc9b003bef0 2024-04-17T05:27:23.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.611+0000 7fc9bd000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fc9b00d19c0 con 0x7fc9b003ba90 2024-04-17T05:27:23.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.610+0000 7f89e6a00640 1 -- 172.21.15.123:0/1732410832 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f89e008c200 con 0x7f89f00aeca0 2024-04-17T05:27:23.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.611+0000 7f56e2800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56e40b5480 0x7f56e40b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.611+0000 7f56e2800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56e40b5480 0x7f56e40b07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38280/0 (socket says 172.21.15.123:38280) 2024-04-17T05:27:23.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.611+0000 7f56e2800640 1 -- 172.21.15.123:0/2596116576 learned_addr learned my addr 172.21.15.123:0/2596116576 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:23.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.611+0000 7fc70a200640 1 -- 172.21.15.123:0/1726920582 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc704147390 msgr2=0x7fc7041444a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.611+0000 7fc70a200640 1 --2- 172.21.15.123:0/1726920582 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc704147390 0x7fc7041444a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc7040b3890 tx=0x7fc6f002b770 comp rx=0 tx=0).stop 2024-04-17T05:27:23.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.611+0000 7f56e1400640 1 --2- 172.21.15.123:0/2596116576 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56e40b3db0 0x7f56e4099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.611+0000 7fc9b7400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9b000c360 0x7fc9b00388d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.612+0000 7fc9b7400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9b000c360 0x7fc9b00388d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38284/0 (socket says 172.21.15.123:38284) 2024-04-17T05:27:23.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.612+0000 7fc9b7400640 1 -- 172.21.15.123:0/2343700403 learned_addr learned my addr 172.21.15.123:0/2343700403 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:23.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.612+0000 7fc867e00640 1 -- 172.21.15.123:0/1836808294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc86814c350 msgr2=0x7fc86814c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.612+0000 7fc867e00640 1 --2- 172.21.15.123:0/1836808294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc86814c350 0x7fc86814c7c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc860009e50 tx=0x7fc86002be50 comp rx=0 tx=0).stop 2024-04-17T05:27:23.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.612+0000 7f56e2800640 1 -- 172.21.15.123:0/2596116576 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56e40b3db0 msgr2=0x7f56e4099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.612+0000 7f56e2800640 1 --2- 172.21.15.123:0/2596116576 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56e40b3db0 0x7f56e4099e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.612+0000 7f56e2800640 1 -- 172.21.15.123:0/2596116576 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56e409df90 msgr2=0x7f56e41d2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.612+0000 7f56e2800640 1 --2- 172.21.15.123:0/2596116576 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56e409df90 0x7f56e41d2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.612+0000 7f56e2800640 1 -- 172.21.15.123:0/2596116576 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e409a590 con 0x7f56e40b5480 2024-04-17T05:27:23.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.612+0000 7fc70a200640 1 -- 172.21.15.123:0/1726920582 shutdown_connections 2024-04-17T05:27:23.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.612+0000 7fc70a200640 1 --2- 172.21.15.123:0/1726920582 >> v2:172.21.15.123:3300/0 conn(0x7fc7041449e0 0x7fc70414e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.612+0000 7fc70a200640 1 --2- 172.21.15.123:0/1726920582 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc704147390 0x7fc7041444a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.612+0000 7fc70a200640 1 -- 172.21.15.123:0/1726920582 >> 172.21.15.123:0/1726920582 conn(0x7fc70406c430 msgr2=0x7fc7040b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:23.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.612+0000 7fc9b6a00640 1 --2- 172.21.15.123:0/2343700403 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9b003ba90 0x7fc9b0034a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.612+0000 7f89eea00640 1 --2- 172.21.15.123:0/1732410832 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f89cc06c9c0 0x7f89cc06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.613+0000 7f56e2800640 1 --2- 172.21.15.123:0/2596116576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56e40b5480 0x7f56e40b07b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f56dc007e40 tx=0x7f56dc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.613+0000 7f8b6fe00640 1 -- 172.21.15.123:0/3116896377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b60005380 con 0x7f8b600337c0 2024-04-17T05:27:23.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.613+0000 7fc9b7e00640 1 --2- 172.21.15.123:0/2343700403 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9b003bef0 0x7fc9b0034fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.613+0000 7fc9b7400640 1 -- 172.21.15.123:0/2343700403 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9b003ba90 msgr2=0x7fc9b0034a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.613+0000 7fc9b7400640 1 --2- 172.21.15.123:0/2343700403 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9b003ba90 0x7fc9b0034a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.613+0000 7fc9b7400640 1 -- 172.21.15.123:0/2343700403 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9b003bef0 msgr2=0x7fc9b0034fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.613+0000 7fc9b7400640 1 --2- 172.21.15.123:0/2343700403 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9b003bef0 0x7fc9b0034fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.613+0000 7fc9b7400640 1 -- 172.21.15.123:0/2343700403 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b01577e0 con 0x7fc9b000c360 2024-04-17T05:27:23.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.613+0000 7fc867e00640 1 -- 172.21.15.123:0/1836808294 shutdown_connections 2024-04-17T05:27:23.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.613+0000 7fc867e00640 1 --2- 172.21.15.123:0/1836808294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc86814c350 0x7fc86814c7c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.613+0000 7fc867e00640 1 -- 172.21.15.123:0/1836808294 >> 172.21.15.123:0/1836808294 conn(0x7fc86806c260 msgr2=0x7fc8680b9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:23.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.613+0000 7fc867e00640 1 -- 172.21.15.123:0/1836808294 shutdown_connections 2024-04-17T05:27:23.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.613+0000 7f56da000640 1 -- 172.21.15.123:0/2596116576 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56dc014620 con 0x7f56e40b5480 2024-04-17T05:27:23.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.613+0000 7f56da000640 1 -- 172.21.15.123:0/2596116576 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56dc019070 con 0x7f56e40b5480 2024-04-17T05:27:23.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.613+0000 7f56da000640 1 -- 172.21.15.123:0/2596116576 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56dc014a00 con 0x7f56e40b5480 2024-04-17T05:27:23.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.613+0000 7fc9b6a00640 1 --2- 172.21.15.123:0/2343700403 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9b003ba90 0x7fc9b0034a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:23.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.613+0000 7fc9b7e00640 1 --2- 172.21.15.123:0/2343700403 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9b003bef0 0x7fc9b0034fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:23.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.613+0000 7fc867e00640 1 -- 172.21.15.123:0/1836808294 wait complete. 2024-04-17T05:27:23.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.613+0000 7fc70a200640 1 -- 172.21.15.123:0/1726920582 shutdown_connections 2024-04-17T05:27:23.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.613+0000 7fc70a200640 1 -- 172.21.15.123:0/1726920582 wait complete. 2024-04-17T05:27:23.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.613+0000 7f56e9000640 1 -- 172.21.15.123:0/2596116576 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56e40b2380 con 0x7f56e40b5480 2024-04-17T05:27:23.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.613+0000 7f56e9000640 1 -- 172.21.15.123:0/2596116576 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e40b2940 con 0x7f56e40b5480 2024-04-17T05:27:23.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.613+0000 7fc9b7400640 1 --2- 172.21.15.123:0/2343700403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9b000c360 0x7fc9b00388d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc9b802db60 tx=0x7fc9b8069700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.614+0000 7f8b65600640 1 -- 172.21.15.123:0/3116896377 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8b540047e0 con 0x7f8b600337c0 2024-04-17T05:27:23.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.615+0000 7f4dbfa00640 1 Processor -- start 2024-04-17T05:27:23.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.615+0000 7f89eea00640 1 --2- 172.21.15.123:0/1732410832 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f89cc06c9c0 0x7f89cc06ee80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f89d8034000 tx=0x7f89d8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.615+0000 7f8b65600640 1 --2- 172.21.15.123:0/3116896377 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8b4806caf0 0x7f8b4806efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.615+0000 7fc867e00640 1 Processor -- start 2024-04-17T05:27:23.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.615+0000 7f4dbfa00640 1 -- start start 2024-04-17T05:27:23.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.615+0000 7fc867e00640 1 -- start start 2024-04-17T05:27:23.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.616+0000 7fc70a200640 1 Processor -- start 2024-04-17T05:27:23.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.616+0000 7fc9a7400640 1 -- 172.21.15.123:0/2343700403 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b80b4050 con 0x7fc9b000c360 2024-04-17T05:27:23.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.616+0000 7fc9a7400640 1 -- 172.21.15.123:0/2343700403 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b80b5040 con 0x7fc9b000c360 2024-04-17T05:27:23.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.616+0000 7fc9a7400640 1 -- 172.21.15.123:0/2343700403 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8068510 con 0x7fc9b000c360 2024-04-17T05:27:23.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.616+0000 7fc9bd000640 1 -- 172.21.15.123:0/2343700403 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9b0157ac0 con 0x7fc9b000c360 2024-04-17T05:27:23.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.616+0000 7f8b6d400640 1 --2- 172.21.15.123:0/3116896377 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8b4806caf0 0x7f8b4806efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.616+0000 7f8b65600640 1 -- 172.21.15.123:0/3116896377 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f8b54013df0 con 0x7f8b600337c0 2024-04-17T05:27:23.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.616+0000 7f4dbfa00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4db80ae640 0x7f4db813dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.616+0000 7f4dbfa00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4db80b0070 0x7f4db813e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.616+0000 7f4dbfa00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4db80aea20 con 0x7f4db8143d20 2024-04-17T05:27:23.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.617+0000 7f4dbfa00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f4db80b05b0 con 0x7f4db80b0070 2024-04-17T05:27:23.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.617+0000 7f4dbfa00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f4db806d500 con 0x7f4db80ae640 2024-04-17T05:27:23.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.617+0000 7f56e9000640 1 -- 172.21.15.123:0/2596116576 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56e4068a40 con 0x7f56e40b5480 2024-04-17T05:27:23.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.616+0000 7fc70a200640 1 -- start start 2024-04-17T05:27:23.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.617+0000 7fc70a200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc70406d040 0x7fc70409d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.617+0000 7fc70a200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc7041449e0 0x7fc7041e1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.617+0000 7fc70a200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc704147390 0x7fc7041e2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.617+0000 7f4dbd000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4db80ae640 0x7f4db813dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.617+0000 7f56da000640 1 -- 172.21.15.123:0/2596116576 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f56dc014ba0 con 0x7f56e40b5480 2024-04-17T05:27:23.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.617+0000 7fc70a200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc7040b4b50 con 0x7fc704147390 2024-04-17T05:27:23.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.617+0000 7f4dbd000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4db80ae640 0x7f4db813dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.123:59578/0 (socket says 172.21.15.123:59578) 2024-04-17T05:27:23.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.617+0000 7f4dbd000640 1 -- 172.21.15.123:0/894799362 learned_addr learned my addr 172.21.15.123:0/894799362 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:23.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.617+0000 7fc70a200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc70406df00 con 0x7fc70406d040 2024-04-17T05:27:23.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.618+0000 7f4dafe00640 1 --2- 172.21.15.123:0/894799362 >> v2:172.21.15.164:3300/0 conn(0x7f4db80b0070 0x7f4db813e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.617+0000 7fc70a200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fc7040b4090 con 0x7fc7041449e0 2024-04-17T05:27:23.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.618+0000 7fc703e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc7041449e0 0x7fc7041e1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.618+0000 7fc867e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8680b1ed0 0x7fc868145480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.618+0000 7fc867e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8680b22b0 0x7fc868147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.618+0000 7fc708e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc70406d040 0x7fc70409d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.618+0000 7fc708e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc70406d040 0x7fc70409d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.123:44724/0 (socket says 172.21.15.123:44724) 2024-04-17T05:27:23.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.618+0000 7fc708e00640 1 -- 172.21.15.123:0/3515046277 learned_addr learned my addr 172.21.15.123:0/3515046277 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:23.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.618+0000 7fc867e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc86814c350 0x7fc8681e1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.618+0000 7fc867e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc8680b9870 con 0x7fc8680b1ed0 2024-04-17T05:27:23.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.618+0000 7fc867e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc86814bdc0 con 0x7fc8680b22b0 2024-04-17T05:27:23.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.618+0000 7fc867e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fc8680b99f0 con 0x7fc86814c350 2024-04-17T05:27:23.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.618+0000 7fc9bd000640 1 -- 172.21.15.123:0/2343700403 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9b00361a0 con 0x7fc9b000c360 2024-04-17T05:27:23.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.619+0000 7f8b6d400640 1 --2- 172.21.15.123:0/3116896377 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8b4806caf0 0x7f8b4806efb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c036000 tx=0x7f8b5c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.619+0000 7fc709800640 1 --2- 172.21.15.123:0/3515046277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc704147390 0x7fc7041e2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.618+0000 7f4dbd000640 1 -- 172.21.15.123:0/894799362 >> v2:172.21.15.164:3300/0 conn(0x7f4db80b0070 msgr2=0x7f4db813e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:23.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.618+0000 7f4dbd000640 1 --2- 172.21.15.123:0/894799362 >> v2:172.21.15.164:3300/0 conn(0x7f4db80b0070 0x7f4db813e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.618+0000 7f4dbd000640 1 -- 172.21.15.123:0/894799362 >> v1:172.21.15.123:6789/0 conn(0x7f4db8143d20 legacy=0x7f4db81441b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:23.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.618+0000 7f4dbd000640 1 -- 172.21.15.123:0/894799362 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4db806d190 con 0x7f4db80ae640 2024-04-17T05:27:23.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.619+0000 7fc708e00640 1 -- 172.21.15.123:0/3515046277 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc7041449e0 msgr2=0x7fc7041e1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.619+0000 7fc708e00640 1 --2- 172.21.15.123:0/3515046277 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc7041449e0 0x7fc7041e1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.619+0000 7fc708e00640 1 -- 172.21.15.123:0/3515046277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc704147390 msgr2=0x7fc7041e2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.619+0000 7fc708e00640 1 --2- 172.21.15.123:0/3515046277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc704147390 0x7fc7041e2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.619+0000 7fc708e00640 1 -- 172.21.15.123:0/3515046277 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc70409cdb0 con 0x7fc70406d040 2024-04-17T05:27:23.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.619+0000 7fc866a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8680b1ed0 0x7fc868145480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.619+0000 7fc866a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8680b1ed0 0x7fc868145480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38306/0 (socket says 172.21.15.123:38306) 2024-04-17T05:27:23.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.619+0000 7fc866a00640 1 -- 172.21.15.123:0/2716024331 learned_addr learned my addr 172.21.15.123:0/2716024331 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:23.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.619+0000 7fc867400640 1 --2- 172.21.15.123:0/2716024331 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc86814c350 0x7fc8681e1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.620+0000 7fc866000640 1 --2- 172.21.15.123:0/2716024331 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8680b22b0 0x7fc868147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.620+0000 7fc708e00640 1 --2- 172.21.15.123:0/3515046277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc70406d040 0x7fc70409d280 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc00cac0 tx=0x7fc6fc00cf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.620+0000 7f4dbd000640 1 --2- 172.21.15.123:0/894799362 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4db80ae640 0x7f4db813dae0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4da8009bd0 tx=0x7f4da802d2b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c1d1b498562eb6c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.620+0000 7f56da000640 1 --2- 172.21.15.123:0/2596116576 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f56c406c940 0x7f56c406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.620+0000 7fc866a00640 1 -- 172.21.15.123:0/2716024331 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc86814c350 msgr2=0x7fc8681e1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.620+0000 7fc866a00640 1 --2- 172.21.15.123:0/2716024331 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc86814c350 0x7fc8681e1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.620+0000 7fc866a00640 1 -- 172.21.15.123:0/2716024331 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8680b22b0 msgr2=0x7fc868147eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.620+0000 7fc866a00640 1 --2- 172.21.15.123:0/2716024331 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8680b22b0 0x7fc868147eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.620+0000 7f56da000640 1 -- 172.21.15.123:0/2596116576 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f56dc08c5e0 con 0x7f56e40b5480 2024-04-17T05:27:23.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.620+0000 7fc866a00640 1 -- 172.21.15.123:0/2716024331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc868147790 con 0x7fc8680b1ed0 2024-04-17T05:27:23.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.620+0000 7fc866a00640 1 --2- 172.21.15.123:0/2716024331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8680b1ed0 0x7fc868145480 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc85800b3e0 tx=0x7fc85800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.621+0000 7fc700c00640 1 -- 172.21.15.123:0/3515046277 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc018070 con 0x7fc70406d040 2024-04-17T05:27:23.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.621+0000 7fc700c00640 1 -- 172.21.15.123:0/3515046277 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6fc003970 con 0x7fc70406d040 2024-04-17T05:27:23.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.621+0000 7fc700c00640 1 -- 172.21.15.123:0/3515046277 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc003d60 con 0x7fc70406d040 2024-04-17T05:27:23.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.621+0000 7fc9bd000640 1 -- 172.21.15.123:0/2343700403 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9b0035f90 con 0x7fc9b000c360 2024-04-17T05:27:23.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.621+0000 7f56e1e00640 1 --2- 172.21.15.123:0/2596116576 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f56c406c940 0x7f56c406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.621+0000 7fc70a200640 1 -- 172.21.15.123:0/3515046277 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7040b35e0 con 0x7fc70406d040 2024-04-17T05:27:23.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.621+0000 7fc70a200640 1 -- 172.21.15.123:0/3515046277 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc70409c070 con 0x7fc70406d040 2024-04-17T05:27:23.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.622+0000 7f56e1e00640 1 --2- 172.21.15.123:0/2596116576 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f56c406c940 0x7f56c406ee00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f56d4006fd0 tx=0x7f56d4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.623+0000 7fc70a200640 1 -- 172.21.15.123:0/3515046277 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc704075b30 con 0x7fc70406d040 2024-04-17T05:27:23.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.624+0000 7f8b65600640 1 -- 172.21.15.123:0/3116896377 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f8b540584f0 con 0x7f8b600337c0 2024-04-17T05:27:23.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.624+0000 7fc85ea00640 1 -- 172.21.15.123:0/2716024331 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc858015020 con 0x7fc8680b1ed0 2024-04-17T05:27:23.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.624+0000 7fc867e00640 1 -- 172.21.15.123:0/2716024331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc868148bf0 con 0x7fc8680b1ed0 2024-04-17T05:27:23.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.624+0000 7fc867e00640 1 -- 172.21.15.123:0/2716024331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8681487f0 con 0x7fc8680b1ed0 2024-04-17T05:27:23.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.625+0000 7fc700c00640 1 -- 172.21.15.123:0/3515046277 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc6fc0050d0 con 0x7fc70406d040 2024-04-17T05:27:23.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.625+0000 7fc700c00640 1 --2- 172.21.15.123:0/3515046277 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc6e406c8f0 0x7fc6e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.625+0000 7fc867e00640 1 -- 172.21.15.123:0/2716024331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8680738c0 con 0x7fc8680b1ed0 2024-04-17T05:27:23.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.626+0000 7fc700c00640 1 -- 172.21.15.123:0/3515046277 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc6fc08b4e0 con 0x7fc70406d040 2024-04-17T05:27:23.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.626+0000 7fc703e00640 1 --2- 172.21.15.123:0/3515046277 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc6e406c8f0 0x7fc6e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.626+0000 7fc9a7400640 1 -- 172.21.15.123:0/2343700403 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc9b80c2020 con 0x7fc9b000c360 2024-04-17T05:27:23.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.627+0000 7fc9a7400640 1 --2- 172.21.15.123:0/2343700403 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc99c06c970 0x7fc99c06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.627+0000 7fc9b6a00640 1 --2- 172.21.15.123:0/2343700403 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc99c06c970 0x7fc99c06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.628+0000 7fc703e00640 1 --2- 172.21.15.123:0/3515046277 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc6e406c8f0 0x7fc6e406edb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0034000 tx=0x7fc6f0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.628+0000 7fc9b6a00640 1 --2- 172.21.15.123:0/2343700403 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc99c06c970 0x7fc99c06ee30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc9b00ce220 tx=0x7fc9ac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.629+0000 7fc85ea00640 1 -- 172.21.15.123:0/2716024331 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc858011830 con 0x7fc8680b1ed0 2024-04-17T05:27:23.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.629+0000 7fc9a7400640 1 -- 172.21.15.123:0/2343700403 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc9b80f58b0 con 0x7fc9b000c360 2024-04-17T05:27:23.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.629+0000 7fc85ea00640 1 -- 172.21.15.123:0/2716024331 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc858011c00 con 0x7fc8680b1ed0 2024-04-17T05:27:23.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.630+0000 7f56da000640 1 -- 172.21.15.123:0/2596116576 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f56dc05a740 con 0x7f56e40b5480 2024-04-17T05:27:23.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.635+0000 7f89e6a00640 1 -- 172.21.15.123:0/1732410832 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f89f00b3070 con 0x7f89f00aeca0 2024-04-17T05:27:23.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.635+0000 7f4db7e00640 1 -- 172.21.15.123:0/894799362 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da802de50 con 0x7f4db80ae640 2024-04-17T05:27:23.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.635+0000 7f4db7e00640 1 -- 172.21.15.123:0/894799362 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da80353f0 con 0x7f4db80ae640 2024-04-17T05:27:23.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.635+0000 7f4db7e00640 1 -- 172.21.15.123:0/894799362 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da80357c0 con 0x7f4db80ae640 2024-04-17T05:27:23.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.635+0000 7fc9a7400640 1 -- 172.21.15.123:0/2343700403 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fc9b80b8360 con 0x7fc9b000c360 2024-04-17T05:27:23.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.636+0000 7f4dbfa00640 1 -- 172.21.15.123:0/894799362 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4db80ae640 msgr2=0x7f4db813dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.636+0000 7f4dbfa00640 1 --2- 172.21.15.123:0/894799362 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4db80ae640 0x7f4db813dae0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4da8009bd0 tx=0x7f4da802d2b0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.636+0000 7f4dbfa00640 1 -- 172.21.15.123:0/894799362 shutdown_connections 2024-04-17T05:27:23.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.636+0000 7f4dbfa00640 1 --2- 172.21.15.123:0/894799362 >> v2:172.21.15.164:3300/0 conn(0x7f4db80b0070 0x7f4db813e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.636+0000 7f4dbfa00640 1 --2- 172.21.15.123:0/894799362 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4db80ae640 0x7f4db813dae0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.636+0000 7f4dbfa00640 1 -- 172.21.15.123:0/894799362 >> 172.21.15.123:0/894799362 conn(0x7f4db80b93b0 msgr2=0x7f4db80b97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:23.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.637+0000 7f0425600640 1 -- 172.21.15.123:0/3495038468 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f041c03b070 con 0x7f04200ccef0 2024-04-17T05:27:23.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.637+0000 7f4dbfa00640 1 -- 172.21.15.123:0/894799362 shutdown_connections 2024-04-17T05:27:23.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.638+0000 7fc85ea00640 1 -- 172.21.15.123:0/2716024331 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc858018020 con 0x7fc8680b1ed0 2024-04-17T05:27:23.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.638+0000 7f0425600640 1 --2- 172.21.15.123:0/3495038468 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f040806c920 0x7f040806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.638+0000 7f0425600640 1 -- 172.21.15.123:0/3495038468 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f041c0adb10 con 0x7f04200ccef0 2024-04-17T05:27:23.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.638+0000 7f4dbfa00640 1 -- 172.21.15.123:0/894799362 wait complete. 2024-04-17T05:27:23.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.639+0000 7f042d600640 1 --2- 172.21.15.123:0/3495038468 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f040806c920 0x7f040806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.639+0000 7fc85ea00640 1 --2- 172.21.15.123:0/2716024331 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc84806c8f0 0x7fc84806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.640+0000 7fc85ea00640 1 -- 172.21.15.123:0/2716024331 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc85808c2d0 con 0x7fc8680b1ed0 2024-04-17T05:27:23.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.640+0000 7f4dbfa00640 1 Processor -- start 2024-04-17T05:27:23.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.640+0000 7fc866000640 1 --2- 172.21.15.123:0/2716024331 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc84806c8f0 0x7fc84806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.641+0000 7f042d600640 1 --2- 172.21.15.123:0/3495038468 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f040806c920 0x7f040806ede0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0428065480 tx=0x7f0428075810 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.640+0000 7f4dbfa00640 1 -- start start 2024-04-17T05:27:23.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.641+0000 7f4dbfa00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4db80ae640 0x7f4db80733c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.641+0000 7f4dbfa00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4db80b0070 0x7f4db80b1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.641+0000 7f4dbfa00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4db8143d20 0x7f4db80b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.641+0000 7f4dbfa00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4db806e050 con 0x7f4db80b0070 2024-04-17T05:27:23.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.641+0000 7f4dbfa00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4db80b5610 con 0x7f4db8143d20 2024-04-17T05:27:23.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.641+0000 7f4dbfa00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f4db806e1d0 con 0x7f4db80ae640 2024-04-17T05:27:23.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.642+0000 7fc866000640 1 --2- 172.21.15.123:0/2716024331 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc84806c8f0 0x7fc84806edb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc8681df840 tx=0x7fc854009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.642+0000 7f4dafe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4db80b0070 0x7f4db80b1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.642+0000 7f4dafe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4db80b0070 0x7f4db80b1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38314/0 (socket says 172.21.15.123:38314) 2024-04-17T05:27:23.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.642+0000 7f4dafe00640 1 -- 172.21.15.123:0/1386084012 learned_addr learned my addr 172.21.15.123:0/1386084012 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:23.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.642+0000 7f4dbd000640 1 --2- 172.21.15.123:0/1386084012 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4db80ae640 0x7f4db80733c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.643+0000 7f4dafe00640 1 -- 172.21.15.123:0/1386084012 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4db80ae640 msgr2=0x7f4db80733c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.643+0000 7f4dbda00640 1 --2- 172.21.15.123:0/1386084012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4db8143d20 0x7f4db80b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.643+0000 7f4dafe00640 1 --2- 172.21.15.123:0/1386084012 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4db80ae640 0x7f4db80733c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.643+0000 7f4dafe00640 1 -- 172.21.15.123:0/1386084012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4db8143d20 msgr2=0x7f4db80b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:23.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.643+0000 7f4dafe00640 1 --2- 172.21.15.123:0/1386084012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4db8143d20 0x7f4db80b2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:23.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.643+0000 7f4dafe00640 1 -- 172.21.15.123:0/1386084012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4db8140c50 con 0x7f4db80b0070 2024-04-17T05:27:23.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.643+0000 7f4dbda00640 1 --2- 172.21.15.123:0/1386084012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4db8143d20 0x7f4db80b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:23.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.643+0000 7f4dbd000640 1 --2- 172.21.15.123:0/1386084012 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4db80ae640 0x7f4db80733c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T05:27:23.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.644+0000 7f4dafe00640 1 --2- 172.21.15.123:0/1386084012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4db80b0070 0x7f4db80b1e90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4da000e9b0 tx=0x7f4da000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.644+0000 7f4db5600640 1 -- 172.21.15.123:0/1386084012 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da0017070 con 0x7f4db80b0070 2024-04-17T05:27:23.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.644+0000 7fc85ea00640 1 -- 172.21.15.123:0/2716024331 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fc85801f020 con 0x7fc8680b1ed0 2024-04-17T05:27:23.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.644+0000 7f4dbfa00640 1 -- 172.21.15.123:0/1386084012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4db80b26c0 con 0x7f4db80b0070 2024-04-17T05:27:23.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.644+0000 7f4db5600640 1 -- 172.21.15.123:0/1386084012 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da000c9a0 con 0x7f4db80b0070 2024-04-17T05:27:23.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.645+0000 7f4dbfa00640 1 -- 172.21.15.123:0/1386084012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4db80b0900 con 0x7f4db80b0070 2024-04-17T05:27:23.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.645+0000 7f4db5600640 1 -- 172.21.15.123:0/1386084012 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da0021060 con 0x7f4db80b0070 2024-04-17T05:27:23.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.647+0000 7f4dbfa00640 1 -- 172.21.15.123:0/1386084012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4db8068a40 con 0x7f4db80b0070 2024-04-17T05:27:23.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.648+0000 7f4db5600640 1 -- 172.21.15.123:0/1386084012 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4da001a070 con 0x7f4db80b0070 2024-04-17T05:27:23.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.650+0000 7f4db5600640 1 --2- 172.21.15.123:0/1386084012 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f4d9406c8f0 0x7f4d9406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:23.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.650+0000 7f4db5600640 1 -- 172.21.15.123:0/1386084012 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f4da008bf10 con 0x7f4db80b0070 2024-04-17T05:27:23.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.651+0000 7f4dbd000640 1 --2- 172.21.15.123:0/1386084012 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f4d9406c8f0 0x7f4d9406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:23.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.652+0000 7f4dbd000640 1 --2- 172.21.15.123:0/1386084012 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f4d9406c8f0 0x7f4d9406edb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4da8036000 tx=0x7f4da8031000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:23.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.659+0000 7f4db5600640 1 -- 172.21.15.123:0/1386084012 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f4da0059f70 con 0x7f4db80b0070 2024-04-17T05:27:23.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.659+0000 7fc700c00640 1 -- 172.21.15.123:0/3515046277 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fc6fc059070 con 0x7fc70406d040 2024-04-17T05:27:23.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:23.662+0000 7f0425600640 1 -- 172.21.15.123:0/3495038468 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f041c07b620 con 0x7f04200ccef0 2024-04-17T05:27:24.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.049+0000 7f56e9000640 1 -- 172.21.15.123:0/2596116576 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f56e406c990 con 0x7f56e40b5480 2024-04-17T05:27:24.050 INFO:teuthology.orchestra.run.smithi123.stdout:60129542154 2024-04-17T05:27:24.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.049+0000 7f56da000640 1 -- 172.21.15.123:0/2596116576 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f56dc05a040 con 0x7f56e40b5480 2024-04-17T05:27:24.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.053+0000 7f8b6fe00640 1 -- 172.21.15.123:0/3116896377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f8b60037d20 con 0x7f8b600337c0 2024-04-17T05:27:24.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.054+0000 7f56e9000640 1 -- 172.21.15.123:0/2596116576 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f56c406c940 msgr2=0x7f56c406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:24.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.054+0000 7f56e9000640 1 --2- 172.21.15.123:0/2596116576 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f56c406c940 0x7f56c406ee00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f56d4006fd0 tx=0x7f56d4008040 comp rx=0 tx=0).stop 2024-04-17T05:27:24.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.054+0000 7f8b65600640 1 -- 172.21.15.123:0/3116896377 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8b5405c7f0 con 0x7f8b600337c0 2024-04-17T05:27:24.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.054+0000 7f56e9000640 1 -- 172.21.15.123:0/2596116576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56e40b5480 msgr2=0x7f56e40b07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:24.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.054+0000 7f56e9000640 1 --2- 172.21.15.123:0/2596116576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56e40b5480 0x7f56e40b07b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f56dc007e40 tx=0x7f56dc00e4b0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.055 INFO:teuthology.orchestra.run.smithi123.stdout:60129542153 2024-04-17T05:27:24.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.055+0000 7f56e9000640 1 -- 172.21.15.123:0/2596116576 shutdown_connections 2024-04-17T05:27:24.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.055+0000 7f56e9000640 1 --2- 172.21.15.123:0/2596116576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56e40b5480 0x7f56e40b07b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.055+0000 7f56e9000640 1 --2- 172.21.15.123:0/2596116576 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f56c406c940 0x7f56c406ee00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.055+0000 7f56e9000640 1 --2- 172.21.15.123:0/2596116576 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f56e40b3db0 0x7f56e4099e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.055+0000 7f56e9000640 1 --2- 172.21.15.123:0/2596116576 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56e409df90 0x7f56e41d2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.055+0000 7f56e9000640 1 -- 172.21.15.123:0/2596116576 >> 172.21.15.123:0/2596116576 conn(0x7f56e40b93b0 msgr2=0x7f56e40676c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:24.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.055+0000 7f56e9000640 1 -- 172.21.15.123:0/2596116576 shutdown_connections 2024-04-17T05:27:24.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.055+0000 7f56e9000640 1 -- 172.21.15.123:0/2596116576 wait complete. 2024-04-17T05:27:24.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.058+0000 7f8b6fe00640 1 -- 172.21.15.123:0/3116896377 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8b4806caf0 msgr2=0x7f8b4806efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:24.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.058+0000 7f8b6fe00640 1 --2- 172.21.15.123:0/3116896377 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8b4806caf0 0x7f8b4806efb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c036000 tx=0x7f8b5c008030 comp rx=0 tx=0).stop 2024-04-17T05:27:24.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.058+0000 7f8b6fe00640 1 -- 172.21.15.123:0/3116896377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b600337c0 msgr2=0x7f8b60167e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:24.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.058+0000 7f8b6fe00640 1 --2- 172.21.15.123:0/3116896377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b600337c0 0x7f8b60167e60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8b5400c450 tx=0x7f8b5400c910 comp rx=0 tx=0).stop 2024-04-17T05:27:24.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.059+0000 7f8b6fe00640 1 -- 172.21.15.123:0/3116896377 shutdown_connections 2024-04-17T05:27:24.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.059+0000 7f8b6fe00640 1 --2- 172.21.15.123:0/3116896377 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8b4806caf0 0x7f8b4806efb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.059+0000 7f8b6fe00640 1 --2- 172.21.15.123:0/3116896377 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8b60033c40 0x7f8b601683a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.059+0000 7f8b6fe00640 1 --2- 172.21.15.123:0/3116896377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b600337c0 0x7f8b60167e60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.059+0000 7f8b6fe00640 1 --2- 172.21.15.123:0/3116896377 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8b60006e90 0x7f8b600c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.059+0000 7f8b6fe00640 1 -- 172.21.15.123:0/3116896377 >> 172.21.15.123:0/3116896377 conn(0x7f8b6003a890 msgr2=0x7f8b6003bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:24.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.059+0000 7f8b6fe00640 1 -- 172.21.15.123:0/3116896377 shutdown_connections 2024-04-17T05:27:24.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.059+0000 7f8b6fe00640 1 -- 172.21.15.123:0/3116896377 wait complete. 2024-04-17T05:27:24.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.072+0000 7f89f5a00640 1 -- 172.21.15.123:0/1732410832 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f89f0072c10 con 0x7f89f00aeca0 2024-04-17T05:27:24.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.073+0000 7fc9bd000640 1 -- 172.21.15.123:0/2343700403 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fc9b00057e0 con 0x7fc9b000c360 2024-04-17T05:27:24.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.073+0000 7f89e6a00640 1 -- 172.21.15.123:0/1732410832 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f89e005a360 con 0x7f89f00aeca0 2024-04-17T05:27:24.071 INFO:teuthology.orchestra.run.smithi123.stdout:60129542153 2024-04-17T05:27:24.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.074+0000 7fc9a7400640 1 -- 172.21.15.123:0/2343700403 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc9b80f7f10 con 0x7fc9b000c360 2024-04-17T05:27:24.075 INFO:teuthology.orchestra.run.smithi123.stdout:60129542154 2024-04-17T05:27:24.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.077+0000 7f89f5a00640 1 -- 172.21.15.123:0/1732410832 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f89cc06c9c0 msgr2=0x7f89cc06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:24.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.077+0000 7f89f5a00640 1 --2- 172.21.15.123:0/1732410832 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f89cc06c9c0 0x7f89cc06ee80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f89d8034000 tx=0x7f89d8008030 comp rx=0 tx=0).stop 2024-04-17T05:27:24.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.077+0000 7f89f5a00640 1 -- 172.21.15.123:0/1732410832 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89f00aeca0 msgr2=0x7f89f01e16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:24.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.077+0000 7f89f5a00640 1 --2- 172.21.15.123:0/1732410832 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89f00aeca0 0x7f89f01e16b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f89e000d800 tx=0x7f89e000dcc0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.077+0000 7f89f5a00640 1 -- 172.21.15.123:0/1732410832 shutdown_connections 2024-04-17T05:27:24.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.077+0000 7f89f5a00640 1 --2- 172.21.15.123:0/1732410832 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89f014a6d0 0x7f89f00b0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.077+0000 7f89f5a00640 1 --2- 172.21.15.123:0/1732410832 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f89cc06c9c0 0x7f89cc06ee80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.077+0000 7f89f5a00640 1 --2- 172.21.15.123:0/1732410832 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89f00aeca0 0x7f89f01e16b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.077+0000 7f89f5a00640 1 --2- 172.21.15.123:0/1732410832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89f006d040 0x7f89f00b2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.077+0000 7f89f5a00640 1 -- 172.21.15.123:0/1732410832 >> 172.21.15.123:0/1732410832 conn(0x7f89f006c040 msgr2=0x7f89f009c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:24.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.078+0000 7f89f5a00640 1 -- 172.21.15.123:0/1732410832 shutdown_connections 2024-04-17T05:27:24.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.078+0000 7f89f5a00640 1 -- 172.21.15.123:0/1732410832 wait complete. 2024-04-17T05:27:24.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.078+0000 7fc867e00640 1 -- 172.21.15.123:0/2716024331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fc8680b7310 con 0x7fc8680b1ed0 2024-04-17T05:27:24.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.078+0000 7fc9bd000640 1 -- 172.21.15.123:0/2343700403 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc99c06c970 msgr2=0x7fc99c06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:24.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.078+0000 7fc9bd000640 1 --2- 172.21.15.123:0/2343700403 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc99c06c970 0x7fc99c06ee30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc9b00ce220 tx=0x7fc9ac009040 comp rx=0 tx=0).stop 2024-04-17T05:27:24.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.079+0000 7fc9bd000640 1 -- 172.21.15.123:0/2343700403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9b000c360 msgr2=0x7fc9b00388d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:24.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.079+0000 7fc9bd000640 1 --2- 172.21.15.123:0/2343700403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9b000c360 0x7fc9b00388d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc9b802db60 tx=0x7fc9b8069700 comp rx=0 tx=0).stop 2024-04-17T05:27:24.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.079+0000 7fc9bd000640 1 -- 172.21.15.123:0/2343700403 shutdown_connections 2024-04-17T05:27:24.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.079+0000 7fc9bd000640 1 --2- 172.21.15.123:0/2343700403 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9b003bef0 0x7fc9b0034fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.079+0000 7fc9bd000640 1 --2- 172.21.15.123:0/2343700403 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc99c06c970 0x7fc99c06ee30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.079+0000 7fc9bd000640 1 --2- 172.21.15.123:0/2343700403 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc9b003ba90 0x7fc9b0034a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.079+0000 7fc9bd000640 1 --2- 172.21.15.123:0/2343700403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc9b000c360 0x7fc9b00388d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.079+0000 7fc9bd000640 1 -- 172.21.15.123:0/2343700403 >> 172.21.15.123:0/2343700403 conn(0x7fc9b000b5d0 msgr2=0x7fc9b00ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:24.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.081+0000 7fc9bd000640 1 -- 172.21.15.123:0/2343700403 shutdown_connections 2024-04-17T05:27:24.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.081+0000 7fc9bd000640 1 -- 172.21.15.123:0/2343700403 wait complete. 2024-04-17T05:27:24.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.081+0000 7fc85ea00640 1 -- 172.21.15.123:0/2716024331 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc85805a430 con 0x7fc8680b1ed0 2024-04-17T05:27:24.083 INFO:teuthology.orchestra.run.smithi123.stdout:60129542154 2024-04-17T05:27:24.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.5 2024-04-17T05:27:24.084 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.4 2024-04-17T05:27:24.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.084+0000 7fc867e00640 1 -- 172.21.15.123:0/2716024331 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc84806c8f0 msgr2=0x7fc84806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:24.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.084+0000 7fc867e00640 1 --2- 172.21.15.123:0/2716024331 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc84806c8f0 0x7fc84806edb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc8681df840 tx=0x7fc854009040 comp rx=0 tx=0).stop 2024-04-17T05:27:24.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.084+0000 7fc867e00640 1 -- 172.21.15.123:0/2716024331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8680b1ed0 msgr2=0x7fc868145480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:24.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.084+0000 7fc867e00640 1 --2- 172.21.15.123:0/2716024331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8680b1ed0 0x7fc868145480 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc85800b3e0 tx=0x7fc85800b8a0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.085+0000 7fc867e00640 1 -- 172.21.15.123:0/2716024331 shutdown_connections 2024-04-17T05:27:24.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.085+0000 7fc867e00640 1 --2- 172.21.15.123:0/2716024331 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc84806c8f0 0x7fc84806edb0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.085+0000 7fc867e00640 1 --2- 172.21.15.123:0/2716024331 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc86814c350 0x7fc8681e1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.085+0000 7fc867e00640 1 --2- 172.21.15.123:0/2716024331 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8680b22b0 0x7fc868147eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.085+0000 7fc867e00640 1 --2- 172.21.15.123:0/2716024331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc8680b1ed0 0x7fc868145480 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.085+0000 7fc867e00640 1 -- 172.21.15.123:0/2716024331 >> 172.21.15.123:0/2716024331 conn(0x7fc86806c260 msgr2=0x7fc8680676c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:24.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.085+0000 7fc867e00640 1 -- 172.21.15.123:0/2716024331 shutdown_connections 2024-04-17T05:27:24.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.085+0000 7fc867e00640 1 -- 172.21.15.123:0/2716024331 wait complete. 2024-04-17T05:27:24.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.089+0000 7f4dbfa00640 1 -- 172.21.15.123:0/1386084012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f4db81410a0 con 0x7f4db80b0070 2024-04-17T05:27:24.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.090+0000 7f4db5600640 1 -- 172.21.15.123:0/1386084012 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4da0059870 con 0x7f4db80b0070 2024-04-17T05:27:24.088 INFO:teuthology.orchestra.run.smithi123.stdout:60129542153 2024-04-17T05:27:24.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.092+0000 7f4dbfa00640 1 -- 172.21.15.123:0/1386084012 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f4d9406c8f0 msgr2=0x7f4d9406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:24.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.092+0000 7f4dbfa00640 1 --2- 172.21.15.123:0/1386084012 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f4d9406c8f0 0x7f4d9406edb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4da8036000 tx=0x7f4da8031000 comp rx=0 tx=0).stop 2024-04-17T05:27:24.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.092+0000 7f4dbfa00640 1 -- 172.21.15.123:0/1386084012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4db80b0070 msgr2=0x7f4db80b1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:24.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.092+0000 7f4dbfa00640 1 --2- 172.21.15.123:0/1386084012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4db80b0070 0x7f4db80b1e90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4da000e9b0 tx=0x7f4da000ee70 comp rx=0 tx=0).stop 2024-04-17T05:27:24.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.093+0000 7f4dbfa00640 1 -- 172.21.15.123:0/1386084012 shutdown_connections 2024-04-17T05:27:24.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.093+0000 7f4dbfa00640 1 --2- 172.21.15.123:0/1386084012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4db8143d20 0x7f4db80b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.093+0000 7f4dbfa00640 1 --2- 172.21.15.123:0/1386084012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4db80b0070 0x7f4db80b1e90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.093+0000 7f4dbfa00640 1 --2- 172.21.15.123:0/1386084012 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f4d9406c8f0 0x7f4d9406edb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.093+0000 7f4dbfa00640 1 --2- 172.21.15.123:0/1386084012 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4db80ae640 0x7f4db80733c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.093+0000 7f4dbfa00640 1 -- 172.21.15.123:0/1386084012 >> 172.21.15.123:0/1386084012 conn(0x7f4db80b93b0 msgr2=0x7f4db80b8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:24.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.093+0000 7f4dbfa00640 1 -- 172.21.15.123:0/1386084012 shutdown_connections 2024-04-17T05:27:24.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.093+0000 7f4dbfa00640 1 -- 172.21.15.123:0/1386084012 wait complete. 2024-04-17T05:27:24.097 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.0 2024-04-17T05:27:24.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.101+0000 7fc70a200640 1 -- 172.21.15.123:0/3515046277 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fc7040af510 con 0x7fc70406d040 2024-04-17T05:27:24.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.101+0000 7f041aa00640 1 -- 172.21.15.123:0/3495038468 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f04200c9f40 con 0x7f04200ccef0 2024-04-17T05:27:24.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.102+0000 7fc700c00640 1 -- 172.21.15.123:0/3515046277 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc6fc05d370 con 0x7fc70406d040 2024-04-17T05:27:24.100 INFO:teuthology.orchestra.run.smithi123.stdout:60129542155 2024-04-17T05:27:24.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.102+0000 7f0425600640 1 -- 172.21.15.123:0/3495038468 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f041c07f920 con 0x7f04200ccef0 2024-04-17T05:27:24.100 INFO:teuthology.orchestra.run.smithi123.stdout:60129542153 2024-04-17T05:27:24.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.105+0000 7fc70a200640 1 -- 172.21.15.123:0/3515046277 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc6e406c8f0 msgr2=0x7fc6e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:24.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.105+0000 7fc70a200640 1 --2- 172.21.15.123:0/3515046277 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc6e406c8f0 0x7fc6e406edb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0034000 tx=0x7fc6f0008030 comp rx=0 tx=0).stop 2024-04-17T05:27:24.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.105+0000 7fc70a200640 1 -- 172.21.15.123:0/3515046277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc70406d040 msgr2=0x7fc70409d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:24.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.105+0000 7fc70a200640 1 --2- 172.21.15.123:0/3515046277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc70406d040 0x7fc70409d280 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc00cac0 tx=0x7fc6fc00cf80 comp rx=0 tx=0).stop 2024-04-17T05:27:24.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.105+0000 7fc70a200640 1 -- 172.21.15.123:0/3515046277 shutdown_connections 2024-04-17T05:27:24.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.105+0000 7fc70a200640 1 --2- 172.21.15.123:0/3515046277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc704147390 0x7fc7041e2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.105+0000 7fc70a200640 1 --2- 172.21.15.123:0/3515046277 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc6e406c8f0 0x7fc6e406edb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.105+0000 7fc70a200640 1 --2- 172.21.15.123:0/3515046277 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc7041449e0 0x7fc7041e1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.105+0000 7fc70a200640 1 --2- 172.21.15.123:0/3515046277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc70406d040 0x7fc70409d280 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.105+0000 7fc70a200640 1 -- 172.21.15.123:0/3515046277 >> 172.21.15.123:0/3515046277 conn(0x7fc70406c430 msgr2=0x7fc7040676c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:24.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.106+0000 7f041aa00640 1 -- 172.21.15.123:0/3495038468 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f040806c920 msgr2=0x7f040806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:24.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.106+0000 7f041aa00640 1 --2- 172.21.15.123:0/3495038468 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f040806c920 0x7f040806ede0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0428065480 tx=0x7f0428075810 comp rx=0 tx=0).stop 2024-04-17T05:27:24.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.106+0000 7f041aa00640 1 -- 172.21.15.123:0/3495038468 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f04200ccef0 msgr2=0x7f04201637d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:24.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.106+0000 7f041aa00640 1 --2- 172.21.15.123:0/3495038468 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f04200ccef0 0x7f04201637d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f041c0097a0 tx=0x7f041c0046c0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.106+0000 7f041aa00640 1 -- 172.21.15.123:0/3495038468 shutdown_connections 2024-04-17T05:27:24.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.106+0000 7f041aa00640 1 --2- 172.21.15.123:0/3495038468 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f040806c920 0x7f040806ede0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.106+0000 7fc70a200640 1 -- 172.21.15.123:0/3515046277 shutdown_connections 2024-04-17T05:27:24.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.106+0000 7fc70a200640 1 -- 172.21.15.123:0/3515046277 wait complete. 2024-04-17T05:27:24.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.106+0000 7f041aa00640 1 --2- 172.21.15.123:0/3495038468 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f04200ccef0 0x7f04201637d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.106+0000 7f041aa00640 1 --2- 172.21.15.123:0/3495038468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04200c6910 0x7f0420163290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.106+0000 7f041aa00640 1 --2- 172.21.15.123:0/3495038468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f042003a370 0x7f04200ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:24.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.106+0000 7f041aa00640 1 -- 172.21.15.123:0/3495038468 >> 172.21.15.123:0/3495038468 conn(0x7f042003ec80 msgr2=0x7f042003fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:24.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.106+0000 7f041aa00640 1 -- 172.21.15.123:0/3495038468 shutdown_connections 2024-04-17T05:27:24.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:24.106+0000 7f041aa00640 1 -- 172.21.15.123:0/3495038468 wait complete. 2024-04-17T05:27:24.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.1 2024-04-17T05:27:24.109 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.7 2024-04-17T05:27:24.110 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.6 2024-04-17T05:27:24.120 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542155 for osd.3 2024-04-17T05:27:24.124 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.2 2024-04-17T05:27:25.085 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-17T05:27:25.085 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-17T05:27:25.098 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-17T05:27:25.110 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-17T05:27:25.110 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-17T05:27:25.110 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-17T05:27:25.121 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-17T05:27:25.124 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-17T05:27:25.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.361+0000 7f3ed5c00640 1 Processor -- start 2024-04-17T05:27:25.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.361+0000 7f3ed5c00640 1 -- start start 2024-04-17T05:27:25.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.363+0000 7f3ed5c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ec801f1d0 0x7f3ec80080a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.363+0000 7f3ed5c00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ec80ce5d0 con 0x7f3ec800c360 2024-04-17T05:27:25.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.363+0000 7f3ed5c00640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ec803c180 con 0x7f3ec801d380 2024-04-17T05:27:25.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.363+0000 7f3ed5c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f3ec800c740 con 0x7f3ec801f1d0 2024-04-17T05:27:25.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.364+0000 7f3ed5200640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f3ec801d380 0x7f3ec803ba70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.123:51224/0 (socket says 172.21.15.123:51224) 2024-04-17T05:27:25.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.365+0000 7f3ed5200640 1 -- 172.21.15.123:0/3403084914 learned_addr learned my addr 172.21.15.123:0/3403084914 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:27:25.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.367+0000 7f3ecea00640 1 -- 172.21.15.123:0/3403084914 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3545921221 0 0) 0x7f3ec80ce5d0 con 0x7f3ec800c360 2024-04-17T05:27:25.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.367+0000 7f3ecea00640 1 -- 172.21.15.123:0/3403084914 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3eb8003520 con 0x7f3ec800c360 2024-04-17T05:27:25.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.367+0000 7f3ecea00640 1 -- 172.21.15.123:0/3403084914 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3225077200 0 0) 0x7f3ed0050be0 con 0x7f3ec801d380 2024-04-17T05:27:25.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.367+0000 7f3ecea00640 1 -- 172.21.15.123:0/3403084914 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3eb80048e0 con 0x7f3ec801d380 2024-04-17T05:27:25.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.367+0000 7fa78de00640 1 Processor -- start 2024-04-17T05:27:25.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.368+0000 7f3ecea00640 1 -- 172.21.15.123:0/3403084914 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1467629541 0 0) 0x7f3eb8003520 con 0x7f3ec800c360 2024-04-17T05:27:25.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.368+0000 7f3ecea00640 1 -- 172.21.15.123:0/3403084914 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ec801f1d0 msgr2=0x7f3ec80080a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:25.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.368+0000 7f3ecea00640 1 --2- 172.21.15.123:0/3403084914 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ec801f1d0 0x7f3ec80080a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.368+0000 7f3ecea00640 1 -- 172.21.15.123:0/3403084914 >> v1:172.21.15.164:6789/0 conn(0x7f3ec801d380 legacy=0x7f3ec803ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.368+0000 7f3ecea00640 1 -- 172.21.15.123:0/3403084914 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec80d0c50 con 0x7f3ec800c360 2024-04-17T05:27:25.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.368+0000 7f3ecea00640 1 -- 172.21.15.123:0/3403084914 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1042962670 0 0) 0x7f3ec4001650 con 0x7f3ec800c360 2024-04-17T05:27:25.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.368+0000 7f3ecea00640 1 -- 172.21.15.123:0/3403084914 >> v1:172.21.15.123:6789/0 conn(0x7f3ec800c360 legacy=0x7f3ec80d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.368+0000 7f3ecea00640 1 --2- 172.21.15.123:0/3403084914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3eb8004de0 0x7f3eb8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.368+0000 7f3ecea00640 1 --2- 172.21.15.123:0/3403084914 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3eb80037a0 0x7f3eb8003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.368+0000 7f3ecea00640 1 --2- 172.21.15.123:0/3403084914 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3eb80043b0 0x7f3eb800ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.368+0000 7f3ecea00640 1 -- 172.21.15.123:0/3403084914 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec800c740 con 0x7f3eb8004de0 2024-04-17T05:27:25.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.368+0000 7f3ecea00640 1 -- 172.21.15.123:0/3403084914 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb800c2c0 con 0x7f3eb80037a0 2024-04-17T05:27:25.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.368+0000 7f3ecea00640 1 -- 172.21.15.123:0/3403084914 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f3eb800c4c0 con 0x7f3eb80043b0 2024-04-17T05:27:25.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.370+0000 7f3ed5200640 1 --2- 172.21.15.123:0/3403084914 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3eb80043b0 0x7f3eb800ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.370+0000 7f3ecfe00640 1 --2- 172.21.15.123:0/3403084914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3eb8004de0 0x7f3eb8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.371+0000 7f3ed5200640 1 -- 172.21.15.123:0/3403084914 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3eb80037a0 msgr2=0x7f3eb8003c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T05:27:25.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.371+0000 7f3ed5200640 1 --2- 172.21.15.123:0/3403084914 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3eb80037a0 0x7f3eb8003c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.371+0000 7f3ed5200640 1 -- 172.21.15.123:0/3403084914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3eb8004de0 msgr2=0x7f3eb8005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:25.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.372+0000 7f3ed5200640 1 --2- 172.21.15.123:0/3403084914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3eb8004de0 0x7f3eb8005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.372+0000 7f3ed5200640 1 -- 172.21.15.123:0/3403084914 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed0050be0 con 0x7f3eb80043b0 2024-04-17T05:27:25.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.368+0000 7fa78de00640 1 -- start start 2024-04-17T05:27:25.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.370+0000 7fa78de00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa780035600 0x7fa7800365a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.370+0000 7fa78de00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa7800359e0 0x7fa7800337d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.370+0000 7fa78de00640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa780029d80 con 0x7fa780033d10 2024-04-17T05:27:25.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.370+0000 7fa78de00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fa780029ff0 con 0x7fa780035600 2024-04-17T05:27:25.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.370+0000 7fa78de00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fa780035e60 con 0x7fa7800359e0 2024-04-17T05:27:25.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.373+0000 7f3ecfe00640 1 --2- 172.21.15.123:0/3403084914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3eb8004de0 0x7f3eb8005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T05:27:25.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.374+0000 7fa78ca00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa780035600 0x7fa7800365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.374+0000 7f3ed5200640 1 --2- 172.21.15.123:0/3403084914 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3eb80043b0 0x7f3eb800ba40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0050f60 tx=0x7f3eb8005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d50628c9bac0a13 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:25.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.374+0000 7fa78ca00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa780035600 0x7fa7800365a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42376/0 (socket says 172.21.15.123:42376) 2024-04-17T05:27:25.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.374+0000 7fa78ca00640 1 -- 172.21.15.123:0/1194831799 learned_addr learned my addr 172.21.15.123:0/1194831799 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:25.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.374+0000 7fa787e00640 1 --2- 172.21.15.123:0/1194831799 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa7800359e0 0x7fa7800337d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.375+0000 7f3ecea00640 1 -- 172.21.15.123:0/3403084914 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0050540 con 0x7f3eb80043b0 2024-04-17T05:27:25.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.375+0000 7f3ecea00640 1 -- 172.21.15.123:0/3403084914 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed006bc80 con 0x7f3eb80043b0 2024-04-17T05:27:25.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.375+0000 7fa787e00640 1 -- 172.21.15.123:0/1194831799 >> v2:172.21.15.123:3300/0 conn(0x7fa780035600 msgr2=0x7fa7800365a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:25.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.375+0000 7fa787e00640 1 --2- 172.21.15.123:0/1194831799 >> v2:172.21.15.123:3300/0 conn(0x7fa780035600 0x7fa7800365a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.375+0000 7fa787e00640 1 -- 172.21.15.123:0/1194831799 >> v1:172.21.15.164:6789/0 conn(0x7fa780033d10 legacy=0x7fa7800c85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.375+0000 7fa787e00640 1 -- 172.21.15.123:0/1194831799 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa780036100 con 0x7fa7800359e0 2024-04-17T05:27:25.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.376+0000 7fa78ca00640 1 --2- 172.21.15.123:0/1194831799 >> v2:172.21.15.123:3300/0 conn(0x7fa780035600 0x7fa7800365a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T05:27:25.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.376+0000 7f3ecea00640 1 -- 172.21.15.123:0/3403084914 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed006d2b0 con 0x7f3eb80043b0 2024-04-17T05:27:25.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.378+0000 7f3ed5c00640 1 -- 172.21.15.123:0/3403084914 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3eb80043b0 msgr2=0x7f3eb800ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.378+0000 7f3ed5c00640 1 --2- 172.21.15.123:0/3403084914 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3eb80043b0 0x7f3eb800ba40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0050f60 tx=0x7f3eb8005830 comp rx=0 tx=0).stop 2024-04-17T05:27:25.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.378+0000 7f3ed5200640 1 -- 172.21.15.123:0/3403084914 reap_dead start 2024-04-17T05:27:25.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.378+0000 7fa787e00640 1 --2- 172.21.15.123:0/1194831799 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa7800359e0 0x7fa7800337d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa788050210 tx=0x7fa7880a91c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d0d97557a603752 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:25.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.378+0000 7f3ed5c00640 1 -- 172.21.15.123:0/3403084914 shutdown_connections 2024-04-17T05:27:25.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.378+0000 7f3ed5c00640 1 -- 172.21.15.123:0/3403084914 >> 172.21.15.123:0/3403084914 conn(0x7f3ec800b5d0 msgr2=0x7f3ec800b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:25.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.379+0000 7fa787400640 1 -- 172.21.15.123:0/1194831799 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7880a9d60 con 0x7fa7800359e0 2024-04-17T05:27:25.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.379+0000 7fa787400640 1 -- 172.21.15.123:0/1194831799 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7880b1440 con 0x7fa7800359e0 2024-04-17T05:27:25.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.379+0000 7fa787400640 1 -- 172.21.15.123:0/1194831799 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7880b1870 con 0x7fa7800359e0 2024-04-17T05:27:25.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.380+0000 7fa78de00640 1 -- 172.21.15.123:0/1194831799 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa7800359e0 msgr2=0x7fa7800337d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.380+0000 7fa78de00640 1 --2- 172.21.15.123:0/1194831799 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa7800359e0 0x7fa7800337d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa788050210 tx=0x7fa7880a91c0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.380+0000 7f3ed5c00640 1 -- 172.21.15.123:0/3403084914 shutdown_connections 2024-04-17T05:27:25.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.380+0000 7f3ed5c00640 1 -- 172.21.15.123:0/3403084914 wait complete. 2024-04-17T05:27:25.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.380+0000 7fa78de00640 1 -- 172.21.15.123:0/1194831799 shutdown_connections 2024-04-17T05:27:25.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.380+0000 7fa78de00640 1 --2- 172.21.15.123:0/1194831799 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa7800359e0 0x7fa7800337d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.380+0000 7fa78de00640 1 --2- 172.21.15.123:0/1194831799 >> v2:172.21.15.123:3300/0 conn(0x7fa780035600 0x7fa7800365a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.380+0000 7fa78de00640 1 -- 172.21.15.123:0/1194831799 >> 172.21.15.123:0/1194831799 conn(0x7fa78003a8a0 msgr2=0x7fa78003acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:25.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.381+0000 7fa78de00640 1 -- 172.21.15.123:0/1194831799 shutdown_connections 2024-04-17T05:27:25.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.381+0000 7fa78de00640 1 -- 172.21.15.123:0/1194831799 wait complete. 2024-04-17T05:27:25.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.384+0000 7fa78de00640 1 Processor -- start 2024-04-17T05:27:25.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.384+0000 7fa78de00640 1 -- start start 2024-04-17T05:27:25.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.384+0000 7f3ed5c00640 1 Processor -- start 2024-04-17T05:27:25.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.385+0000 7f3ed5c00640 1 -- start start 2024-04-17T05:27:25.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.385+0000 7fa78de00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa780033d10 0x7fa78002ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.385+0000 7fa78de00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa780035600 0x7fa780162860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.385+0000 7fa78de00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7800359e0 0x7fa780162da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.386+0000 7fa78ca00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa780033d10 0x7fa78002ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.386+0000 7f3ed5c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ec8027dc0 0x7f3ec8166440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.386+0000 7f3ed5c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ec8026a30 0x7f3ec8024b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.386+0000 7f3ed5c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ec8025080 0x7f3ec8169a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.386+0000 7f3ed5c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec80080a0 con 0x7f3ec8025080 2024-04-17T05:27:25.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.387+0000 7fa78ca00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa780033d10 0x7fa78002ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.123:42982/0 (socket says 172.21.15.123:42982) 2024-04-17T05:27:25.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.386+0000 7f3ed5c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec8008950 con 0x7f3ec8027dc0 2024-04-17T05:27:25.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.387+0000 7f3ed5c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f3ec8008220 con 0x7f3ec8026a30 2024-04-17T05:27:25.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.387+0000 7f3ed5200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ec8025080 0x7f3ec8169a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.387+0000 7fa78d400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7800359e0 0x7fa780162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.387+0000 7fa78de00640 1 -- 172.21.15.123:0/1447918458 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa7800c8e50 con 0x7fa7800359e0 2024-04-17T05:27:25.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.387+0000 7fa78ca00640 1 -- 172.21.15.123:0/1447918458 learned_addr learned my addr 172.21.15.123:0/1447918458 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:25.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.387+0000 7fa78de00640 1 -- 172.21.15.123:0/1447918458 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fa7800c8cd0 con 0x7fa780033d10 2024-04-17T05:27:25.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.387+0000 7fa78de00640 1 -- 172.21.15.123:0/1447918458 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fa780006ea0 con 0x7fa780035600 2024-04-17T05:27:25.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.388+0000 7fa787e00640 1 --2- 172.21.15.123:0/1447918458 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa780035600 0x7fa780162860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.387+0000 7f3ecf400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ec8026a30 0x7f3ec8024b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.388+0000 7f3ecf400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ec8026a30 0x7f3ec8024b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.123:48210/0 (socket says 172.21.15.123:48210) 2024-04-17T05:27:25.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.388+0000 7f3ecf400640 1 -- 172.21.15.123:0/2833177139 learned_addr learned my addr 172.21.15.123:0/2833177139 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:25.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.387+0000 7f3ed5200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ec8025080 0x7f3ec8169a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42398/0 (socket says 172.21.15.123:42398) 2024-04-17T05:27:25.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.388+0000 7fa78ca00640 1 -- 172.21.15.123:0/1447918458 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa780035600 msgr2=0x7fa780162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.388+0000 7fa78ca00640 1 --2- 172.21.15.123:0/1447918458 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa780035600 0x7fa780162860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.388+0000 7fa78ca00640 1 -- 172.21.15.123:0/1447918458 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7800359e0 msgr2=0x7fa780162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.388+0000 7fa78ca00640 1 --2- 172.21.15.123:0/1447918458 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7800359e0 0x7fa780162da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.388+0000 7fa78ca00640 1 -- 172.21.15.123:0/1447918458 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa78002fa90 con 0x7fa780033d10 2024-04-17T05:27:25.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.388+0000 7fa78d400640 1 --2- 172.21.15.123:0/1447918458 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7800359e0 0x7fa780162da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T05:27:25.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.388+0000 7f3ecfe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ec8027dc0 0x7f3ec8166440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.389+0000 7fa78ca00640 1 --2- 172.21.15.123:0/1447918458 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa780033d10 0x7fa78002ed20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa77c009f70 tx=0x7fa77c00eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:25.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.390+0000 7fa784c00640 1 -- 172.21.15.123:0/1447918458 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c00f040 con 0x7fa780033d10 2024-04-17T05:27:25.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.390+0000 7fa784c00640 1 -- 172.21.15.123:0/1447918458 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa77c017e00 con 0x7fa780033d10 2024-04-17T05:27:25.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.390+0000 7fa784c00640 1 -- 172.21.15.123:0/1447918458 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c004250 con 0x7fa780033d10 2024-04-17T05:27:25.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.389+0000 7f3ecfe00640 1 -- 172.21.15.123:0/2833177139 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ec8026a30 msgr2=0x7f3ec8024b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.389+0000 7f3ecfe00640 1 --2- 172.21.15.123:0/2833177139 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ec8026a30 0x7f3ec8024b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.389+0000 7f3ecfe00640 1 -- 172.21.15.123:0/2833177139 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ec8025080 msgr2=0x7f3ec8169a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.390+0000 7f3ecfe00640 1 --2- 172.21.15.123:0/2833177139 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ec8025080 0x7f3ec8169a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.390+0000 7f3ecfe00640 1 -- 172.21.15.123:0/2833177139 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec8025500 con 0x7f3ec8027dc0 2024-04-17T05:27:25.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.390+0000 7f3ed5200640 1 --2- 172.21.15.123:0/2833177139 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ec8025080 0x7f3ec8169a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T05:27:25.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.390+0000 7fa78de00640 1 -- 172.21.15.123:0/1447918458 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa780030450 con 0x7fa780033d10 2024-04-17T05:27:25.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.390+0000 7fa78de00640 1 -- 172.21.15.123:0/1447918458 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa780030710 con 0x7fa780033d10 2024-04-17T05:27:25.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.391+0000 7f3ecfe00640 1 --2- 172.21.15.123:0/2833177139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ec8027dc0 0x7f3ec8166440 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3ec400f930 tx=0x7f3ec400fdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:25.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.392+0000 7fa78de00640 1 -- 172.21.15.123:0/1447918458 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa764005290 con 0x7fa780033d10 2024-04-17T05:27:25.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.392+0000 7f3ebfe00640 1 -- 172.21.15.123:0/2833177139 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec40052e0 con 0x7f3ec8027dc0 2024-04-17T05:27:25.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.392+0000 7f3ebfe00640 1 -- 172.21.15.123:0/2833177139 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ec4018070 con 0x7f3ec8027dc0 2024-04-17T05:27:25.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.392+0000 7f3ebfe00640 1 -- 172.21.15.123:0/2833177139 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec400d990 con 0x7f3ec8027dc0 2024-04-17T05:27:25.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.393+0000 7f3ed5c00640 1 -- 172.21.15.123:0/2833177139 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ec8029ce0 con 0x7f3ec8027dc0 2024-04-17T05:27:25.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.393+0000 7f3ed5c00640 1 -- 172.21.15.123:0/2833177139 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ec8029300 con 0x7f3ec8027dc0 2024-04-17T05:27:25.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.394+0000 7f3ed5c00640 1 -- 172.21.15.123:0/2833177139 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ec80057e0 con 0x7f3ec8027dc0 2024-04-17T05:27:25.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.396+0000 7fa784c00640 1 -- 172.21.15.123:0/1447918458 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa77c00c670 con 0x7fa780033d10 2024-04-17T05:27:25.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.398+0000 7fa784c00640 1 --2- 172.21.15.123:0/1447918458 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fa76806c940 0x7fa76806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.398+0000 7fa784c00640 1 -- 172.21.15.123:0/1447918458 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa77c094790 con 0x7fa780033d10 2024-04-17T05:27:25.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.398+0000 7fa787e00640 1 --2- 172.21.15.123:0/1447918458 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fa76806c940 0x7fa76806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.400+0000 7fa787e00640 1 --2- 172.21.15.123:0/1447918458 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fa76806c940 0x7fa76806ee00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa780035fe0 tx=0x7fa7880ad000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:25.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.410+0000 7fa784c00640 1 -- 172.21.15.123:0/1447918458 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fa77c0628f0 con 0x7fa780033d10 2024-04-17T05:27:25.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.412+0000 7f3ebfe00640 1 -- 172.21.15.123:0/2833177139 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3ec400db30 con 0x7f3ec8027dc0 2024-04-17T05:27:25.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.413+0000 7f3ebfe00640 1 --2- 172.21.15.123:0/2833177139 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f3eb406c9f0 0x7f3eb406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.413+0000 7f3ebfe00640 1 -- 172.21.15.123:0/2833177139 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3ec408c560 con 0x7f3ec8027dc0 2024-04-17T05:27:25.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.414+0000 7f3ecf400640 1 --2- 172.21.15.123:0/2833177139 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f3eb406c9f0 0x7f3eb406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.416+0000 7f3ecf400640 1 --2- 172.21.15.123:0/2833177139 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f3eb406c9f0 0x7f3eb406eeb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8008d20 tx=0x7f3ec00090e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:25.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.422+0000 7fe93a400640 1 Processor -- start 2024-04-17T05:27:25.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.423+0000 7f3ebfe00640 1 -- 172.21.15.123:0/2833177139 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f3ec8025500 con 0x7f3ec8027dc0 2024-04-17T05:27:25.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.422+0000 7fe93a400640 1 -- start start 2024-04-17T05:27:25.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.424+0000 7fe93a400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe9341480f0 0x7fe934148580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.424+0000 7fe93a400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9340b4ab0 con 0x7fe9340b61c0 2024-04-17T05:27:25.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.424+0000 7fe93a400640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9340b4d90 con 0x7fe9340b52b0 2024-04-17T05:27:25.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.424+0000 7fe93a400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fe9340b69b0 con 0x7fe9341480f0 2024-04-17T05:27:25.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.424+0000 7fe933400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe9340b61c0 0x7fe9340b3d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47778/0 (socket says 172.21.15.123:47778) 2024-04-17T05:27:25.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.425+0000 7fe933400640 1 -- 172.21.15.123:0/1005730334 learned_addr learned my addr 172.21.15.123:0/1005730334 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:27:25.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.425+0000 7fe932a00640 1 --2- 172.21.15.123:0/1005730334 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe9341480f0 0x7fe934148580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.426+0000 7fe932000640 1 -- 172.21.15.123:0/1005730334 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 690134789 0 0) 0x7fe9340b4ab0 con 0x7fe9340b61c0 2024-04-17T05:27:25.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.426+0000 7fe932000640 1 -- 172.21.15.123:0/1005730334 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe918003520 con 0x7fe9340b61c0 2024-04-17T05:27:25.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.426+0000 7fe932a00640 1 -- 172.21.15.123:0/1005730334 >> v1:172.21.15.164:6789/0 conn(0x7fe9340b52b0 legacy=0x7fe9340b5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.426+0000 7fe932a00640 1 -- 172.21.15.123:0/1005730334 >> v1:172.21.15.123:6789/0 conn(0x7fe9340b61c0 legacy=0x7fe9340b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.426+0000 7fe932a00640 1 -- 172.21.15.123:0/1005730334 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9340b65a0 con 0x7fe9341480f0 2024-04-17T05:27:25.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.429+0000 7fe932a00640 1 --2- 172.21.15.123:0/1005730334 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe9341480f0 0x7fe934148580 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe9200097d0 tx=0x7fe92002b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0d96759debeb734 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:25.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.430+0000 7fe932000640 1 -- 172.21.15.123:0/1005730334 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9200317c0 con 0x7fe9341480f0 2024-04-17T05:27:25.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.430+0000 7fe932000640 1 -- 172.21.15.123:0/1005730334 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe920037070 con 0x7fe9341480f0 2024-04-17T05:27:25.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.430+0000 7fe932000640 1 -- 172.21.15.123:0/1005730334 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe920031b80 con 0x7fe9341480f0 2024-04-17T05:27:25.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.431+0000 7fe93a400640 1 -- 172.21.15.123:0/1005730334 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe9341480f0 msgr2=0x7fe934148580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.431+0000 7fe93a400640 1 --2- 172.21.15.123:0/1005730334 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe9341480f0 0x7fe934148580 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe9200097d0 tx=0x7fe92002b860 comp rx=0 tx=0).stop 2024-04-17T05:27:25.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.431+0000 7fe93a400640 1 -- 172.21.15.123:0/1005730334 shutdown_connections 2024-04-17T05:27:25.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.431+0000 7fe93a400640 1 --2- 172.21.15.123:0/1005730334 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe9341480f0 0x7fe934148580 secure :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe9200097d0 tx=0x7fe92002b860 comp rx=0 tx=0).stop 2024-04-17T05:27:25.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.431+0000 7fe93a400640 1 -- 172.21.15.123:0/1005730334 >> 172.21.15.123:0/1005730334 conn(0x7fe9340bd6f0 msgr2=0x7fe9340bdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:25.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.432+0000 7fe93a400640 1 -- 172.21.15.123:0/1005730334 shutdown_connections 2024-04-17T05:27:25.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.432+0000 7fe93a400640 1 -- 172.21.15.123:0/1005730334 wait complete. 2024-04-17T05:27:25.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.434+0000 7fe93a400640 1 Processor -- start 2024-04-17T05:27:25.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.435+0000 7fe93a400640 1 -- start start 2024-04-17T05:27:25.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.436+0000 7fe93a400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9340b52b0 0x7fe93414b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.436+0000 7fe93a400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9340b61c0 0x7fe934143a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.436+0000 7fe93a400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe9341429a0 0x7fe934143fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.436+0000 7fe93a400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe9341536b0 con 0x7fe9340b61c0 2024-04-17T05:27:25.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.436+0000 7fe93a400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe934153530 con 0x7fe9340b52b0 2024-04-17T05:27:25.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.436+0000 7fe93a400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fe934153830 con 0x7fe9341429a0 2024-04-17T05:27:25.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.437+0000 7fe933400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9340b52b0 0x7fe93414b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.437+0000 7fe932a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9340b61c0 0x7fe934143a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.437+0000 7fe933400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9340b52b0 0x7fe93414b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.123:42996/0 (socket says 172.21.15.123:42996) 2024-04-17T05:27:25.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.437+0000 7fe933400640 1 -- 172.21.15.123:0/4074694711 learned_addr learned my addr 172.21.15.123:0/4074694711 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:25.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.437+0000 7fe933e00640 1 --2- 172.21.15.123:0/4074694711 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe9341429a0 0x7fe934143fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.437+0000 7fed6cc00640 1 Processor -- start 2024-04-17T05:27:25.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.438+0000 7fed6cc00640 1 -- start start 2024-04-17T05:27:25.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.438+0000 7fe933400640 1 -- 172.21.15.123:0/4074694711 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe9341429a0 msgr2=0x7fe934143fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.438+0000 7fe933400640 1 --2- 172.21.15.123:0/4074694711 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe9341429a0 0x7fe934143fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.438+0000 7fe933400640 1 -- 172.21.15.123:0/4074694711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9340b61c0 msgr2=0x7fe934143a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.438+0000 7fe933400640 1 --2- 172.21.15.123:0/4074694711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9340b61c0 0x7fe934143a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.438+0000 7fe933400640 1 -- 172.21.15.123:0/4074694711 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe934142ed0 con 0x7fe9340b52b0 2024-04-17T05:27:25.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.439+0000 7fe933400640 1 --2- 172.21.15.123:0/4074694711 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9340b52b0 0x7fe93414b290 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe92400c440 tx=0x7fe92400c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:25.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.439+0000 7fe92b400640 1 -- 172.21.15.123:0/4074694711 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe924017070 con 0x7fe9340b52b0 2024-04-17T05:27:25.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.440+0000 7fe93a400640 1 -- 172.21.15.123:0/4074694711 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9341431b0 con 0x7fe9340b52b0 2024-04-17T05:27:25.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.440+0000 7fed6cc00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fed680b7e90 0x7fed680b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.440+0000 7fe92b400640 1 -- 172.21.15.123:0/4074694711 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe924005ce0 con 0x7fe9340b52b0 2024-04-17T05:27:25.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.440+0000 7fe92b400640 1 -- 172.21.15.123:0/4074694711 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9240072b0 con 0x7fe9340b52b0 2024-04-17T05:27:25.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.440+0000 7fed6cc00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed6814bff0 con 0x7fed680b58b0 2024-04-17T05:27:25.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.440+0000 7fed6cc00640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed680b5c90 con 0x7fed681486a0 2024-04-17T05:27:25.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.440+0000 7fe05aa00640 1 Processor -- start 2024-04-17T05:27:25.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.440+0000 7fe346600640 1 Processor -- start 2024-04-17T05:27:25.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.440+0000 7fed6cc00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fed68148210 con 0x7fed680b7e90 2024-04-17T05:27:25.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.440+0000 7fe93a400640 1 -- 172.21.15.123:0/4074694711 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9341ff500 con 0x7fe9340b52b0 2024-04-17T05:27:25.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.441+0000 7fed66800640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fed681486a0 0x7fed6814b8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.123:51248/0 (socket says 172.21.15.123:51248) 2024-04-17T05:27:25.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.441+0000 7fed66800640 1 -- 172.21.15.123:0/2770424021 learned_addr learned my addr 172.21.15.123:0/2770424021 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:27:25.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.441+0000 7fed65400640 1 --2- 172.21.15.123:0/2770424021 >> v2:172.21.15.123:3300/0 conn(0x7fed680b7e90 0x7fed680b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.441+0000 7fe346600640 1 -- start start 2024-04-17T05:27:25.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.442+0000 7fed65400640 1 -- 172.21.15.123:0/2770424021 >> v1:172.21.15.164:6789/0 conn(0x7fed681486a0 legacy=0x7fed6814b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.442+0000 7fe93a400640 1 -- 172.21.15.123:0/4074694711 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe90c005290 con 0x7fe9340b52b0 2024-04-17T05:27:25.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.442+0000 7fed65400640 1 -- 172.21.15.123:0/2770424021 >> v1:172.21.15.123:6789/0 conn(0x7fed680b58b0 legacy=0x7fed6814b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.442+0000 7fed65400640 1 -- 172.21.15.123:0/2770424021 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed68147be0 con 0x7fed680b7e90 2024-04-17T05:27:25.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.442+0000 7fe346600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe3400b58b0 0x7fe3400b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.442+0000 7fe346600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe3400b7e90 0x7fe3401486a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.442+0000 7fe346600640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3400b5c90 con 0x7fe34014b1d0 2024-04-17T05:27:25.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.442+0000 7fe346600640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe340148210 con 0x7fe3400b7e90 2024-04-17T05:27:25.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.442+0000 7fe346600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fe3400b67a0 con 0x7fe3400b58b0 2024-04-17T05:27:25.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.440+0000 7fe05aa00640 1 -- start start 2024-04-17T05:27:25.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.442+0000 7fe05aa00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe054072b20 0x7fe054147f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.442+0000 7fe05aa00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe054071a90 0x7fe0541484a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.442+0000 7fe05aa00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe05413e3d0 0x7fe05413e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.442+0000 7fe05aa00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe054072f00 con 0x7fe054071a90 2024-04-17T05:27:25.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.442+0000 7fe05aa00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7fe0540baa00 con 0x7fe054072b20 2024-04-17T05:27:25.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.442+0000 7fe05aa00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fe0540bace0 con 0x7fe05413e3d0 2024-04-17T05:27:25.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.443+0000 7fe058c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe054071a90 0x7fe0541484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.443+0000 7fe33f400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe3400b58b0 0x7fe3400b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.443+0000 7fe33f400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe3400b58b0 0x7fe3400b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.123:48244/0 (socket says 172.21.15.123:48244) 2024-04-17T05:27:25.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.443+0000 7fe059600640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe054072b20 0x7fe054147f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.443+0000 7fe33f400640 1 -- 172.21.15.123:0/3171524671 learned_addr learned my addr 172.21.15.123:0/3171524671 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:25.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.444+0000 7fe058c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe054071a90 0x7fe0541484a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42416/0 (socket says 172.21.15.123:42416) 2024-04-17T05:27:25.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.444+0000 7fe058c00640 1 -- 172.21.15.123:0/967664094 learned_addr learned my addr 172.21.15.123:0/967664094 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:25.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.444+0000 7fe05a000640 1 --2- 172.21.15.123:0/967664094 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe05413e3d0 0x7fe05413e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.444+0000 7fe33f400640 1 -- 172.21.15.123:0/3171524671 >> v2:172.21.15.123:3300/0 conn(0x7fe3400b7e90 msgr2=0x7fe3401486a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:25.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.444+0000 7fe33f400640 1 --2- 172.21.15.123:0/3171524671 >> v2:172.21.15.123:3300/0 conn(0x7fe3400b7e90 0x7fe3401486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.444+0000 7fe33f400640 1 -- 172.21.15.123:0/3171524671 >> v1:172.21.15.164:6789/0 conn(0x7fe34014b1d0 legacy=0x7fe34014b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:25.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.444+0000 7fe33f400640 1 -- 172.21.15.123:0/3171524671 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe340147be0 con 0x7fe3400b58b0 2024-04-17T05:27:25.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.444+0000 7fe059600640 1 -- 172.21.15.123:0/967664094 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe05413e3d0 msgr2=0x7fe05413e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:25.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.444+0000 7fe059600640 1 --2- 172.21.15.123:0/967664094 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe05413e3d0 0x7fe05413e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.444+0000 7fe059600640 1 -- 172.21.15.123:0/967664094 >> v2:172.21.15.123:3300/0 conn(0x7fe054071a90 msgr2=0x7fe0541484a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:25.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.445+0000 7fe059600640 1 --2- 172.21.15.123:0/967664094 >> v2:172.21.15.123:3300/0 conn(0x7fe054071a90 0x7fe0541484a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.445+0000 7fe059600640 1 -- 172.21.15.123:0/967664094 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0540bafc0 con 0x7fe054072b20 2024-04-17T05:27:25.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.445+0000 7fed65400640 1 --2- 172.21.15.123:0/2770424021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed680b7e90 0x7fed680b6260 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fed540097a0 tx=0x7fed5402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47b47739932e3345 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:25.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.445+0000 7fe058c00640 1 --2- 172.21.15.123:0/967664094 >> v2:172.21.15.123:3300/0 conn(0x7fe054071a90 0x7fe0541484a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T05:27:25.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.445+0000 7fe92b400640 1 -- 172.21.15.123:0/4074694711 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe92401a070 con 0x7fe9340b52b0 2024-04-17T05:27:25.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.445+0000 7fed64a00640 1 -- 172.21.15.123:0/2770424021 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed54035020 con 0x7fed680b7e90 2024-04-17T05:27:25.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.446+0000 7fed64a00640 1 -- 172.21.15.123:0/2770424021 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed54031830 con 0x7fed680b7e90 2024-04-17T05:27:25.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.446+0000 7fed64a00640 1 -- 172.21.15.123:0/2770424021 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed54031c00 con 0x7fed680b7e90 2024-04-17T05:27:25.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.446+0000 7fe33f400640 1 --2- 172.21.15.123:0/3171524671 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe3400b58b0 0x7fe3400b6260 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe3300098a0 tx=0x7fe33002b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f227fc5875c575c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:25.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.446+0000 7fe33e000640 1 -- 172.21.15.123:0/3171524671 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3300317c0 con 0x7fe3400b58b0 2024-04-17T05:27:25.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.446+0000 7fe33e000640 1 -- 172.21.15.123:0/3171524671 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe330037070 con 0x7fe3400b58b0 2024-04-17T05:27:25.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.446+0000 7fe33e000640 1 -- 172.21.15.123:0/3171524671 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe330031b80 con 0x7fe3400b58b0 2024-04-17T05:27:25.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.447+0000 7fed6cc00640 1 -- 172.21.15.123:0/2770424021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed680b7e90 msgr2=0x7fed680b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.447+0000 7fed6cc00640 1 --2- 172.21.15.123:0/2770424021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed680b7e90 0x7fed680b6260 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fed540097a0 tx=0x7fed5402b8d0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.447+0000 7fe059600640 1 --2- 172.21.15.123:0/967664094 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe054072b20 0x7fe054147f60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe0540b5ca0 tx=0x7fe04c02bd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14e94e5a6e894cc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:25.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.447+0000 7fed6cc00640 1 -- 172.21.15.123:0/2770424021 shutdown_connections 2024-04-17T05:27:25.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.447+0000 7fed6cc00640 1 --2- 172.21.15.123:0/2770424021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed680b7e90 0x7fed680b6260 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.447+0000 7fed6cc00640 1 -- 172.21.15.123:0/2770424021 >> 172.21.15.123:0/2770424021 conn(0x7fed680bd6f0 msgr2=0x7fed680bdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:25.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.447+0000 7fe346600640 1 -- 172.21.15.123:0/3171524671 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe3400b58b0 msgr2=0x7fe3400b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.447+0000 7fe346600640 1 --2- 172.21.15.123:0/3171524671 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe3400b58b0 0x7fe3400b6260 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe3300098a0 tx=0x7fe33002b860 comp rx=0 tx=0).stop 2024-04-17T05:27:25.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.447+0000 7fed6cc00640 1 -- 172.21.15.123:0/2770424021 shutdown_connections 2024-04-17T05:27:25.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.448+0000 7fed6cc00640 1 -- 172.21.15.123:0/2770424021 wait complete. 2024-04-17T05:27:25.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.448+0000 7fe346600640 1 -- 172.21.15.123:0/3171524671 shutdown_connections 2024-04-17T05:27:25.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.448+0000 7fe346600640 1 --2- 172.21.15.123:0/3171524671 >> v2:172.21.15.123:3300/0 conn(0x7fe3400b7e90 0x7fe3401486a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.448+0000 7fe346600640 1 --2- 172.21.15.123:0/3171524671 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe3400b58b0 0x7fe3400b6260 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.448+0000 7fe346600640 1 -- 172.21.15.123:0/3171524671 >> 172.21.15.123:0/3171524671 conn(0x7fe3400bd6f0 msgr2=0x7fe3400bdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:25.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.448+0000 7fe92b400640 1 --2- 172.21.15.123:0/4074694711 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe91406c8f0 0x7fe91406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.448+0000 7fe92b400640 1 -- 172.21.15.123:0/4074694711 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe92408b0f0 con 0x7fe9340b52b0 2024-04-17T05:27:25.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.448+0000 7fe346600640 1 -- 172.21.15.123:0/3171524671 shutdown_connections 2024-04-17T05:27:25.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.448+0000 7fe346600640 1 -- 172.21.15.123:0/3171524671 wait complete. 2024-04-17T05:27:25.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.448+0000 7fe932a00640 1 --2- 172.21.15.123:0/4074694711 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe91406c8f0 0x7fe91406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.450+0000 7fe346600640 1 Processor -- start 2024-04-17T05:27:25.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.450+0000 7fed6cc00640 1 Processor -- start 2024-04-17T05:27:25.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.450+0000 7fe346600640 1 -- start start 2024-04-17T05:27:25.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.451+0000 7fed6cc00640 1 -- start start 2024-04-17T05:27:25.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.451+0000 7fe932a00640 1 --2- 172.21.15.123:0/4074694711 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe91406c8f0 0x7fe91406edb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe920036000 tx=0x7fe920008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:25.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.452+0000 7fed6cc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed680b58b0 0x7fed6814b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.452+0000 7fe346600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe3400b58b0 0x7fe340149430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.452+0000 7fed6cc00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed680b7e90 0x7fed681e52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.452+0000 7fe346600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe3400b7e90 0x7fe3401e2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.452+0000 7fe346600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe34014b1d0 0x7fe3401394c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.453+0000 7fed6cc00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed681486a0 0x7fed681e5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.453+0000 7fe346600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe340148be0 con 0x7fe34014b1d0 2024-04-17T05:27:25.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.453+0000 7fe346600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe3400b76b0 con 0x7fe3400b58b0 2024-04-17T05:27:25.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.453+0000 7fe346600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fe340147ea0 con 0x7fe3400b7e90 2024-04-17T05:27:25.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.453+0000 7fe33fe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe34014b1d0 0x7fe3401394c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.453+0000 7fe33fe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe34014b1d0 0x7fe3401394c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42426/0 (socket says 172.21.15.123:42426) 2024-04-17T05:27:25.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.453+0000 7fe33fe00640 1 -- 172.21.15.123:0/1058213956 learned_addr learned my addr 172.21.15.123:0/1058213956 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:25.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.453+0000 7fe33f400640 1 --2- 172.21.15.123:0/1058213956 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe3400b58b0 0x7fe340149430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.453+0000 7fe33ea00640 1 --2- 172.21.15.123:0/1058213956 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe3400b7e90 0x7fe3401e2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.453+0000 7fed66800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed681486a0 0x7fed681e5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.453+0000 7fed65e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed680b58b0 0x7fed6814b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.453+0000 7fed66800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed681486a0 0x7fed681e5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42442/0 (socket says 172.21.15.123:42442) 2024-04-17T05:27:25.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.453+0000 7fed65400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed680b7e90 0x7fed681e52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.453+0000 7fed65e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed680b58b0 0x7fed6814b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.123:43016/0 (socket says 172.21.15.123:43016) 2024-04-17T05:27:25.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.453+0000 7fed65400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed680b7e90 0x7fed681e52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.123:48262/0 (socket says 172.21.15.123:48262) 2024-04-17T05:27:25.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.453+0000 7fed66800640 1 -- 172.21.15.123:0/1584302913 learned_addr learned my addr 172.21.15.123:0/1584302913 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:25.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.454+0000 7fed6cc00640 1 -- 172.21.15.123:0/1584302913 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fed680b76b0 con 0x7fed681486a0 2024-04-17T05:27:25.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.454+0000 7fed6cc00640 1 -- 172.21.15.123:0/1584302913 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fed680b67a0 con 0x7fed680b58b0 2024-04-17T05:27:25.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.454+0000 7fed6cc00640 1 -- 172.21.15.123:0/1584302913 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fed68147ea0 con 0x7fed680b7e90 2024-04-17T05:27:25.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.454+0000 7fe33fe00640 1 -- 172.21.15.123:0/1058213956 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe3400b7e90 msgr2=0x7fe3401e2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.454+0000 7fe33fe00640 1 --2- 172.21.15.123:0/1058213956 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe3400b7e90 0x7fe3401e2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.454+0000 7fe33fe00640 1 -- 172.21.15.123:0/1058213956 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe3400b58b0 msgr2=0x7fe340149430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.454+0000 7fe33fe00640 1 --2- 172.21.15.123:0/1058213956 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe3400b58b0 0x7fe340149430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.454+0000 7fe33fe00640 1 -- 172.21.15.123:0/1058213956 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3401e2c80 con 0x7fe34014b1d0 2024-04-17T05:27:25.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.454+0000 7fe33fe00640 1 --2- 172.21.15.123:0/1058213956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe34014b1d0 0x7fe3401394c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe33800b9c0 tx=0x7fe33800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:25.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.454+0000 7f10eb000640 1 Processor -- start 2024-04-17T05:27:25.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.455+0000 7f10eb000640 1 -- start start 2024-04-17T05:27:25.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.455+0000 7fe337400640 1 -- 172.21.15.123:0/1058213956 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe338019070 con 0x7fe34014b1d0 2024-04-17T05:27:25.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.455+0000 7fe337400640 1 -- 172.21.15.123:0/1058213956 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe33800cba0 con 0x7fe34014b1d0 2024-04-17T05:27:25.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.455+0000 7fe337400640 1 -- 172.21.15.123:0/1058213956 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe338014440 con 0x7fe34014b1d0 2024-04-17T05:27:25.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.455+0000 7fe346600640 1 -- 172.21.15.123:0/1058213956 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3401e29a0 con 0x7fe34014b1d0 2024-04-17T05:27:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.456+0000 7f8756a00640 1 Processor -- start 2024-04-17T05:27:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.455+0000 7fed66800640 1 -- 172.21.15.123:0/1584302913 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed680b7e90 msgr2=0x7fed681e52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.455+0000 7fed66800640 1 --2- 172.21.15.123:0/1584302913 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed680b7e90 0x7fed681e52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.455+0000 7fed66800640 1 -- 172.21.15.123:0/1584302913 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed680b58b0 msgr2=0x7fed6814b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.455+0000 7fed66800640 1 --2- 172.21.15.123:0/1584302913 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed680b58b0 0x7fed6814b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.455+0000 7fed66800640 1 -- 172.21.15.123:0/1584302913 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed6814aa30 con 0x7fed681486a0 2024-04-17T05:27:25.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.456+0000 7f8756a00640 1 -- start start 2024-04-17T05:27:25.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.456+0000 7f10eb000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f10e40ae3d0 0x7f10e4144ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.456+0000 7f10eb000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10e40b5580 con 0x7f10e41453e0 2024-04-17T05:27:25.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.456+0000 7f10eb000640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10e40b5860 con 0x7f10e406d2d0 2024-04-17T05:27:25.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.456+0000 7f10eb000640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f10e40b5330 con 0x7f10e40ae3d0 2024-04-17T05:27:25.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.456+0000 7fe346600640 1 -- 172.21.15.123:0/1058213956 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe34014aec0 con 0x7fe34014b1d0 2024-04-17T05:27:25.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.457+0000 7f10e3e00640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f10e406d2d0 0x7f10e40afd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.123:51262/0 (socket says 172.21.15.123:51262) 2024-04-17T05:27:25.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.457+0000 7f10e3e00640 1 -- 172.21.15.123:0/3646094130 learned_addr learned my addr 172.21.15.123:0/3646094130 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:27:25.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.457+0000 7f10e3400640 1 --2- 172.21.15.123:0/3646094130 >> v2:172.21.15.123:3300/0 conn(0x7f10e40ae3d0 0x7f10e4144ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.456+0000 7fed66800640 1 --2- 172.21.15.123:0/1584302913 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed681486a0 0x7fed681e5830 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fed6000c9f0 tx=0x7fed6000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:25.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.457+0000 7f8756a00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f87500b58f0 0x7f87501482f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.457+0000 7f8756a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87500b65d0 con 0x7f8750147ed0 2024-04-17T05:27:25.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.457+0000 7f8756a00640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87500b75a0 con 0x7f87500b61f0 2024-04-17T05:27:25.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.457+0000 7f8756a00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f87500b4d50 con 0x7f87500b58f0 2024-04-17T05:27:25.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.458+0000 7fed5e000640 1 -- 172.21.15.123:0/1584302913 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed60017070 con 0x7fed681486a0 2024-04-17T05:27:25.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.458+0000 7fed5e000640 1 -- 172.21.15.123:0/1584302913 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed6000ab70 con 0x7fed681486a0 2024-04-17T05:27:25.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.458+0000 7fed5e000640 1 -- 172.21.15.123:0/1584302913 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed60012400 con 0x7fed681486a0 2024-04-17T05:27:25.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.458+0000 7f10e3400640 1 -- 172.21.15.123:0/3646094130 >> v1:172.21.15.164:6789/0 conn(0x7f10e406d2d0 legacy=0x7f10e40afd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:25.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.458+0000 7fed6cc00640 1 -- 172.21.15.123:0/1584302913 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed6814b8e0 con 0x7fed681486a0 2024-04-17T05:27:25.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.458+0000 7fed6cc00640 1 -- 172.21.15.123:0/1584302913 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed680735e0 con 0x7fed681486a0 2024-04-17T05:27:25.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.458+0000 7f10e3400640 1 -- 172.21.15.123:0/3646094130 >> v1:172.21.15.123:6789/0 conn(0x7f10e41453e0 legacy=0x7f10e41526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.458+0000 7f10e3400640 1 -- 172.21.15.123:0/3646094130 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e40b5b40 con 0x7f10e40ae3d0 2024-04-17T05:27:25.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.458+0000 7f8755600640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f87500b61f0 0x7f87500b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.123:51268/0 (socket says 172.21.15.123:51268) 2024-04-17T05:27:25.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.458+0000 7f8756000640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f87500b58f0 0x7f87501482f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.458+0000 7fe346600640 1 -- 172.21.15.123:0/1058213956 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe340145b50 con 0x7fe34014b1d0 2024-04-17T05:27:25.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.458+0000 7f8754c00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8750147ed0 0x7f87500b51e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47802/0 (socket says 172.21.15.123:47802) 2024-04-17T05:27:25.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.458+0000 7f8754c00640 1 -- 172.21.15.123:0/1926220399 learned_addr learned my addr 172.21.15.123:0/1926220399 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:27:25.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.459+0000 7f8756000640 1 -- 172.21.15.123:0/1926220399 >> v1:172.21.15.164:6789/0 conn(0x7f87500b61f0 legacy=0x7f87500b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:25.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.459+0000 7fe337400640 1 -- 172.21.15.123:0/1058213956 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe33801c070 con 0x7fe34014b1d0 2024-04-17T05:27:25.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.460+0000 7fed6cc00640 1 -- 172.21.15.123:0/1584302913 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed6814b700 con 0x7fed681486a0 2024-04-17T05:27:25.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.460+0000 7f874fe00640 1 -- 172.21.15.123:0/1926220399 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 781672927 0 0) 0x7f87500b65d0 con 0x7f8750147ed0 2024-04-17T05:27:25.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.460+0000 7f8756000640 1 -- 172.21.15.123:0/1926220399 >> v1:172.21.15.123:6789/0 conn(0x7f8750147ed0 legacy=0x7f87500b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.460+0000 7f8756000640 1 -- 172.21.15.123:0/1926220399 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87500b49e0 con 0x7f87500b58f0 2024-04-17T05:27:25.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.461+0000 7fe337400640 1 --2- 172.21.15.123:0/1058213956 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe32006c940 0x7fe32006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.462+0000 7f8756000640 1 --2- 172.21.15.123:0/1926220399 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87500b58f0 0x7f87501482f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8748009d90 tx=0x7f874802beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=642468e994377ef6 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:25.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.462+0000 7fe337400640 1 -- 172.21.15.123:0/1058213956 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe3380574a0 con 0x7fe34014b1d0 2024-04-17T05:27:25.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.462+0000 7fe33f400640 1 --2- 172.21.15.123:0/1058213956 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe32006c940 0x7fe32006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.462+0000 7f10e3400640 1 --2- 172.21.15.123:0/3646094130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10e40ae3d0 0x7f10e4144ea0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f10d00097a0 tx=0x7f10d002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64dca8b2921dcacd server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:25.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.463+0000 7fed5e000640 1 -- 172.21.15.123:0/1584302913 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fed6001a070 con 0x7fed681486a0 2024-04-17T05:27:25.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.463+0000 7fed5e000640 1 --2- 172.21.15.123:0/1584302913 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fed4806c940 0x7fed4806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.464+0000 7fed5e000640 1 -- 172.21.15.123:0/1584302913 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fed6008bf70 con 0x7fed681486a0 2024-04-17T05:27:25.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.464+0000 7fe33f400640 1 --2- 172.21.15.123:0/1058213956 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe32006c940 0x7fe32006ee00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe330036000 tx=0x7fe33003d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:25.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.464+0000 7fed65e00640 1 --2- 172.21.15.123:0/1584302913 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fed4806c940 0x7fed4806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.465+0000 7fe92b400640 1 -- 172.21.15.123:0/4074694711 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fe924058c40 con 0x7fe9340b52b0 2024-04-17T05:27:25.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.465+0000 7f874fe00640 1 -- 172.21.15.123:0/1926220399 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8748039070 con 0x7f87500b58f0 2024-04-17T05:27:25.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.465+0000 7f874fe00640 1 -- 172.21.15.123:0/1926220399 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f874802cc60 con 0x7f87500b58f0 2024-04-17T05:27:25.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.465+0000 7f874fe00640 1 -- 172.21.15.123:0/1926220399 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8748034660 con 0x7f87500b58f0 2024-04-17T05:27:25.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.465+0000 7fe053e00640 1 -- 172.21.15.123:0/967664094 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c039070 con 0x7fe054072b20 2024-04-17T05:27:25.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.465+0000 7fe053e00640 1 -- 172.21.15.123:0/967664094 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe04c02cb40 con 0x7fe054072b20 2024-04-17T05:27:25.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.465+0000 7fe053e00640 1 -- 172.21.15.123:0/967664094 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c034440 con 0x7fe054072b20 2024-04-17T05:27:25.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.466+0000 7fed65e00640 1 --2- 172.21.15.123:0/1584302913 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fed4806c940 0x7fed4806ee00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fed58001780 tx=0x7fed58009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:25.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.466+0000 7f8756a00640 1 -- 172.21.15.123:0/1926220399 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87500b58f0 msgr2=0x7f87501482f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.466+0000 7f8756a00640 1 --2- 172.21.15.123:0/1926220399 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87500b58f0 0x7f87501482f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8748009d90 tx=0x7f874802beb0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.466+0000 7f8756a00640 1 -- 172.21.15.123:0/1926220399 shutdown_connections 2024-04-17T05:27:25.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.466+0000 7f8756a00640 1 --2- 172.21.15.123:0/1926220399 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87500b58f0 0x7f87501482f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.466+0000 7f8756a00640 1 -- 172.21.15.123:0/1926220399 >> 172.21.15.123:0/1926220399 conn(0x7f875006c260 msgr2=0x7f87500b9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:25.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.466+0000 7fe05aa00640 1 -- 172.21.15.123:0/967664094 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe054072b20 msgr2=0x7fe054147f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.466+0000 7fe05aa00640 1 --2- 172.21.15.123:0/967664094 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe054072b20 0x7fe054147f60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe0540b5ca0 tx=0x7fe04c02bd90 comp rx=0 tx=0).stop 2024-04-17T05:27:25.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.467+0000 7fe05aa00640 1 -- 172.21.15.123:0/967664094 shutdown_connections 2024-04-17T05:27:25.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.467+0000 7fe05aa00640 1 --2- 172.21.15.123:0/967664094 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe05413e3d0 0x7fe05413e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.467+0000 7fe05aa00640 1 --2- 172.21.15.123:0/967664094 >> v2:172.21.15.123:3300/0 conn(0x7fe054071a90 0x7fe0541484a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.467+0000 7fe05aa00640 1 --2- 172.21.15.123:0/967664094 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe054072b20 0x7fe054147f60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.467+0000 7fe05aa00640 1 -- 172.21.15.123:0/967664094 >> 172.21.15.123:0/967664094 conn(0x7fe05406db10 msgr2=0x7fe0540ba200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:25.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.466+0000 7f8756a00640 1 -- 172.21.15.123:0/1926220399 shutdown_connections 2024-04-17T05:27:25.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.466+0000 7f8756a00640 1 -- 172.21.15.123:0/1926220399 wait complete. 2024-04-17T05:27:25.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.467+0000 7fe05aa00640 1 -- 172.21.15.123:0/967664094 shutdown_connections 2024-04-17T05:27:25.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.467+0000 7fe337400640 1 -- 172.21.15.123:0/1058213956 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fe340145b50 con 0x7fe34014b1d0 2024-04-17T05:27:25.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.468+0000 7fe05aa00640 1 -- 172.21.15.123:0/967664094 wait complete. 2024-04-17T05:27:25.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.469+0000 7f8756a00640 1 Processor -- start 2024-04-17T05:27:25.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.470+0000 7f8756a00640 1 -- start start 2024-04-17T05:27:25.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.470+0000 7fe05aa00640 1 Processor -- start 2024-04-17T05:27:25.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.470+0000 7fe05aa00640 1 -- start start 2024-04-17T05:27:25.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.471+0000 7f8756a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87500b58f0 0x7f87501440f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.471+0000 7f8756a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87500b61f0 0x7f875013fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.471+0000 7f8756a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8750147ed0 0x7f875013b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.471+0000 7f8756a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f87501534b0 con 0x7f8750147ed0 2024-04-17T05:27:25.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.471+0000 7f8756a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8750153330 con 0x7f87500b61f0 2024-04-17T05:27:25.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.471+0000 7f8756a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f8750153630 con 0x7f87500b58f0 2024-04-17T05:27:25.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.471+0000 7f8756000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8750147ed0 0x7f875013b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.471+0000 7f8755600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87500b58f0 0x7f87501440f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.471+0000 7f8756000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8750147ed0 0x7f875013b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42456/0 (socket says 172.21.15.123:42456) 2024-04-17T05:27:25.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.471+0000 7f8754c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87500b61f0 0x7f875013fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.471+0000 7f8756000640 1 -- 172.21.15.123:0/1441838830 learned_addr learned my addr 172.21.15.123:0/1441838830 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:25.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.472+0000 7f8756000640 1 -- 172.21.15.123:0/1441838830 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87500b58f0 msgr2=0x7f87501440f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.472+0000 7f8756000640 1 --2- 172.21.15.123:0/1441838830 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87500b58f0 0x7f87501440f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.472+0000 7f8756000640 1 -- 172.21.15.123:0/1441838830 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87500b61f0 msgr2=0x7f875013fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.472+0000 7f8756000640 1 --2- 172.21.15.123:0/1441838830 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87500b61f0 0x7f875013fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.472+0000 7f8756000640 1 -- 172.21.15.123:0/1441838830 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87501e5aa0 con 0x7f8750147ed0 2024-04-17T05:27:25.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.472+0000 7fe05aa00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe054071a90 0x7fe054144000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.472+0000 7fe05aa00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe054072b20 0x7fe054141460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.472+0000 7fe05aa00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe05413e3d0 0x7fe0541e1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.472+0000 7fe05aa00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe0540714b0 con 0x7fe054072b20 2024-04-17T05:27:25.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.472+0000 7fe05aa00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe0540b6a00 con 0x7fe054071a90 2024-04-17T05:27:25.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.472+0000 7fe05aa00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fe054071630 con 0x7fe05413e3d0 2024-04-17T05:27:25.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.473+0000 7f8756000640 1 --2- 172.21.15.123:0/1441838830 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8750147ed0 0x7f875013b440 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8748037040 tx=0x7f8748004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:25.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.473+0000 7fe058c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe054072b20 0x7fe054141460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.473+0000 7fe058c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe054072b20 0x7fe054141460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42472/0 (socket says 172.21.15.123:42472) 2024-04-17T05:27:25.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.473+0000 7fe058c00640 1 -- 172.21.15.123:0/2698568654 learned_addr learned my addr 172.21.15.123:0/2698568654 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:25.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.473+0000 7fe059600640 1 --2- 172.21.15.123:0/2698568654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe054071a90 0x7fe054144000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.473+0000 7fe05a000640 1 --2- 172.21.15.123:0/2698568654 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe05413e3d0 0x7fe0541e1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.473+0000 7fe058c00640 1 -- 172.21.15.123:0/2698568654 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe05413e3d0 msgr2=0x7fe0541e1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.473+0000 7fe058c00640 1 --2- 172.21.15.123:0/2698568654 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe05413e3d0 0x7fe0541e1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.473+0000 7fe058c00640 1 -- 172.21.15.123:0/2698568654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe054071a90 msgr2=0x7fe054144000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.473+0000 7fe058c00640 1 --2- 172.21.15.123:0/2698568654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe054071a90 0x7fe054144000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.473+0000 7fe058c00640 1 -- 172.21.15.123:0/2698568654 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe054144d10 con 0x7fe054072b20 2024-04-17T05:27:25.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.473+0000 7fe05a000640 1 --2- 172.21.15.123:0/2698568654 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe05413e3d0 0x7fe0541e1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:25.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.474+0000 7fe058c00640 1 --2- 172.21.15.123:0/2698568654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe054072b20 0x7fe054141460 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe04000e9e0 tx=0x7fe04000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:25.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.477+0000 7f10e2a00640 1 -- 172.21.15.123:0/3646094130 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d00315a0 con 0x7f10e40ae3d0 2024-04-17T05:27:25.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.477+0000 7fed5e000640 1 -- 172.21.15.123:0/1584302913 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fed6814b700 con 0x7fed681486a0 2024-04-17T05:27:25.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.479+0000 7fe051600640 1 -- 172.21.15.123:0/2698568654 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe040017070 con 0x7fe054072b20 2024-04-17T05:27:25.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.479+0000 7fe051600640 1 -- 172.21.15.123:0/2698568654 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe04000c9d0 con 0x7fe054072b20 2024-04-17T05:27:25.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.479+0000 7fe051600640 1 -- 172.21.15.123:0/2698568654 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04000cd80 con 0x7fe054072b20 2024-04-17T05:27:25.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.479+0000 7f874d600640 1 -- 172.21.15.123:0/1441838830 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8748044020 con 0x7f8750147ed0 2024-04-17T05:27:25.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.480+0000 7f874d600640 1 -- 172.21.15.123:0/1441838830 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87480326f0 con 0x7f8750147ed0 2024-04-17T05:27:25.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.480+0000 7f874d600640 1 -- 172.21.15.123:0/1441838830 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8748039040 con 0x7f8750147ed0 2024-04-17T05:27:25.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.480+0000 7f8756a00640 1 -- 172.21.15.123:0/1441838830 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87501449c0 con 0x7f8750147ed0 2024-04-17T05:27:25.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.480+0000 7f8756a00640 1 -- 172.21.15.123:0/1441838830 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8750153050 con 0x7f8750147ed0 2024-04-17T05:27:25.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.480+0000 7fe05aa00640 1 -- 172.21.15.123:0/2698568654 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe054146df0 con 0x7fe054072b20 2024-04-17T05:27:25.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.480+0000 7fe05aa00640 1 -- 172.21.15.123:0/2698568654 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe054144790 con 0x7fe054072b20 2024-04-17T05:27:25.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.482+0000 7fe05aa00640 1 -- 172.21.15.123:0/2698568654 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe054075b30 con 0x7fe054072b20 2024-04-17T05:27:25.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.481+0000 7f10e2a00640 1 -- 172.21.15.123:0/3646094130 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10d0037070 con 0x7f10e40ae3d0 2024-04-17T05:27:25.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.481+0000 7f10e2a00640 1 -- 172.21.15.123:0/3646094130 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d0031960 con 0x7f10e40ae3d0 2024-04-17T05:27:25.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.482+0000 7f10eb000640 1 -- 172.21.15.123:0/3646094130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10e40ae3d0 msgr2=0x7f10e4144ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.482+0000 7f10eb000640 1 --2- 172.21.15.123:0/3646094130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10e40ae3d0 0x7f10e4144ea0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f10d00097a0 tx=0x7f10d002b840 comp rx=0 tx=0).stop 2024-04-17T05:27:25.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.484+0000 7f10eb000640 1 -- 172.21.15.123:0/3646094130 shutdown_connections 2024-04-17T05:27:25.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.484+0000 7f10eb000640 1 --2- 172.21.15.123:0/3646094130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10e40ae3d0 0x7f10e4144ea0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.484+0000 7f10eb000640 1 -- 172.21.15.123:0/3646094130 >> 172.21.15.123:0/3646094130 conn(0x7f10e40b93b0 msgr2=0x7f10e40b97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:25.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.485+0000 7f874d600640 1 -- 172.21.15.123:0/1441838830 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8748047020 con 0x7f8750147ed0 2024-04-17T05:27:25.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.486+0000 7f874d600640 1 --2- 172.21.15.123:0/1441838830 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f873006c920 0x7f873006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.486+0000 7f874d600640 1 -- 172.21.15.123:0/1441838830 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f87480ae8b0 con 0x7f8750147ed0 2024-04-17T05:27:25.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.487+0000 7f10eb000640 1 -- 172.21.15.123:0/3646094130 shutdown_connections 2024-04-17T05:27:25.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.487+0000 7f10eb000640 1 -- 172.21.15.123:0/3646094130 wait complete. 2024-04-17T05:27:25.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.487+0000 7f8756a00640 1 -- 172.21.15.123:0/1441838830 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8750146e50 con 0x7f8750147ed0 2024-04-17T05:27:25.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.489+0000 7fe051600640 1 -- 172.21.15.123:0/2698568654 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe04001a070 con 0x7fe054072b20 2024-04-17T05:27:25.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.489+0000 7f10eb000640 1 Processor -- start 2024-04-17T05:27:25.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.489+0000 7f10eb000640 1 -- start start 2024-04-17T05:27:25.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.491+0000 7f10eb000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10e406d2d0 0x7f10e40b1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.491+0000 7f10eb000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10e40ae3d0 0x7f10e40998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.491+0000 7f10eb000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10e41453e0 0x7f10e409acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.491+0000 7f10eb000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f10e4145850 con 0x7f10e41453e0 2024-04-17T05:27:25.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.491+0000 7f10eb000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f10e40b9ed0 con 0x7f10e406d2d0 2024-04-17T05:27:25.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.491+0000 7f10eb000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f10e4099fd0 con 0x7f10e40ae3d0 2024-04-17T05:27:25.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.491+0000 7f8755600640 1 --2- 172.21.15.123:0/1441838830 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f873006c920 0x7f873006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.491+0000 7fe051600640 1 --2- 172.21.15.123:0/2698568654 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe03406c9c0 0x7fe03406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.492+0000 7f10e3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10e406d2d0 0x7f10e40b1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.492+0000 7f10e3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10e406d2d0 0x7f10e40b1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.123:43072/0 (socket says 172.21.15.123:43072) 2024-04-17T05:27:25.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.492+0000 7f10e3e00640 1 -- 172.21.15.123:0/2879472182 learned_addr learned my addr 172.21.15.123:0/2879472182 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:25.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.492+0000 7f10e3400640 1 --2- 172.21.15.123:0/2879472182 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10e40ae3d0 0x7f10e40998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.492+0000 7fe051600640 1 -- 172.21.15.123:0/2698568654 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe04008c4d0 con 0x7fe054072b20 2024-04-17T05:27:25.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.492+0000 7fe059600640 1 --2- 172.21.15.123:0/2698568654 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe03406c9c0 0x7fe03406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.493+0000 7f10e3e00640 1 -- 172.21.15.123:0/2879472182 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10e40ae3d0 msgr2=0x7f10e40998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.493+0000 7f10e3e00640 1 --2- 172.21.15.123:0/2879472182 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10e40ae3d0 0x7f10e40998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.493+0000 7f10e9000640 1 --2- 172.21.15.123:0/2879472182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10e41453e0 0x7f10e409acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.493+0000 7f10e3e00640 1 -- 172.21.15.123:0/2879472182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10e41453e0 msgr2=0x7f10e409acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.493+0000 7f10e3e00640 1 --2- 172.21.15.123:0/2879472182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10e41453e0 0x7f10e409acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.493+0000 7f10e3e00640 1 -- 172.21.15.123:0/2879472182 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e4073650 con 0x7f10e406d2d0 2024-04-17T05:27:25.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.493+0000 7f10e9000640 1 --2- 172.21.15.123:0/2879472182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10e41453e0 0x7f10e409acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:25.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.493+0000 7f10e3e00640 1 --2- 172.21.15.123:0/2879472182 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10e406d2d0 0x7f10e40b1a60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f10d400cc40 tx=0x7f10d400a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:25.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.494+0000 7f10dbe00640 1 -- 172.21.15.123:0/2879472182 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d400ad40 con 0x7f10e406d2d0 2024-04-17T05:27:25.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.494+0000 7f10eb000640 1 -- 172.21.15.123:0/2879472182 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10e40722a0 con 0x7f10e406d2d0 2024-04-17T05:27:25.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.494+0000 7f10dbe00640 1 -- 172.21.15.123:0/2879472182 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10d4012400 con 0x7f10e406d2d0 2024-04-17T05:27:25.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.494+0000 7f10eb000640 1 -- 172.21.15.123:0/2879472182 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10e409b3d0 con 0x7f10e406d2d0 2024-04-17T05:27:25.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.495+0000 7f8755600640 1 --2- 172.21.15.123:0/1441838830 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f873006c920 0x7f873006ede0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8744005fd0 tx=0x7f8744007e60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:25.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.496+0000 7f10dbe00640 1 -- 172.21.15.123:0/2879472182 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d40127b0 con 0x7f10e406d2d0 2024-04-17T05:27:25.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.496+0000 7f10eb000640 1 -- 172.21.15.123:0/2879472182 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10e4068a40 con 0x7f10e406d2d0 2024-04-17T05:27:25.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.496+0000 7fe059600640 1 --2- 172.21.15.123:0/2698568654 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe03406c9c0 0x7fe03406ee80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe04c036000 tx=0x7fe04c030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:25.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.496+0000 7fe051600640 1 -- 172.21.15.123:0/2698568654 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fe040059fe0 con 0x7fe054072b20 2024-04-17T05:27:25.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.503+0000 7f10dbe00640 1 -- 172.21.15.123:0/2879472182 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f10d4012950 con 0x7f10e406d2d0 2024-04-17T05:27:25.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.504+0000 7f10dbe00640 1 --2- 172.21.15.123:0/2879472182 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f10c406c8f0 0x7f10c406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:25.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.504+0000 7f10dbe00640 1 -- 172.21.15.123:0/2879472182 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f10d408cff0 con 0x7f10e406d2d0 2024-04-17T05:27:25.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.505+0000 7f10e3400640 1 --2- 172.21.15.123:0/2879472182 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f10c406c8f0 0x7f10c406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:25.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.506+0000 7f874d600640 1 -- 172.21.15.123:0/1441838830 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f8750146e50 con 0x7f8750147ed0 2024-04-17T05:27:25.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.507+0000 7f10e3400640 1 --2- 172.21.15.123:0/2879472182 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f10c406c8f0 0x7f10c406edb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f10d0036000 tx=0x7f10d003d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:25.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.511+0000 7f10dbe00640 1 -- 172.21.15.123:0/2879472182 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f10d405b0f0 con 0x7f10e406d2d0 2024-04-17T05:27:25.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.827+0000 7fa78de00640 1 -- 172.21.15.123:0/1447918458 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fa764005850 con 0x7fa780033d10 2024-04-17T05:27:25.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.828+0000 7fa784c00640 1 -- 172.21.15.123:0/1447918458 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa77c0621f0 con 0x7fa780033d10 2024-04-17T05:27:25.826 INFO:teuthology.orchestra.run.smithi123.stdout:60129542155 2024-04-17T05:27:25.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.831+0000 7fa78de00640 1 -- 172.21.15.123:0/1447918458 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fa76806c940 msgr2=0x7fa76806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.831+0000 7fa78de00640 1 --2- 172.21.15.123:0/1447918458 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fa76806c940 0x7fa76806ee00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa780035fe0 tx=0x7fa7880ad000 comp rx=0 tx=0).stop 2024-04-17T05:27:25.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.832+0000 7fa78de00640 1 -- 172.21.15.123:0/1447918458 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa780033d10 msgr2=0x7fa78002ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.832+0000 7fa78de00640 1 --2- 172.21.15.123:0/1447918458 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa780033d10 0x7fa78002ed20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa77c009f70 tx=0x7fa77c00eca0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.832+0000 7fa78de00640 1 -- 172.21.15.123:0/1447918458 shutdown_connections 2024-04-17T05:27:25.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.832+0000 7fa78de00640 1 --2- 172.21.15.123:0/1447918458 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7800359e0 0x7fa780162da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.832+0000 7fa78de00640 1 --2- 172.21.15.123:0/1447918458 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fa76806c940 0x7fa76806ee00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.832+0000 7fa78de00640 1 --2- 172.21.15.123:0/1447918458 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa780035600 0x7fa780162860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.833+0000 7fa78de00640 1 --2- 172.21.15.123:0/1447918458 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa780033d10 0x7fa78002ed20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.833+0000 7fa78de00640 1 -- 172.21.15.123:0/1447918458 >> 172.21.15.123:0/1447918458 conn(0x7fa78003a8a0 msgr2=0x7fa78003ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:25.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.833+0000 7fa78de00640 1 -- 172.21.15.123:0/1447918458 shutdown_connections 2024-04-17T05:27:25.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.833+0000 7fa78de00640 1 -- 172.21.15.123:0/1447918458 wait complete. 2024-04-17T05:27:25.857 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.5 2024-04-17T05:27:25.857 DEBUG:teuthology.parallel:result is None 2024-04-17T05:27:25.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.871+0000 7f3ed5c00640 1 -- 172.21.15.123:0/2833177139 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f3ec8029020 con 0x7f3ec8027dc0 2024-04-17T05:27:25.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.872+0000 7f3ebfe00640 1 -- 172.21.15.123:0/2833177139 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3ec405a070 con 0x7f3ec8027dc0 2024-04-17T05:27:25.870 INFO:teuthology.orchestra.run.smithi123.stdout:60129542154 2024-04-17T05:27:25.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.875+0000 7f3ed5c00640 1 -- 172.21.15.123:0/2833177139 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f3eb406c9f0 msgr2=0x7f3eb406eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.875+0000 7f3ed5c00640 1 --2- 172.21.15.123:0/2833177139 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f3eb406c9f0 0x7f3eb406eeb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8008d20 tx=0x7f3ec00090e0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.875+0000 7f3ed5c00640 1 -- 172.21.15.123:0/2833177139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ec8027dc0 msgr2=0x7f3ec8166440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.875+0000 7f3ed5c00640 1 --2- 172.21.15.123:0/2833177139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ec8027dc0 0x7f3ec8166440 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3ec400f930 tx=0x7f3ec400fdf0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.876+0000 7f3ed5c00640 1 -- 172.21.15.123:0/2833177139 shutdown_connections 2024-04-17T05:27:25.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.876+0000 7f3ed5c00640 1 --2- 172.21.15.123:0/2833177139 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ec8025080 0x7f3ec8169a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.876+0000 7f3ed5c00640 1 --2- 172.21.15.123:0/2833177139 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f3eb406c9f0 0x7f3eb406eeb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.876+0000 7f3ed5c00640 1 --2- 172.21.15.123:0/2833177139 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3ec8026a30 0x7f3ec8024b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.876+0000 7f3ed5c00640 1 --2- 172.21.15.123:0/2833177139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3ec8027dc0 0x7f3ec8166440 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.876+0000 7f3ed5c00640 1 -- 172.21.15.123:0/2833177139 >> 172.21.15.123:0/2833177139 conn(0x7f3ec800b5d0 msgr2=0x7f3ec803ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:25.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.876+0000 7f3ed5c00640 1 -- 172.21.15.123:0/2833177139 shutdown_connections 2024-04-17T05:27:25.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.876+0000 7f3ed5c00640 1 -- 172.21.15.123:0/2833177139 wait complete. 2024-04-17T05:27:25.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.889+0000 7fe05aa00640 1 -- 172.21.15.123:0/2698568654 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fe054142150 con 0x7fe054072b20 2024-04-17T05:27:25.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.890+0000 7fe051600640 1 -- 172.21.15.123:0/2698568654 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe04005e2e0 con 0x7fe054072b20 2024-04-17T05:27:25.888 INFO:teuthology.orchestra.run.smithi123.stdout:60129542155 2024-04-17T05:27:25.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.892+0000 7fe05aa00640 1 -- 172.21.15.123:0/2698568654 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe03406c9c0 msgr2=0x7fe03406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.892+0000 7fe05aa00640 1 --2- 172.21.15.123:0/2698568654 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe03406c9c0 0x7fe03406ee80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe04c036000 tx=0x7fe04c030000 comp rx=0 tx=0).stop 2024-04-17T05:27:25.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.892+0000 7fe05aa00640 1 -- 172.21.15.123:0/2698568654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe054072b20 msgr2=0x7fe054141460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.892+0000 7fe05aa00640 1 --2- 172.21.15.123:0/2698568654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe054072b20 0x7fe054141460 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe04000e9e0 tx=0x7fe04000eea0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.892+0000 7fe346600640 1 -- 172.21.15.123:0/1058213956 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fe340068a40 con 0x7fe34014b1d0 2024-04-17T05:27:25.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.892+0000 7fe05aa00640 1 -- 172.21.15.123:0/2698568654 shutdown_connections 2024-04-17T05:27:25.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.892+0000 7fe05aa00640 1 --2- 172.21.15.123:0/2698568654 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe03406c9c0 0x7fe03406ee80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.892+0000 7fe05aa00640 1 --2- 172.21.15.123:0/2698568654 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe05413e3d0 0x7fe0541e1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.892+0000 7fe05aa00640 1 --2- 172.21.15.123:0/2698568654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe054072b20 0x7fe054141460 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.892+0000 7fe05aa00640 1 --2- 172.21.15.123:0/2698568654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe054071a90 0x7fe054144000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.892+0000 7fe05aa00640 1 -- 172.21.15.123:0/2698568654 >> 172.21.15.123:0/2698568654 conn(0x7fe05406db10 msgr2=0x7fe054145b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:25.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.893+0000 7fe05aa00640 1 -- 172.21.15.123:0/2698568654 shutdown_connections 2024-04-17T05:27:25.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.893+0000 7fe05aa00640 1 -- 172.21.15.123:0/2698568654 wait complete. 2024-04-17T05:27:25.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.893+0000 7fe337400640 1 -- 172.21.15.123:0/1058213956 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe338059400 con 0x7fe34014b1d0 2024-04-17T05:27:25.892 INFO:teuthology.orchestra.run.smithi123.stdout:60129542155 2024-04-17T05:27:25.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.896+0000 7fe346600640 1 -- 172.21.15.123:0/1058213956 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe32006c940 msgr2=0x7fe32006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.896+0000 7fe346600640 1 --2- 172.21.15.123:0/1058213956 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe32006c940 0x7fe32006ee00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe330036000 tx=0x7fe33003d040 comp rx=0 tx=0).stop 2024-04-17T05:27:25.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.896+0000 7fe346600640 1 -- 172.21.15.123:0/1058213956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe34014b1d0 msgr2=0x7fe3401394c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.896+0000 7fe346600640 1 --2- 172.21.15.123:0/1058213956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe34014b1d0 0x7fe3401394c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe33800b9c0 tx=0x7fe33800be80 comp rx=0 tx=0).stop 2024-04-17T05:27:25.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.896+0000 7fe346600640 1 -- 172.21.15.123:0/1058213956 shutdown_connections 2024-04-17T05:27:25.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.896+0000 7fe346600640 1 --2- 172.21.15.123:0/1058213956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe34014b1d0 0x7fe3401394c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.896+0000 7fe346600640 1 --2- 172.21.15.123:0/1058213956 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe32006c940 0x7fe32006ee00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.896+0000 7fe346600640 1 --2- 172.21.15.123:0/1058213956 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe3400b7e90 0x7fe3401e2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.896+0000 7fe346600640 1 --2- 172.21.15.123:0/1058213956 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe3400b58b0 0x7fe340149430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.896+0000 7fe346600640 1 -- 172.21.15.123:0/1058213956 >> 172.21.15.123:0/1058213956 conn(0x7fe3400bd6f0 msgr2=0x7fe3400676c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:25.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.897+0000 7fe346600640 1 -- 172.21.15.123:0/1058213956 shutdown_connections 2024-04-17T05:27:25.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.897+0000 7fe346600640 1 -- 172.21.15.123:0/1058213956 wait complete. 2024-04-17T05:27:25.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.900+0000 7fe93a400640 1 -- 172.21.15.123:0/4074694711 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fe90c005580 con 0x7fe9340b52b0 2024-04-17T05:27:25.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.901+0000 7fe92b400640 1 -- 172.21.15.123:0/4074694711 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe92405cf40 con 0x7fe9340b52b0 2024-04-17T05:27:25.901 INFO:teuthology.orchestra.run.smithi123.stdout:60129542154 2024-04-17T05:27:25.901 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.4 2024-04-17T05:27:25.901 DEBUG:teuthology.parallel:result is None 2024-04-17T05:27:25.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.904+0000 7fe93a400640 1 -- 172.21.15.123:0/4074694711 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe91406c8f0 msgr2=0x7fe91406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.904+0000 7fe93a400640 1 --2- 172.21.15.123:0/4074694711 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe91406c8f0 0x7fe91406edb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe920036000 tx=0x7fe920008030 comp rx=0 tx=0).stop 2024-04-17T05:27:25.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.904+0000 7fe93a400640 1 -- 172.21.15.123:0/4074694711 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9340b52b0 msgr2=0x7fe93414b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.904+0000 7fe93a400640 1 --2- 172.21.15.123:0/4074694711 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9340b52b0 0x7fe93414b290 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe92400c440 tx=0x7fe92400c900 comp rx=0 tx=0).stop 2024-04-17T05:27:25.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.905+0000 7fe93a400640 1 -- 172.21.15.123:0/4074694711 shutdown_connections 2024-04-17T05:27:25.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.905+0000 7fe93a400640 1 --2- 172.21.15.123:0/4074694711 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe91406c8f0 0x7fe91406edb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.905+0000 7fe93a400640 1 --2- 172.21.15.123:0/4074694711 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe9341429a0 0x7fe934143fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.905+0000 7fe93a400640 1 --2- 172.21.15.123:0/4074694711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9340b61c0 0x7fe934143a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.905+0000 7fe93a400640 1 --2- 172.21.15.123:0/4074694711 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9340b52b0 0x7fe93414b290 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.905+0000 7fe93a400640 1 -- 172.21.15.123:0/4074694711 >> 172.21.15.123:0/4074694711 conn(0x7fe9340bd6f0 msgr2=0x7fe93413e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:25.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.905+0000 7fe93a400640 1 -- 172.21.15.123:0/4074694711 shutdown_connections 2024-04-17T05:27:25.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.905+0000 7fe93a400640 1 -- 172.21.15.123:0/4074694711 wait complete. 2024-04-17T05:27:25.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.909+0000 7fed6cc00640 1 -- 172.21.15.123:0/1584302913 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fed68068a40 con 0x7fed681486a0 2024-04-17T05:27:25.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.910+0000 7fed5e000640 1 -- 172.21.15.123:0/1584302913 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fed60059a80 con 0x7fed681486a0 2024-04-17T05:27:25.908 INFO:teuthology.orchestra.run.smithi123.stdout:60129542154 2024-04-17T05:27:25.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.913+0000 7fed6cc00640 1 -- 172.21.15.123:0/1584302913 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fed4806c940 msgr2=0x7fed4806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.913+0000 7fed6cc00640 1 --2- 172.21.15.123:0/1584302913 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fed4806c940 0x7fed4806ee00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fed58001780 tx=0x7fed58009040 comp rx=0 tx=0).stop 2024-04-17T05:27:25.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.913+0000 7fed6cc00640 1 -- 172.21.15.123:0/1584302913 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed681486a0 msgr2=0x7fed681e5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.913+0000 7fed6cc00640 1 --2- 172.21.15.123:0/1584302913 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed681486a0 0x7fed681e5830 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fed6000c9f0 tx=0x7fed6000ceb0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.914+0000 7fed6cc00640 1 -- 172.21.15.123:0/1584302913 shutdown_connections 2024-04-17T05:27:25.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.914+0000 7fed6cc00640 1 --2- 172.21.15.123:0/1584302913 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed681486a0 0x7fed681e5830 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.914+0000 7fed6cc00640 1 --2- 172.21.15.123:0/1584302913 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fed4806c940 0x7fed4806ee00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.914+0000 7fed6cc00640 1 --2- 172.21.15.123:0/1584302913 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fed680b7e90 0x7fed681e52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.914+0000 7fed6cc00640 1 --2- 172.21.15.123:0/1584302913 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed680b58b0 0x7fed6814b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.914+0000 7fed6cc00640 1 -- 172.21.15.123:0/1584302913 >> 172.21.15.123:0/1584302913 conn(0x7fed680bd6f0 msgr2=0x7fed681463e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:25.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.914+0000 7fed6cc00640 1 -- 172.21.15.123:0/1584302913 shutdown_connections 2024-04-17T05:27:25.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.915+0000 7fed6cc00640 1 -- 172.21.15.123:0/1584302913 wait complete. 2024-04-17T05:27:25.917 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.7 2024-04-17T05:27:25.917 DEBUG:teuthology.parallel:result is None 2024-04-17T05:27:25.920 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.1 2024-04-17T05:27:25.920 DEBUG:teuthology.parallel:result is None 2024-04-17T05:27:25.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.923+0000 7f8756a00640 1 -- 172.21.15.123:0/1441838830 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f87501e50b0 con 0x7f8750147ed0 2024-04-17T05:27:25.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.924+0000 7f874d600640 1 -- 172.21.15.123:0/1441838830 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f874804e070 con 0x7f8750147ed0 2024-04-17T05:27:25.922 INFO:teuthology.orchestra.run.smithi123.stdout:60129542154 2024-04-17T05:27:25.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.925+0000 7f10eb000640 1 -- 172.21.15.123:0/2879472182 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f10e40b8e10 con 0x7f10e406d2d0 2024-04-17T05:27:25.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.926+0000 7f10dbe00640 1 -- 172.21.15.123:0/2879472182 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f10d405a9f0 con 0x7f10e406d2d0 2024-04-17T05:27:25.924 INFO:teuthology.orchestra.run.smithi123.stdout:60129542156 2024-04-17T05:27:25.925 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.6 2024-04-17T05:27:25.925 DEBUG:teuthology.parallel:result is None 2024-04-17T05:27:25.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.927+0000 7f8756a00640 1 -- 172.21.15.123:0/1441838830 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f873006c920 msgr2=0x7f873006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.927+0000 7f8756a00640 1 --2- 172.21.15.123:0/1441838830 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f873006c920 0x7f873006ede0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8744005fd0 tx=0x7f8744007e60 comp rx=0 tx=0).stop 2024-04-17T05:27:25.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.927+0000 7f8756a00640 1 -- 172.21.15.123:0/1441838830 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8750147ed0 msgr2=0x7f875013b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.927+0000 7f8756a00640 1 --2- 172.21.15.123:0/1441838830 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8750147ed0 0x7f875013b440 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8748037040 tx=0x7f8748004a40 comp rx=0 tx=0).stop 2024-04-17T05:27:25.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.928+0000 7f8756a00640 1 -- 172.21.15.123:0/1441838830 shutdown_connections 2024-04-17T05:27:25.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.928+0000 7f8756a00640 1 --2- 172.21.15.123:0/1441838830 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8750147ed0 0x7f875013b440 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.928+0000 7f8756a00640 1 --2- 172.21.15.123:0/1441838830 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87500b61f0 0x7f875013fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.928+0000 7f8756a00640 1 --2- 172.21.15.123:0/1441838830 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f873006c920 0x7f873006ede0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.928+0000 7f8756a00640 1 --2- 172.21.15.123:0/1441838830 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87500b58f0 0x7f87501440f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.928+0000 7f8756a00640 1 -- 172.21.15.123:0/1441838830 >> 172.21.15.123:0/1441838830 conn(0x7f875006c260 msgr2=0x7f8750147690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:25.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.928+0000 7f8756a00640 1 -- 172.21.15.123:0/1441838830 shutdown_connections 2024-04-17T05:27:25.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.928+0000 7f8756a00640 1 -- 172.21.15.123:0/1441838830 wait complete. 2024-04-17T05:27:25.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.928+0000 7f10eb000640 1 -- 172.21.15.123:0/2879472182 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f10c406c8f0 msgr2=0x7f10c406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.928+0000 7f10eb000640 1 --2- 172.21.15.123:0/2879472182 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f10c406c8f0 0x7f10c406edb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f10d0036000 tx=0x7f10d003d040 comp rx=0 tx=0).stop 2024-04-17T05:27:25.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.928+0000 7f10eb000640 1 -- 172.21.15.123:0/2879472182 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10e406d2d0 msgr2=0x7f10e40b1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:25.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.928+0000 7f10eb000640 1 --2- 172.21.15.123:0/2879472182 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10e406d2d0 0x7f10e40b1a60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f10d400cc40 tx=0x7f10d400a430 comp rx=0 tx=0).stop 2024-04-17T05:27:25.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.929+0000 7f10eb000640 1 -- 172.21.15.123:0/2879472182 shutdown_connections 2024-04-17T05:27:25.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.929+0000 7f10eb000640 1 --2- 172.21.15.123:0/2879472182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10e41453e0 0x7f10e409acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.929+0000 7f10eb000640 1 --2- 172.21.15.123:0/2879472182 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f10c406c8f0 0x7f10c406edb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.929+0000 7f10eb000640 1 --2- 172.21.15.123:0/2879472182 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f10e40ae3d0 0x7f10e40998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.929+0000 7f10eb000640 1 --2- 172.21.15.123:0/2879472182 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10e406d2d0 0x7f10e40b1a60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:25.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.929+0000 7f10eb000640 1 -- 172.21.15.123:0/2879472182 >> 172.21.15.123:0/2879472182 conn(0x7f10e40b93b0 msgr2=0x7f10e40b7980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:25.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.929+0000 7f10eb000640 1 -- 172.21.15.123:0/2879472182 shutdown_connections 2024-04-17T05:27:25.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:25.929+0000 7f10eb000640 1 -- 172.21.15.123:0/2879472182 wait complete. 2024-04-17T05:27:25.939 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.0 2024-04-17T05:27:25.939 DEBUG:teuthology.parallel:result is None 2024-04-17T05:27:25.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.3 2024-04-17T05:27:25.944 DEBUG:teuthology.parallel:result is None 2024-04-17T05:27:25.945 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.2 2024-04-17T05:27:25.945 DEBUG:teuthology.parallel:result is None 2024-04-17T05:27:25.945 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-17T05:27:25.945 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T05:27:26.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.190+0000 7f77f1000640 1 Processor -- start 2024-04-17T05:27:26.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.190+0000 7f77f1000640 1 -- start start 2024-04-17T05:27:26.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.191+0000 7f77f1000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f77ec142110 0x7f77ec0b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:26.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.192+0000 7f77f1000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77ec148240 con 0x7f77ec0b9a80 2024-04-17T05:27:26.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.192+0000 7f77f1000640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77ec0b57e0 con 0x7f77ec0ba6a0 2024-04-17T05:27:26.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.192+0000 7f77f1000640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f77ec0b5e10 con 0x7f77ec142110 2024-04-17T05:27:26.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.192+0000 7f77eaa00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f77ec0b9a80 0x7f77ec141a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47814/0 (socket says 172.21.15.123:47814) 2024-04-17T05:27:26.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.192+0000 7f77eaa00640 1 -- 172.21.15.123:0/923069849 learned_addr learned my addr 172.21.15.123:0/923069849 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:27:26.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.192+0000 7f77ebe00640 1 --2- 172.21.15.123:0/923069849 >> v2:172.21.15.123:3300/0 conn(0x7f77ec142110 0x7f77ec0b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:26.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.192+0000 7f77ea000640 1 -- 172.21.15.123:0/923069849 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 530761176 0 0) 0x7f77ec148240 con 0x7f77ec0b9a80 2024-04-17T05:27:26.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.192+0000 7f77ea000640 1 -- 172.21.15.123:0/923069849 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77d0003520 con 0x7f77ec0b9a80 2024-04-17T05:27:26.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.192+0000 7f77ebe00640 1 -- 172.21.15.123:0/923069849 >> v1:172.21.15.164:6789/0 conn(0x7f77ec0ba6a0 legacy=0x7f77ec147b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:26.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.192+0000 7f77ebe00640 1 -- 172.21.15.123:0/923069849 >> v1:172.21.15.123:6789/0 conn(0x7f77ec0b9a80 legacy=0x7f77ec141a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:26.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.192+0000 7f77ebe00640 1 -- 172.21.15.123:0/923069849 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77ec0baa80 con 0x7f77ec142110 2024-04-17T05:27:26.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.194+0000 7f77ebe00640 1 --2- 172.21.15.123:0/923069849 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77ec142110 0x7f77ec0b48f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009d90 tx=0x7f77e402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d705aac50e0998fe server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:26.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.194+0000 7f77ea000640 1 -- 172.21.15.123:0/923069849 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e4039070 con 0x7f77ec142110 2024-04-17T05:27:26.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.194+0000 7f77ea000640 1 -- 172.21.15.123:0/923069849 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77e402cc60 con 0x7f77ec142110 2024-04-17T05:27:26.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.194+0000 7f77ea000640 1 -- 172.21.15.123:0/923069849 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e4034640 con 0x7f77ec142110 2024-04-17T05:27:26.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.194+0000 7f77f1000640 1 -- 172.21.15.123:0/923069849 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77ec142110 msgr2=0x7f77ec0b48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:26.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.194+0000 7f77f1000640 1 --2- 172.21.15.123:0/923069849 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77ec142110 0x7f77ec0b48f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009d90 tx=0x7f77e402beb0 comp rx=0 tx=0).stop 2024-04-17T05:27:26.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.194+0000 7f77f1000640 1 -- 172.21.15.123:0/923069849 shutdown_connections 2024-04-17T05:27:26.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.194+0000 7f77f1000640 1 --2- 172.21.15.123:0/923069849 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77ec142110 0x7f77ec0b48f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:26.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.194+0000 7f77f1000640 1 -- 172.21.15.123:0/923069849 >> 172.21.15.123:0/923069849 conn(0x7f77ec06bda0 msgr2=0x7f77ec06c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:26.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.194+0000 7f77f1000640 1 -- 172.21.15.123:0/923069849 shutdown_connections 2024-04-17T05:27:26.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.195+0000 7f77f1000640 1 -- 172.21.15.123:0/923069849 wait complete. 2024-04-17T05:27:26.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.196+0000 7f77f1000640 1 Processor -- start 2024-04-17T05:27:26.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.196+0000 7f77f1000640 1 -- start start 2024-04-17T05:27:26.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.197+0000 7f77f1000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77ec0b9a80 0x7f77ec1dd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:26.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.197+0000 7f77f1000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77ec0ba6a0 0x7f77ec136b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:26.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.197+0000 7f77f1000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77ec142110 0x7f77ec138230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:26.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.197+0000 7f77f1000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f77ec0b62a0 con 0x7f77ec0ba6a0 2024-04-17T05:27:26.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.197+0000 7f77f1000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f77ec0b71d0 con 0x7f77ec142110 2024-04-17T05:27:26.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.197+0000 7f77f1000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f77ec0b6420 con 0x7f77ec0b9a80 2024-04-17T05:27:26.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.197+0000 7f77eaa00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77ec0ba6a0 0x7f77ec136b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:26.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.197+0000 7f77eaa00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77ec0ba6a0 0x7f77ec136b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42490/0 (socket says 172.21.15.123:42490) 2024-04-17T05:27:26.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.197+0000 7f77eaa00640 1 -- 172.21.15.123:0/2471657102 learned_addr learned my addr 172.21.15.123:0/2471657102 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:26.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.197+0000 7f77eaa00640 1 -- 172.21.15.123:0/2471657102 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77ec0b9a80 msgr2=0x7f77ec1dd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:26.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.197+0000 7f77eaa00640 1 --2- 172.21.15.123:0/2471657102 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77ec0b9a80 0x7f77ec1dd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:26.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.197+0000 7f77ebe00640 1 --2- 172.21.15.123:0/2471657102 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77ec142110 0x7f77ec138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:26.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.197+0000 7f77eaa00640 1 -- 172.21.15.123:0/2471657102 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77ec142110 msgr2=0x7f77ec138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:26.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.197+0000 7f77eaa00640 1 --2- 172.21.15.123:0/2471657102 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77ec142110 0x7f77ec138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:26.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.197+0000 7f77eaa00640 1 -- 172.21.15.123:0/2471657102 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77ec1395e0 con 0x7f77ec0ba6a0 2024-04-17T05:27:26.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.198+0000 7f77eaa00640 1 --2- 172.21.15.123:0/2471657102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77ec0ba6a0 0x7f77ec136b50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f77d800c530 tx=0x7f77d800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:26.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.198+0000 7f77e3400640 1 -- 172.21.15.123:0/2471657102 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d8017070 con 0x7f77ec0ba6a0 2024-04-17T05:27:26.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.198+0000 7f77e3400640 1 -- 172.21.15.123:0/2471657102 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77d8005ce0 con 0x7f77ec0ba6a0 2024-04-17T05:27:26.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.198+0000 7f77e3400640 1 -- 172.21.15.123:0/2471657102 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d80072b0 con 0x7f77ec0ba6a0 2024-04-17T05:27:26.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.198+0000 7f77f1000640 1 -- 172.21.15.123:0/2471657102 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77ec137250 con 0x7f77ec0ba6a0 2024-04-17T05:27:26.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.198+0000 7f77f1000640 1 -- 172.21.15.123:0/2471657102 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77ec137d10 con 0x7f77ec0ba6a0 2024-04-17T05:27:26.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.199+0000 7f77f1000640 1 -- 172.21.15.123:0/2471657102 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77ec138890 con 0x7f77ec0ba6a0 2024-04-17T05:27:26.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.200+0000 7f77e3400640 1 -- 172.21.15.123:0/2471657102 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f77d801a070 con 0x7f77ec0ba6a0 2024-04-17T05:27:26.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.201+0000 7f77e3400640 1 --2- 172.21.15.123:0/2471657102 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f77cc06c8f0 0x7f77cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:26.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.202+0000 7f77e3400640 1 -- 172.21.15.123:0/2471657102 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f77d808b1f0 con 0x7f77ec0ba6a0 2024-04-17T05:27:26.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.202+0000 7f77eb400640 1 --2- 172.21.15.123:0/2471657102 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f77cc06c8f0 0x7f77cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:26.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.203+0000 7f77eb400640 1 --2- 172.21.15.123:0/2471657102 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f77cc06c8f0 0x7f77cc06edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f77dc000f60 tx=0x7f77dc0079b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:26.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.206+0000 7f77e3400640 1 -- 172.21.15.123:0/2471657102 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f77d8059410 con 0x7f77ec0ba6a0 2024-04-17T05:27:26.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.387+0000 7f77f1000640 1 -- 172.21.15.123:0/2471657102 --> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f77ec137090 con 0x7f77cc06c8f0 2024-04-17T05:27:26.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.414+0000 7f77e3400640 1 -- 172.21.15.123:0/2471657102 <== mgr.4103 v2:172.21.15.164:6832/4204006015 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332537 (secure 0 0 0) 0x7f77dc005080 con 0x7f77cc06c8f0 2024-04-17T05:27:26.418 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:27:26.420 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-04-17T05:27:26.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.420+0000 7f77f1000640 1 -- 172.21.15.123:0/2471657102 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f77cc06c8f0 msgr2=0x7f77cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:26.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.420+0000 7f77f1000640 1 --2- 172.21.15.123:0/2471657102 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f77cc06c8f0 0x7f77cc06edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f77dc000f60 tx=0x7f77dc0079b0 comp rx=0 tx=0).stop 2024-04-17T05:27:26.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.420+0000 7f77f1000640 1 -- 172.21.15.123:0/2471657102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77ec0ba6a0 msgr2=0x7f77ec136b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:26.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.420+0000 7f77f1000640 1 --2- 172.21.15.123:0/2471657102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77ec0ba6a0 0x7f77ec136b50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f77d800c530 tx=0x7f77d800c9f0 comp rx=0 tx=0).stop 2024-04-17T05:27:26.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.420+0000 7f77f1000640 1 -- 172.21.15.123:0/2471657102 shutdown_connections 2024-04-17T05:27:26.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.420+0000 7f77f1000640 1 --2- 172.21.15.123:0/2471657102 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77ec142110 0x7f77ec138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:26.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.420+0000 7f77f1000640 1 --2- 172.21.15.123:0/2471657102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77ec0ba6a0 0x7f77ec136b50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:26.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.420+0000 7f77f1000640 1 --2- 172.21.15.123:0/2471657102 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f77cc06c8f0 0x7f77cc06edb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:26.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.420+0000 7f77f1000640 1 --2- 172.21.15.123:0/2471657102 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f77ec0b9a80 0x7f77ec1dd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:26.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.420+0000 7f77f1000640 1 -- 172.21.15.123:0/2471657102 >> 172.21.15.123:0/2471657102 conn(0x7f77ec06bda0 msgr2=0x7f77ec0bc210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:26.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.420+0000 7f77f1000640 1 -- 172.21.15.123:0/2471657102 shutdown_connections 2024-04-17T05:27:26.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.420+0000 7f77f1000640 1 -- 172.21.15.123:0/2471657102 wait complete. 2024-04-17T05:27:26.437 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-04-17T05:27:26.310479+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219524,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755196,"statfs":{"total":773094113280,"available":772869320704,"internally_reserved":0,"allocated":3448832,"data_stored":2055264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005535"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314325+0000","last_change":"2024-04-17T05:26:52.205802+0000","last_active":"2024-04-17T05:26:59.314325+0000","last_peered":"2024-04-17T05:26:59.314325+0000","last_clean":"2024-04-17T05:26:59.314325+0000","last_became_active":"2024-04-17T05:26:52.205459+0000","last_became_peered":"2024-04-17T05:26:52.205459+0000","last_unstale":"2024-04-17T05:26:59.314325+0000","last_undegraded":"2024-04-17T05:26:59.314325+0000","last_fullsized":"2024-04-17T05:26:59.314325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:12:06.528342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274704+0000","last_change":"2024-04-17T05:26:53.231441+0000","last_active":"2024-04-17T05:26:58.274704+0000","last_peered":"2024-04-17T05:26:58.274704+0000","last_clean":"2024-04-17T05:26:58.274704+0000","last_became_active":"2024-04-17T05:26:53.231139+0000","last_became_peered":"2024-04-17T05:26:53.231139+0000","last_unstale":"2024-04-17T05:26:58.274704+0000","last_undegraded":"2024-04-17T05:26:58.274704+0000","last_fullsized":"2024-04-17T05:26:58.274704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:38:13.010763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273065+0000","last_change":"2024-04-17T05:26:57.347742+0000","last_active":"2024-04-17T05:26:58.273065+0000","last_peered":"2024-04-17T05:26:58.273065+0000","last_clean":"2024-04-17T05:26:58.273065+0000","last_became_active":"2024-04-17T05:26:57.347333+0000","last_became_peered":"2024-04-17T05:26:57.347333+0000","last_unstale":"2024-04-17T05:26:58.273065+0000","last_undegraded":"2024-04-17T05:26:58.273065+0000","last_fullsized":"2024-04-17T05:26:58.273065+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:23:44.724644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274845+0000","last_change":"2024-04-17T05:26:52.203448+0000","last_active":"2024-04-17T05:26:58.274845+0000","last_peered":"2024-04-17T05:26:58.274845+0000","last_clean":"2024-04-17T05:26:58.274845+0000","last_became_active":"2024-04-17T05:26:52.203161+0000","last_became_peered":"2024-04-17T05:26:52.203161+0000","last_unstale":"2024-04-17T05:26:58.274845+0000","last_undegraded":"2024-04-17T05:26:58.274845+0000","last_fullsized":"2024-04-17T05:26:58.274845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:11:26.292397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313463+0000","last_change":"2024-04-17T05:26:53.241735+0000","last_active":"2024-04-17T05:26:59.313463+0000","last_peered":"2024-04-17T05:26:59.313463+0000","last_clean":"2024-04-17T05:26:59.313463+0000","last_became_active":"2024-04-17T05:26:53.241460+0000","last_became_peered":"2024-04-17T05:26:53.241460+0000","last_unstale":"2024-04-17T05:26:59.313463+0000","last_undegraded":"2024-04-17T05:26:59.313463+0000","last_fullsized":"2024-04-17T05:26:59.313463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:32.131344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.275682+0000","last_change":"2024-04-17T05:26:57.310052+0000","last_active":"2024-04-17T05:26:58.275682+0000","last_peered":"2024-04-17T05:26:58.275682+0000","last_clean":"2024-04-17T05:26:58.275682+0000","last_became_active":"2024-04-17T05:26:57.309057+0000","last_became_peered":"2024-04-17T05:26:57.309057+0000","last_unstale":"2024-04-17T05:26:58.275682+0000","last_undegraded":"2024-04-17T05:26:58.275682+0000","last_fullsized":"2024-04-17T05:26:58.275682+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:32:29.420749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317337+0000","last_change":"2024-04-17T05:26:52.217413+0000","last_active":"2024-04-17T05:26:59.317337+0000","last_peered":"2024-04-17T05:26:59.317337+0000","last_clean":"2024-04-17T05:26:59.317337+0000","last_became_active":"2024-04-17T05:26:52.217101+0000","last_became_peered":"2024-04-17T05:26:52.217101+0000","last_unstale":"2024-04-17T05:26:59.317337+0000","last_undegraded":"2024-04-17T05:26:59.317337+0000","last_fullsized":"2024-04-17T05:26:59.317337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:39:51.930934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276312+0000","last_change":"2024-04-17T05:26:53.219012+0000","last_active":"2024-04-17T05:26:58.276312+0000","last_peered":"2024-04-17T05:26:58.276312+0000","last_clean":"2024-04-17T05:26:58.276312+0000","last_became_active":"2024-04-17T05:26:53.216591+0000","last_became_peered":"2024-04-17T05:26:53.216591+0000","last_unstale":"2024-04-17T05:26:58.276312+0000","last_undegraded":"2024-04-17T05:26:58.276312+0000","last_fullsized":"2024-04-17T05:26:58.276312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:02:12.833146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276701+0000","last_change":"2024-04-17T05:26:57.310537+0000","last_active":"2024-04-17T05:26:58.276701+0000","last_peered":"2024-04-17T05:26:58.276701+0000","last_clean":"2024-04-17T05:26:58.276701+0000","last_became_active":"2024-04-17T05:26:57.309381+0000","last_became_peered":"2024-04-17T05:26:57.309381+0000","last_unstale":"2024-04-17T05:26:58.276701+0000","last_undegraded":"2024-04-17T05:26:58.276701+0000","last_fullsized":"2024-04-17T05:26:58.276701+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:38:17.093545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317625+0000","last_change":"2024-04-17T05:26:52.218309+0000","last_active":"2024-04-17T05:26:59.317625+0000","last_peered":"2024-04-17T05:26:59.317625+0000","last_clean":"2024-04-17T05:26:59.317625+0000","last_became_active":"2024-04-17T05:26:52.217898+0000","last_became_peered":"2024-04-17T05:26:52.217898+0000","last_unstale":"2024-04-17T05:26:59.317625+0000","last_undegraded":"2024-04-17T05:26:59.317625+0000","last_fullsized":"2024-04-17T05:26:59.317625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:16:02.152039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276476+0000","last_change":"2024-04-17T05:26:53.232546+0000","last_active":"2024-04-17T05:26:58.276476+0000","last_peered":"2024-04-17T05:26:58.276476+0000","last_clean":"2024-04-17T05:26:58.276476+0000","last_became_active":"2024-04-17T05:26:53.232239+0000","last_became_peered":"2024-04-17T05:26:53.232239+0000","last_unstale":"2024-04-17T05:26:58.276476+0000","last_undegraded":"2024-04-17T05:26:58.276476+0000","last_fullsized":"2024-04-17T05:26:58.276476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:38:13.010763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276356+0000","last_change":"2024-04-17T05:26:57.297256+0000","last_active":"2024-04-17T05:26:58.276356+0000","last_peered":"2024-04-17T05:26:58.276356+0000","last_clean":"2024-04-17T05:26:58.276356+0000","last_became_active":"2024-04-17T05:26:57.296757+0000","last_became_peered":"2024-04-17T05:26:57.296757+0000","last_unstale":"2024-04-17T05:26:58.276356+0000","last_undegraded":"2024-04-17T05:26:58.276356+0000","last_fullsized":"2024-04-17T05:26:58.276356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:45:59.432940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315091+0000","last_change":"2024-04-17T05:26:53.244539+0000","last_active":"2024-04-17T05:26:59.315091+0000","last_peered":"2024-04-17T05:26:59.315091+0000","last_clean":"2024-04-17T05:26:59.315091+0000","last_became_active":"2024-04-17T05:26:53.244104+0000","last_became_peered":"2024-04-17T05:26:53.244104+0000","last_unstale":"2024-04-17T05:26:59.315091+0000","last_undegraded":"2024-04-17T05:26:59.315091+0000","last_fullsized":"2024-04-17T05:26:59.315091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:41:48.514881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317859+0000","last_change":"2024-04-17T05:26:52.214434+0000","last_active":"2024-04-17T05:26:59.317859+0000","last_peered":"2024-04-17T05:26:59.317859+0000","last_clean":"2024-04-17T05:26:59.317859+0000","last_became_active":"2024-04-17T05:26:52.214158+0000","last_became_peered":"2024-04-17T05:26:52.214158+0000","last_unstale":"2024-04-17T05:26:59.317859+0000","last_undegraded":"2024-04-17T05:26:59.317859+0000","last_fullsized":"2024-04-17T05:26:59.317859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:36:56.201576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.278955+0000","last_change":"2024-04-17T05:26:57.307151+0000","last_active":"2024-04-17T05:26:58.278955+0000","last_peered":"2024-04-17T05:26:58.278955+0000","last_clean":"2024-04-17T05:26:58.278955+0000","last_became_active":"2024-04-17T05:26:57.305676+0000","last_became_peered":"2024-04-17T05:26:57.305676+0000","last_unstale":"2024-04-17T05:26:58.278955+0000","last_undegraded":"2024-04-17T05:26:58.278955+0000","last_fullsized":"2024-04-17T05:26:58.278955+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:40:55.126943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273944+0000","last_change":"2024-04-17T05:26:53.230514+0000","last_active":"2024-04-17T05:26:58.273944+0000","last_peered":"2024-04-17T05:26:58.273944+0000","last_clean":"2024-04-17T05:26:58.273944+0000","last_became_active":"2024-04-17T05:26:53.230175+0000","last_became_peered":"2024-04-17T05:26:53.230175+0000","last_unstale":"2024-04-17T05:26:58.273944+0000","last_undegraded":"2024-04-17T05:26:58.273944+0000","last_fullsized":"2024-04-17T05:26:58.273944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:32.131344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315033+0000","last_change":"2024-04-17T05:26:52.207664+0000","last_active":"2024-04-17T05:26:59.315033+0000","last_peered":"2024-04-17T05:26:59.315033+0000","last_clean":"2024-04-17T05:26:59.315033+0000","last_became_active":"2024-04-17T05:26:52.207343+0000","last_became_peered":"2024-04-17T05:26:52.207343+0000","last_unstale":"2024-04-17T05:26:59.315033+0000","last_undegraded":"2024-04-17T05:26:59.315033+0000","last_fullsized":"2024-04-17T05:26:59.315033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:05:28.743450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.277704+0000","last_change":"2024-04-17T05:26:57.311205+0000","last_active":"2024-04-17T05:26:58.277704+0000","last_peered":"2024-04-17T05:26:58.277704+0000","last_clean":"2024-04-17T05:26:58.277704+0000","last_became_active":"2024-04-17T05:26:57.310038+0000","last_became_peered":"2024-04-17T05:26:57.310038+0000","last_unstale":"2024-04-17T05:26:58.277704+0000","last_undegraded":"2024-04-17T05:26:58.277704+0000","last_fullsized":"2024-04-17T05:26:58.277704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:02:16.915928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273375+0000","last_change":"2024-04-17T05:26:53.229416+0000","last_active":"2024-04-17T05:26:58.273375+0000","last_peered":"2024-04-17T05:26:58.273375+0000","last_clean":"2024-04-17T05:26:58.273375+0000","last_became_active":"2024-04-17T05:26:53.227324+0000","last_became_peered":"2024-04-17T05:26:53.227324+0000","last_unstale":"2024-04-17T05:26:58.273375+0000","last_undegraded":"2024-04-17T05:26:58.273375+0000","last_fullsized":"2024-04-17T05:26:58.273375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:08:41.870139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314210+0000","last_change":"2024-04-17T05:26:52.207557+0000","last_active":"2024-04-17T05:26:59.314210+0000","last_peered":"2024-04-17T05:26:59.314210+0000","last_clean":"2024-04-17T05:26:59.314210+0000","last_became_active":"2024-04-17T05:26:52.207019+0000","last_became_peered":"2024-04-17T05:26:52.207019+0000","last_unstale":"2024-04-17T05:26:59.314210+0000","last_undegraded":"2024-04-17T05:26:59.314210+0000","last_fullsized":"2024-04-17T05:26:59.314210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:43.039139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316495+0000","last_change":"2024-04-17T05:26:57.345734+0000","last_active":"2024-04-17T05:26:59.316495+0000","last_peered":"2024-04-17T05:26:59.316495+0000","last_clean":"2024-04-17T05:26:59.316495+0000","last_became_active":"2024-04-17T05:26:57.345300+0000","last_became_peered":"2024-04-17T05:26:57.345300+0000","last_unstale":"2024-04-17T05:26:59.316495+0000","last_undegraded":"2024-04-17T05:26:59.316495+0000","last_fullsized":"2024-04-17T05:26:59.316495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:45:07.123915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276660+0000","last_change":"2024-04-17T05:26:53.218687+0000","last_active":"2024-04-17T05:26:58.276660+0000","last_peered":"2024-04-17T05:26:58.276660+0000","last_clean":"2024-04-17T05:26:58.276660+0000","last_became_active":"2024-04-17T05:26:53.218355+0000","last_became_peered":"2024-04-17T05:26:53.218355+0000","last_unstale":"2024-04-17T05:26:58.276660+0000","last_undegraded":"2024-04-17T05:26:58.276660+0000","last_fullsized":"2024-04-17T05:26:58.276660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:05:29.762149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316846+0000","last_change":"2024-04-17T05:26:52.214868+0000","last_active":"2024-04-17T05:26:59.316846+0000","last_peered":"2024-04-17T05:26:59.316846+0000","last_clean":"2024-04-17T05:26:59.316846+0000","last_became_active":"2024-04-17T05:26:52.214633+0000","last_became_peered":"2024-04-17T05:26:52.214633+0000","last_unstale":"2024-04-17T05:26:59.316846+0000","last_undegraded":"2024-04-17T05:26:59.316846+0000","last_fullsized":"2024-04-17T05:26:59.316846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:10:33.072665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276550+0000","last_change":"2024-04-17T05:26:57.309644+0000","last_active":"2024-04-17T05:26:58.276550+0000","last_peered":"2024-04-17T05:26:58.276550+0000","last_clean":"2024-04-17T05:26:58.276550+0000","last_became_active":"2024-04-17T05:26:57.309175+0000","last_became_peered":"2024-04-17T05:26:57.309175+0000","last_unstale":"2024-04-17T05:26:58.276550+0000","last_undegraded":"2024-04-17T05:26:58.276550+0000","last_fullsized":"2024-04-17T05:26:58.276550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:31:30.903722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314210+0000","last_change":"2024-04-17T05:26:53.220368+0000","last_active":"2024-04-17T05:26:59.314210+0000","last_peered":"2024-04-17T05:26:59.314210+0000","last_clean":"2024-04-17T05:26:59.314210+0000","last_became_active":"2024-04-17T05:26:53.220068+0000","last_became_peered":"2024-04-17T05:26:53.220068+0000","last_unstale":"2024-04-17T05:26:59.314210+0000","last_undegraded":"2024-04-17T05:26:59.314210+0000","last_fullsized":"2024-04-17T05:26:59.314210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:04:57.213834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316683+0000","last_change":"2024-04-17T05:26:52.215954+0000","last_active":"2024-04-17T05:26:59.316683+0000","last_peered":"2024-04-17T05:26:59.316683+0000","last_clean":"2024-04-17T05:26:59.316683+0000","last_became_active":"2024-04-17T05:26:52.215637+0000","last_became_peered":"2024-04-17T05:26:52.215637+0000","last_unstale":"2024-04-17T05:26:59.316683+0000","last_undegraded":"2024-04-17T05:26:59.316683+0000","last_fullsized":"2024-04-17T05:26:59.316683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:05:12.780620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276029+0000","last_change":"2024-04-17T05:26:57.342654+0000","last_active":"2024-04-17T05:26:58.276029+0000","last_peered":"2024-04-17T05:26:58.276029+0000","last_clean":"2024-04-17T05:26:58.276029+0000","last_became_active":"2024-04-17T05:26:57.342205+0000","last_became_peered":"2024-04-17T05:26:57.342205+0000","last_unstale":"2024-04-17T05:26:58.276029+0000","last_undegraded":"2024-04-17T05:26:58.276029+0000","last_fullsized":"2024-04-17T05:26:58.276029+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:08:20.405780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.275085+0000","last_change":"2024-04-17T05:26:53.238192+0000","last_active":"2024-04-17T05:26:58.275085+0000","last_peered":"2024-04-17T05:26:58.275085+0000","last_clean":"2024-04-17T05:26:58.275085+0000","last_became_active":"2024-04-17T05:26:53.237901+0000","last_became_peered":"2024-04-17T05:26:53.237901+0000","last_unstale":"2024-04-17T05:26:58.275085+0000","last_undegraded":"2024-04-17T05:26:58.275085+0000","last_fullsized":"2024-04-17T05:26:58.275085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:31:26.820940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315702+0000","last_change":"2024-04-17T05:26:52.213337+0000","last_active":"2024-04-17T05:26:59.315702+0000","last_peered":"2024-04-17T05:26:59.315702+0000","last_clean":"2024-04-17T05:26:59.315702+0000","last_became_active":"2024-04-17T05:26:52.213091+0000","last_became_peered":"2024-04-17T05:26:52.213091+0000","last_unstale":"2024-04-17T05:26:59.315702+0000","last_undegraded":"2024-04-17T05:26:59.315702+0000","last_fullsized":"2024-04-17T05:26:59.315702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:26.013417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.272624+0000","last_change":"2024-04-17T05:26:57.342025+0000","last_active":"2024-04-17T05:26:58.272624+0000","last_peered":"2024-04-17T05:26:58.272624+0000","last_clean":"2024-04-17T05:26:58.272624+0000","last_became_active":"2024-04-17T05:26:57.341654+0000","last_became_peered":"2024-04-17T05:26:57.341654+0000","last_unstale":"2024-04-17T05:26:58.272624+0000","last_undegraded":"2024-04-17T05:26:58.272624+0000","last_fullsized":"2024-04-17T05:26:58.272624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:43:39.199679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315923+0000","last_change":"2024-04-17T05:26:53.220626+0000","last_active":"2024-04-17T05:26:59.315923+0000","last_peered":"2024-04-17T05:26:59.315923+0000","last_clean":"2024-04-17T05:26:59.315923+0000","last_became_active":"2024-04-17T05:26:53.220331+0000","last_became_peered":"2024-04-17T05:26:53.220331+0000","last_unstale":"2024-04-17T05:26:59.315923+0000","last_undegraded":"2024-04-17T05:26:59.315923+0000","last_fullsized":"2024-04-17T05:26:59.315923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:32:25.337967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317911+0000","last_change":"2024-04-17T05:26:52.216060+0000","last_active":"2024-04-17T05:26:59.317911+0000","last_peered":"2024-04-17T05:26:59.317911+0000","last_clean":"2024-04-17T05:26:59.317911+0000","last_became_active":"2024-04-17T05:26:52.215771+0000","last_became_peered":"2024-04-17T05:26:52.215771+0000","last_unstale":"2024-04-17T05:26:59.317911+0000","last_undegraded":"2024-04-17T05:26:59.317911+0000","last_fullsized":"2024-04-17T05:26:59.317911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:14:11.769826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313579+0000","last_change":"2024-04-17T05:26:57.343520+0000","last_active":"2024-04-17T05:26:59.313579+0000","last_peered":"2024-04-17T05:26:59.313579+0000","last_clean":"2024-04-17T05:26:59.313579+0000","last_became_active":"2024-04-17T05:26:57.343032+0000","last_became_peered":"2024-04-17T05:26:57.343032+0000","last_unstale":"2024-04-17T05:26:59.313579+0000","last_undegraded":"2024-04-17T05:26:59.313579+0000","last_fullsized":"2024-04-17T05:26:59.313579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:59:04.049982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276726+0000","last_change":"2024-04-17T05:26:53.238977+0000","last_active":"2024-04-17T05:26:58.276726+0000","last_peered":"2024-04-17T05:26:58.276726+0000","last_clean":"2024-04-17T05:26:58.276726+0000","last_became_active":"2024-04-17T05:26:53.238516+0000","last_became_peered":"2024-04-17T05:26:53.238516+0000","last_unstale":"2024-04-17T05:26:58.276726+0000","last_undegraded":"2024-04-17T05:26:58.276726+0000","last_fullsized":"2024-04-17T05:26:58.276726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:59:47.655532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315985+0000","last_change":"2024-04-17T05:26:52.204960+0000","last_active":"2024-04-17T05:26:59.315985+0000","last_peered":"2024-04-17T05:26:59.315985+0000","last_clean":"2024-04-17T05:26:59.315985+0000","last_became_active":"2024-04-17T05:26:52.204529+0000","last_became_peered":"2024-04-17T05:26:52.204529+0000","last_unstale":"2024-04-17T05:26:59.315985+0000","last_undegraded":"2024-04-17T05:26:59.315985+0000","last_fullsized":"2024-04-17T05:26:59.315985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:28.440614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314574+0000","last_change":"2024-04-17T05:26:57.300433+0000","last_active":"2024-04-17T05:26:59.314574+0000","last_peered":"2024-04-17T05:26:59.314574+0000","last_clean":"2024-04-17T05:26:59.314574+0000","last_became_active":"2024-04-17T05:26:57.299625+0000","last_became_peered":"2024-04-17T05:26:57.299625+0000","last_unstale":"2024-04-17T05:26:59.314574+0000","last_undegraded":"2024-04-17T05:26:59.314574+0000","last_fullsized":"2024-04-17T05:26:59.314574+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:59:51.738314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.278228+0000","last_change":"2024-04-17T05:26:53.221039+0000","last_active":"2024-04-17T05:26:58.278228+0000","last_peered":"2024-04-17T05:26:58.278228+0000","last_clean":"2024-04-17T05:26:58.278228+0000","last_became_active":"2024-04-17T05:26:53.220763+0000","last_became_peered":"2024-04-17T05:26:53.220763+0000","last_unstale":"2024-04-17T05:26:58.278228+0000","last_undegraded":"2024-04-17T05:26:58.278228+0000","last_fullsized":"2024-04-17T05:26:58.278228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:06:06.694765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.275564+0000","last_change":"2024-04-17T05:26:52.200059+0000","last_active":"2024-04-17T05:26:58.275564+0000","last_peered":"2024-04-17T05:26:58.275564+0000","last_clean":"2024-04-17T05:26:58.275564+0000","last_became_active":"2024-04-17T05:26:52.199528+0000","last_became_peered":"2024-04-17T05:26:52.199528+0000","last_unstale":"2024-04-17T05:26:58.275564+0000","last_undegraded":"2024-04-17T05:26:58.275564+0000","last_fullsized":"2024-04-17T05:26:58.275564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:39:42.873364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315890+0000","last_change":"2024-04-17T05:26:57.306296+0000","last_active":"2024-04-17T05:26:59.315890+0000","last_peered":"2024-04-17T05:26:59.315890+0000","last_clean":"2024-04-17T05:26:59.315890+0000","last_became_active":"2024-04-17T05:26:57.305013+0000","last_became_peered":"2024-04-17T05:26:57.305013+0000","last_unstale":"2024-04-17T05:26:59.315890+0000","last_undegraded":"2024-04-17T05:26:59.315890+0000","last_fullsized":"2024-04-17T05:26:59.315890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:43:13.615366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313694+0000","last_change":"2024-04-17T05:26:53.225946+0000","last_active":"2024-04-17T05:26:59.313694+0000","last_peered":"2024-04-17T05:26:59.313694+0000","last_clean":"2024-04-17T05:26:59.313694+0000","last_became_active":"2024-04-17T05:26:53.220930+0000","last_became_peered":"2024-04-17T05:26:53.220930+0000","last_unstale":"2024-04-17T05:26:59.313694+0000","last_undegraded":"2024-04-17T05:26:59.313694+0000","last_fullsized":"2024-04-17T05:26:59.313694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:08:41.870139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315801+0000","last_change":"2024-04-17T05:26:52.200139+0000","last_active":"2024-04-17T05:26:59.315801+0000","last_peered":"2024-04-17T05:26:59.315801+0000","last_clean":"2024-04-17T05:26:59.315801+0000","last_became_active":"2024-04-17T05:26:52.199804+0000","last_became_peered":"2024-04-17T05:26:52.199804+0000","last_unstale":"2024-04-17T05:26:59.315801+0000","last_undegraded":"2024-04-17T05:26:59.315801+0000","last_fullsized":"2024-04-17T05:26:59.315801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:05:28.743450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316978+0000","last_change":"2024-04-17T05:26:57.303365+0000","last_active":"2024-04-17T05:26:59.316978+0000","last_peered":"2024-04-17T05:26:59.316978+0000","last_clean":"2024-04-17T05:26:59.316978+0000","last_became_active":"2024-04-17T05:26:57.301101+0000","last_became_peered":"2024-04-17T05:26:57.301101+0000","last_unstale":"2024-04-17T05:26:59.316978+0000","last_undegraded":"2024-04-17T05:26:59.316978+0000","last_fullsized":"2024-04-17T05:26:59.316978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:43:39.199679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.312425+0000","last_change":"2024-04-17T05:26:53.238762+0000","last_active":"2024-04-17T05:26:59.312425+0000","last_peered":"2024-04-17T05:26:59.312425+0000","last_clean":"2024-04-17T05:26:59.312425+0000","last_became_active":"2024-04-17T05:26:53.238488+0000","last_became_peered":"2024-04-17T05:26:53.238488+0000","last_unstale":"2024-04-17T05:26:59.312425+0000","last_undegraded":"2024-04-17T05:26:59.312425+0000","last_fullsized":"2024-04-17T05:26:59.312425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:38.214751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315993+0000","last_change":"2024-04-17T05:26:52.213104+0000","last_active":"2024-04-17T05:26:59.315993+0000","last_peered":"2024-04-17T05:26:59.315993+0000","last_clean":"2024-04-17T05:26:59.315993+0000","last_became_active":"2024-04-17T05:26:52.212838+0000","last_became_peered":"2024-04-17T05:26:52.212838+0000","last_unstale":"2024-04-17T05:26:59.315993+0000","last_undegraded":"2024-04-17T05:26:59.315993+0000","last_fullsized":"2024-04-17T05:26:59.315993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:11:58.913400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313981+0000","last_change":"2024-04-17T05:26:57.342387+0000","last_active":"2024-04-17T05:26:59.313981+0000","last_peered":"2024-04-17T05:26:59.313981+0000","last_clean":"2024-04-17T05:26:59.313981+0000","last_became_active":"2024-04-17T05:26:57.342008+0000","last_became_peered":"2024-04-17T05:26:57.342008+0000","last_unstale":"2024-04-17T05:26:59.313981+0000","last_undegraded":"2024-04-17T05:26:59.313981+0000","last_fullsized":"2024-04-17T05:26:59.313981+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:43:39.199679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273541+0000","last_change":"2024-04-17T05:26:53.243046+0000","last_active":"2024-04-17T05:26:58.273541+0000","last_peered":"2024-04-17T05:26:58.273541+0000","last_clean":"2024-04-17T05:26:58.273541+0000","last_became_active":"2024-04-17T05:26:53.242778+0000","last_became_peered":"2024-04-17T05:26:53.242778+0000","last_unstale":"2024-04-17T05:26:58.273541+0000","last_undegraded":"2024-04-17T05:26:58.273541+0000","last_fullsized":"2024-04-17T05:26:58.273541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:32:25.337967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274750+0000","last_change":"2024-04-17T05:26:52.198125+0000","last_active":"2024-04-17T05:26:58.274750+0000","last_peered":"2024-04-17T05:26:58.274750+0000","last_clean":"2024-04-17T05:26:58.274750+0000","last_became_active":"2024-04-17T05:26:52.197762+0000","last_became_peered":"2024-04-17T05:26:52.197762+0000","last_unstale":"2024-04-17T05:26:58.274750+0000","last_undegraded":"2024-04-17T05:26:58.274750+0000","last_fullsized":"2024-04-17T05:26:58.274750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:28.440614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316306+0000","last_change":"2024-04-17T05:26:48.072527+0000","last_active":"2024-04-17T05:26:59.316306+0000","last_peered":"2024-04-17T05:26:59.316306+0000","last_clean":"2024-04-17T05:26:59.316306+0000","last_became_active":"2024-04-17T05:26:48.070585+0000","last_became_peered":"2024-04-17T05:26:48.070585+0000","last_unstale":"2024-04-17T05:26:59.316306+0000","last_undegraded":"2024-04-17T05:26:59.316306+0000","last_fullsized":"2024-04-17T05:26:59.316306+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:46.995002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:46.995002+0000","last_clean_scrub_stamp":"2024-04-17T05:26:46.995002+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:48:35.792125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316121+0000","last_change":"2024-04-17T05:26:57.346681+0000","last_active":"2024-04-17T05:26:59.316121+0000","last_peered":"2024-04-17T05:26:59.316121+0000","last_clean":"2024-04-17T05:26:59.316121+0000","last_became_active":"2024-04-17T05:26:57.345320+0000","last_became_peered":"2024-04-17T05:26:57.345320+0000","last_unstale":"2024-04-17T05:26:59.316121+0000","last_undegraded":"2024-04-17T05:26:59.316121+0000","last_fullsized":"2024-04-17T05:26:59.316121+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:14:02.473527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316740+0000","last_change":"2024-04-17T05:26:53.251585+0000","last_active":"2024-04-17T05:26:59.316740+0000","last_peered":"2024-04-17T05:26:59.316740+0000","last_clean":"2024-04-17T05:26:59.316740+0000","last_became_active":"2024-04-17T05:26:53.249490+0000","last_became_peered":"2024-04-17T05:26:53.249490+0000","last_unstale":"2024-04-17T05:26:59.316740+0000","last_undegraded":"2024-04-17T05:26:59.316740+0000","last_fullsized":"2024-04-17T05:26:59.316740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:32:48.533935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317029+0000","last_change":"2024-04-17T05:26:52.209276+0000","last_active":"2024-04-17T05:26:59.317029+0000","last_peered":"2024-04-17T05:26:59.317029+0000","last_clean":"2024-04-17T05:26:59.317029+0000","last_became_active":"2024-04-17T05:26:52.208422+0000","last_became_peered":"2024-04-17T05:26:52.208422+0000","last_unstale":"2024-04-17T05:26:59.317029+0000","last_undegraded":"2024-04-17T05:26:59.317029+0000","last_fullsized":"2024-04-17T05:26:59.317029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:39:42.873364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315187+0000","last_change":"2024-04-17T05:26:57.342209+0000","last_active":"2024-04-17T05:26:59.315187+0000","last_peered":"2024-04-17T05:26:59.315187+0000","last_clean":"2024-04-17T05:26:59.315187+0000","last_became_active":"2024-04-17T05:26:57.341658+0000","last_became_peered":"2024-04-17T05:26:57.341658+0000","last_unstale":"2024-04-17T05:26:59.315187+0000","last_undegraded":"2024-04-17T05:26:59.315187+0000","last_fullsized":"2024-04-17T05:26:59.315187+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:49.740852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276430+0000","last_change":"2024-04-17T05:26:53.239720+0000","last_active":"2024-04-17T05:26:58.276430+0000","last_peered":"2024-04-17T05:26:58.276430+0000","last_clean":"2024-04-17T05:26:58.276430+0000","last_became_active":"2024-04-17T05:26:53.238669+0000","last_became_peered":"2024-04-17T05:26:53.238669+0000","last_unstale":"2024-04-17T05:26:58.276430+0000","last_undegraded":"2024-04-17T05:26:58.276430+0000","last_fullsized":"2024-04-17T05:26:58.276430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:58:59.967200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316067+0000","last_change":"2024-04-17T05:26:52.202596+0000","last_active":"2024-04-17T05:26:59.316067+0000","last_peered":"2024-04-17T05:26:59.316067+0000","last_clean":"2024-04-17T05:26:59.316067+0000","last_became_active":"2024-04-17T05:26:52.202246+0000","last_became_peered":"2024-04-17T05:26:52.202246+0000","last_unstale":"2024-04-17T05:26:59.316067+0000","last_undegraded":"2024-04-17T05:26:59.316067+0000","last_fullsized":"2024-04-17T05:26:59.316067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:30.475514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313919+0000","last_change":"2024-04-17T05:26:57.303069+0000","last_active":"2024-04-17T05:26:59.313919+0000","last_peered":"2024-04-17T05:26:59.313919+0000","last_clean":"2024-04-17T05:26:59.313919+0000","last_became_active":"2024-04-17T05:26:57.302457+0000","last_became_peered":"2024-04-17T05:26:57.302457+0000","last_unstale":"2024-04-17T05:26:59.313919+0000","last_undegraded":"2024-04-17T05:26:59.313919+0000","last_fullsized":"2024-04-17T05:26:59.313919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:45:07.123915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.318354+0000","last_change":"2024-04-17T05:26:53.255140+0000","last_active":"2024-04-17T05:26:59.318354+0000","last_peered":"2024-04-17T05:26:59.318354+0000","last_clean":"2024-04-17T05:26:59.318354+0000","last_became_active":"2024-04-17T05:26:53.254371+0000","last_became_peered":"2024-04-17T05:26:53.254371+0000","last_unstale":"2024-04-17T05:26:59.318354+0000","last_undegraded":"2024-04-17T05:26:59.318354+0000","last_fullsized":"2024-04-17T05:26:59.318354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:33:12.651636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317435+0000","last_change":"2024-04-17T05:26:52.204598+0000","last_active":"2024-04-17T05:26:59.317435+0000","last_peered":"2024-04-17T05:26:59.317435+0000","last_clean":"2024-04-17T05:26:59.317435+0000","last_became_active":"2024-04-17T05:26:52.204139+0000","last_became_peered":"2024-04-17T05:26:52.204139+0000","last_unstale":"2024-04-17T05:26:59.317435+0000","last_undegraded":"2024-04-17T05:26:59.317435+0000","last_fullsized":"2024-04-17T05:26:59.317435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:11:26.292397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274608+0000","last_change":"2024-04-17T05:26:57.345152+0000","last_active":"2024-04-17T05:26:58.274608+0000","last_peered":"2024-04-17T05:26:58.274608+0000","last_clean":"2024-04-17T05:26:58.274608+0000","last_became_active":"2024-04-17T05:26:57.342006+0000","last_became_peered":"2024-04-17T05:26:57.342006+0000","last_unstale":"2024-04-17T05:26:58.274608+0000","last_undegraded":"2024-04-17T05:26:58.274608+0000","last_fullsized":"2024-04-17T05:26:58.274608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:56:05.345989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317476+0000","last_change":"2024-04-17T05:26:53.253746+0000","last_active":"2024-04-17T05:26:59.317476+0000","last_peered":"2024-04-17T05:26:59.317476+0000","last_clean":"2024-04-17T05:26:59.317476+0000","last_became_active":"2024-04-17T05:26:53.253395+0000","last_became_peered":"2024-04-17T05:26:53.253395+0000","last_unstale":"2024-04-17T05:26:59.317476+0000","last_undegraded":"2024-04-17T05:26:59.317476+0000","last_fullsized":"2024-04-17T05:26:59.317476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:46:38.091860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.277646+0000","last_change":"2024-04-17T05:26:52.199105+0000","last_active":"2024-04-17T05:26:58.277646+0000","last_peered":"2024-04-17T05:26:58.277646+0000","last_clean":"2024-04-17T05:26:58.277646+0000","last_became_active":"2024-04-17T05:26:52.198798+0000","last_became_peered":"2024-04-17T05:26:52.198798+0000","last_unstale":"2024-04-17T05:26:58.277646+0000","last_undegraded":"2024-04-17T05:26:58.277646+0000","last_fullsized":"2024-04-17T05:26:58.277646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:34:06.405382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274283+0000","last_change":"2024-04-17T05:26:57.306130+0000","last_active":"2024-04-17T05:26:58.274283+0000","last_peered":"2024-04-17T05:26:58.274283+0000","last_clean":"2024-04-17T05:26:58.274283+0000","last_became_active":"2024-04-17T05:26:57.305415+0000","last_became_peered":"2024-04-17T05:26:57.305415+0000","last_unstale":"2024-04-17T05:26:58.274283+0000","last_undegraded":"2024-04-17T05:26:58.274283+0000","last_fullsized":"2024-04-17T05:26:58.274283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:36.214126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317844+0000","last_change":"2024-04-17T05:26:53.253524+0000","last_active":"2024-04-17T05:26:59.317844+0000","last_peered":"2024-04-17T05:26:59.317844+0000","last_clean":"2024-04-17T05:26:59.317844+0000","last_became_active":"2024-04-17T05:26:53.251408+0000","last_became_peered":"2024-04-17T05:26:53.251408+0000","last_unstale":"2024-04-17T05:26:59.317844+0000","last_undegraded":"2024-04-17T05:26:59.317844+0000","last_fullsized":"2024-04-17T05:26:59.317844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:13:58.390745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315457+0000","last_change":"2024-04-17T05:26:52.197556+0000","last_active":"2024-04-17T05:26:59.315457+0000","last_peered":"2024-04-17T05:26:59.315457+0000","last_clean":"2024-04-17T05:26:59.315457+0000","last_became_active":"2024-04-17T05:26:52.197250+0000","last_became_peered":"2024-04-17T05:26:52.197250+0000","last_unstale":"2024-04-17T05:26:59.315457+0000","last_undegraded":"2024-04-17T05:26:59.315457+0000","last_fullsized":"2024-04-17T05:26:59.315457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:12:06.528342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313911+0000","last_change":"2024-04-17T05:26:57.296438+0000","last_active":"2024-04-17T05:26:59.313911+0000","last_peered":"2024-04-17T05:26:59.313911+0000","last_clean":"2024-04-17T05:26:59.313911+0000","last_became_active":"2024-04-17T05:26:57.296040+0000","last_became_peered":"2024-04-17T05:26:57.296040+0000","last_unstale":"2024-04-17T05:26:59.313911+0000","last_undegraded":"2024-04-17T05:26:59.313911+0000","last_fullsized":"2024-04-17T05:26:59.313911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:43:13.615366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315063+0000","last_change":"2024-04-17T05:26:53.231338+0000","last_active":"2024-04-17T05:26:59.315063+0000","last_peered":"2024-04-17T05:26:59.315063+0000","last_clean":"2024-04-17T05:26:59.315063+0000","last_became_active":"2024-04-17T05:26:53.230987+0000","last_became_peered":"2024-04-17T05:26:53.230987+0000","last_unstale":"2024-04-17T05:26:59.315063+0000","last_undegraded":"2024-04-17T05:26:59.315063+0000","last_fullsized":"2024-04-17T05:26:59.315063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:08:10.489719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315083+0000","last_change":"2024-04-17T05:26:52.207087+0000","last_active":"2024-04-17T05:26:59.315083+0000","last_peered":"2024-04-17T05:26:59.315083+0000","last_clean":"2024-04-17T05:26:59.315083+0000","last_became_active":"2024-04-17T05:26:52.206401+0000","last_became_peered":"2024-04-17T05:26:52.206401+0000","last_unstale":"2024-04-17T05:26:59.315083+0000","last_undegraded":"2024-04-17T05:26:59.315083+0000","last_fullsized":"2024-04-17T05:26:59.315083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:56:53.915549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.275125+0000","last_change":"2024-04-17T05:26:57.346955+0000","last_active":"2024-04-17T05:26:58.275125+0000","last_peered":"2024-04-17T05:26:58.275125+0000","last_clean":"2024-04-17T05:26:58.275125+0000","last_became_active":"2024-04-17T05:26:57.346516+0000","last_became_peered":"2024-04-17T05:26:57.346516+0000","last_unstale":"2024-04-17T05:26:58.275125+0000","last_undegraded":"2024-04-17T05:26:58.275125+0000","last_fullsized":"2024-04-17T05:26:58.275125+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:00:55.830345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317606+0000","last_change":"2024-04-17T05:26:53.254195+0000","last_active":"2024-04-17T05:26:59.317606+0000","last_peered":"2024-04-17T05:26:59.317606+0000","last_clean":"2024-04-17T05:26:59.317606+0000","last_became_active":"2024-04-17T05:26:53.253813+0000","last_became_peered":"2024-04-17T05:26:53.253813+0000","last_unstale":"2024-04-17T05:26:59.317606+0000","last_undegraded":"2024-04-17T05:26:59.317606+0000","last_fullsized":"2024-04-17T05:26:59.317606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:18:31.208224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.275423+0000","last_change":"2024-04-17T05:26:52.211664+0000","last_active":"2024-04-17T05:26:58.275423+0000","last_peered":"2024-04-17T05:26:58.275423+0000","last_clean":"2024-04-17T05:26:58.275423+0000","last_became_active":"2024-04-17T05:26:52.210106+0000","last_became_peered":"2024-04-17T05:26:52.210106+0000","last_unstale":"2024-04-17T05:26:58.275423+0000","last_undegraded":"2024-04-17T05:26:58.275423+0000","last_fullsized":"2024-04-17T05:26:58.275423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:11:26.292397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274110+0000","last_change":"2024-04-17T05:26:57.344473+0000","last_active":"2024-04-17T05:26:58.274110+0000","last_peered":"2024-04-17T05:26:58.274110+0000","last_clean":"2024-04-17T05:26:58.274110+0000","last_became_active":"2024-04-17T05:26:57.341999+0000","last_became_peered":"2024-04-17T05:26:57.341999+0000","last_unstale":"2024-04-17T05:26:58.274110+0000","last_undegraded":"2024-04-17T05:26:58.274110+0000","last_fullsized":"2024-04-17T05:26:58.274110+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:35:19.879335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313364+0000","last_change":"2024-04-17T05:26:53.235732+0000","last_active":"2024-04-17T05:26:59.313364+0000","last_peered":"2024-04-17T05:26:59.313364+0000","last_clean":"2024-04-17T05:26:59.313364+0000","last_became_active":"2024-04-17T05:26:53.233202+0000","last_became_peered":"2024-04-17T05:26:53.233202+0000","last_unstale":"2024-04-17T05:26:59.313364+0000","last_undegraded":"2024-04-17T05:26:59.313364+0000","last_fullsized":"2024-04-17T05:26:59.313364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:58:23.088108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314205+0000","last_change":"2024-04-17T05:26:52.194788+0000","last_active":"2024-04-17T05:26:59.314205+0000","last_peered":"2024-04-17T05:26:59.314205+0000","last_clean":"2024-04-17T05:26:59.314205+0000","last_became_active":"2024-04-17T05:26:52.194504+0000","last_became_peered":"2024-04-17T05:26:52.194504+0000","last_unstale":"2024-04-17T05:26:59.314205+0000","last_undegraded":"2024-04-17T05:26:59.314205+0000","last_fullsized":"2024-04-17T05:26:59.314205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:29:09.631143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276321+0000","last_change":"2024-04-17T05:26:57.344052+0000","last_active":"2024-04-17T05:26:58.276321+0000","last_peered":"2024-04-17T05:26:58.276321+0000","last_clean":"2024-04-17T05:26:58.276321+0000","last_became_active":"2024-04-17T05:26:57.343479+0000","last_became_peered":"2024-04-17T05:26:57.343479+0000","last_unstale":"2024-04-17T05:26:58.276321+0000","last_undegraded":"2024-04-17T05:26:58.276321+0000","last_fullsized":"2024-04-17T05:26:58.276321+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:23:44.724644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316499+0000","last_change":"2024-04-17T05:26:53.250744+0000","last_active":"2024-04-17T05:26:59.316499+0000","last_peered":"2024-04-17T05:26:59.316499+0000","last_clean":"2024-04-17T05:26:59.316499+0000","last_became_active":"2024-04-17T05:26:53.249125+0000","last_became_peered":"2024-04-17T05:26:53.249125+0000","last_unstale":"2024-04-17T05:26:59.316499+0000","last_undegraded":"2024-04-17T05:26:59.316499+0000","last_fullsized":"2024-04-17T05:26:59.316499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:29.313074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:27:10.814542+0000","last_change":"2024-04-17T05:26:52.208074+0000","last_active":"2024-04-17T05:27:10.814542+0000","last_peered":"2024-04-17T05:27:10.814542+0000","last_clean":"2024-04-17T05:27:10.814542+0000","last_became_active":"2024-04-17T05:26:52.207696+0000","last_became_peered":"2024-04-17T05:26:52.207696+0000","last_unstale":"2024-04-17T05:27:10.814542+0000","last_undegraded":"2024-04-17T05:27:10.814542+0000","last_fullsized":"2024-04-17T05:27:10.814542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:10:33.072665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314836+0000","last_change":"2024-04-17T05:26:57.303649+0000","last_active":"2024-04-17T05:26:59.314836+0000","last_peered":"2024-04-17T05:26:59.314836+0000","last_clean":"2024-04-17T05:26:59.314836+0000","last_became_active":"2024-04-17T05:26:57.303124+0000","last_became_peered":"2024-04-17T05:26:57.303124+0000","last_unstale":"2024-04-17T05:26:59.314836+0000","last_undegraded":"2024-04-17T05:26:59.314836+0000","last_fullsized":"2024-04-17T05:26:59.314836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:59:04.049982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.277954+0000","last_change":"2024-04-17T05:26:53.232911+0000","last_active":"2024-04-17T05:26:58.277954+0000","last_peered":"2024-04-17T05:26:58.277954+0000","last_clean":"2024-04-17T05:26:58.277954+0000","last_became_active":"2024-04-17T05:26:53.232624+0000","last_became_peered":"2024-04-17T05:26:53.232624+0000","last_unstale":"2024-04-17T05:26:58.277954+0000","last_undegraded":"2024-04-17T05:26:58.277954+0000","last_fullsized":"2024-04-17T05:26:58.277954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:31.494213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315869+0000","last_change":"2024-04-17T05:26:52.207484+0000","last_active":"2024-04-17T05:26:59.315869+0000","last_peered":"2024-04-17T05:26:59.315869+0000","last_clean":"2024-04-17T05:26:59.315869+0000","last_became_active":"2024-04-17T05:26:52.207181+0000","last_became_peered":"2024-04-17T05:26:52.207181+0000","last_unstale":"2024-04-17T05:26:59.315869+0000","last_undegraded":"2024-04-17T05:26:59.315869+0000","last_fullsized":"2024-04-17T05:26:59.315869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:06:05.676066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.277617+0000","last_change":"2024-04-17T05:26:57.310269+0000","last_active":"2024-04-17T05:26:58.277617+0000","last_peered":"2024-04-17T05:26:58.277617+0000","last_clean":"2024-04-17T05:26:58.277617+0000","last_became_active":"2024-04-17T05:26:57.308888+0000","last_became_peered":"2024-04-17T05:26:57.308888+0000","last_unstale":"2024-04-17T05:26:58.277617+0000","last_undegraded":"2024-04-17T05:26:58.277617+0000","last_fullsized":"2024-04-17T05:26:58.277617+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:52:36.475652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314048+0000","last_change":"2024-04-17T05:26:53.241678+0000","last_active":"2024-04-17T05:26:59.314048+0000","last_peered":"2024-04-17T05:26:59.314048+0000","last_clean":"2024-04-17T05:26:59.314048+0000","last_became_active":"2024-04-17T05:26:53.241388+0000","last_became_peered":"2024-04-17T05:26:53.241388+0000","last_unstale":"2024-04-17T05:26:59.314048+0000","last_undegraded":"2024-04-17T05:26:59.314048+0000","last_fullsized":"2024-04-17T05:26:59.314048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:32:25.337967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.277856+0000","last_change":"2024-04-17T05:26:52.213786+0000","last_active":"2024-04-17T05:26:58.277856+0000","last_peered":"2024-04-17T05:26:58.277856+0000","last_clean":"2024-04-17T05:26:58.277856+0000","last_became_active":"2024-04-17T05:26:52.212440+0000","last_became_peered":"2024-04-17T05:26:52.212440+0000","last_unstale":"2024-04-17T05:26:58.277856+0000","last_undegraded":"2024-04-17T05:26:58.277856+0000","last_fullsized":"2024-04-17T05:26:58.277856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:06:05.676066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273308+0000","last_change":"2024-04-17T05:26:57.300596+0000","last_active":"2024-04-17T05:26:58.273308+0000","last_peered":"2024-04-17T05:26:58.273308+0000","last_clean":"2024-04-17T05:26:58.273308+0000","last_became_active":"2024-04-17T05:26:57.300156+0000","last_became_peered":"2024-04-17T05:26:57.300156+0000","last_unstale":"2024-04-17T05:26:58.273308+0000","last_undegraded":"2024-04-17T05:26:58.273308+0000","last_fullsized":"2024-04-17T05:26:58.273308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:11:16.497552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.277619+0000","last_change":"2024-04-17T05:26:53.238893+0000","last_active":"2024-04-17T05:26:58.277619+0000","last_peered":"2024-04-17T05:26:58.277619+0000","last_clean":"2024-04-17T05:26:58.277619+0000","last_became_active":"2024-04-17T05:26:53.238566+0000","last_became_peered":"2024-04-17T05:26:53.238566+0000","last_unstale":"2024-04-17T05:26:58.277619+0000","last_undegraded":"2024-04-17T05:26:58.277619+0000","last_fullsized":"2024-04-17T05:26:58.277619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:52:32.392870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316389+0000","last_change":"2024-04-17T05:26:52.215304+0000","last_active":"2024-04-17T05:26:59.316389+0000","last_peered":"2024-04-17T05:26:59.316389+0000","last_clean":"2024-04-17T05:26:59.316389+0000","last_became_active":"2024-04-17T05:26:52.214958+0000","last_became_peered":"2024-04-17T05:26:52.214958+0000","last_unstale":"2024-04-17T05:26:59.316389+0000","last_undegraded":"2024-04-17T05:26:59.316389+0000","last_fullsized":"2024-04-17T05:26:59.316389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:13:25.702517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273063+0000","last_change":"2024-04-17T05:26:57.342083+0000","last_active":"2024-04-17T05:26:58.273063+0000","last_peered":"2024-04-17T05:26:58.273063+0000","last_clean":"2024-04-17T05:26:58.273063+0000","last_became_active":"2024-04-17T05:26:57.341304+0000","last_became_peered":"2024-04-17T05:26:57.341304+0000","last_unstale":"2024-04-17T05:26:58.273063+0000","last_undegraded":"2024-04-17T05:26:58.273063+0000","last_fullsized":"2024-04-17T05:26:58.273063+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:56:05.345989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313536+0000","last_change":"2024-04-17T05:26:57.342446+0000","last_active":"2024-04-17T05:26:59.313536+0000","last_peered":"2024-04-17T05:26:59.313536+0000","last_clean":"2024-04-17T05:26:59.313536+0000","last_became_active":"2024-04-17T05:26:57.342076+0000","last_became_peered":"2024-04-17T05:26:57.342076+0000","last_unstale":"2024-04-17T05:26:59.313536+0000","last_undegraded":"2024-04-17T05:26:59.313536+0000","last_fullsized":"2024-04-17T05:26:59.313536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:59:51.738314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314000+0000","last_change":"2024-04-17T05:26:53.228706+0000","last_active":"2024-04-17T05:26:59.314000+0000","last_peered":"2024-04-17T05:26:59.314000+0000","last_clean":"2024-04-17T05:26:59.314000+0000","last_became_active":"2024-04-17T05:26:53.228381+0000","last_became_peered":"2024-04-17T05:26:53.228381+0000","last_unstale":"2024-04-17T05:26:59.314000+0000","last_undegraded":"2024-04-17T05:26:59.314000+0000","last_fullsized":"2024-04-17T05:26:59.314000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:04:57.213834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274809+0000","last_change":"2024-04-17T05:26:52.195697+0000","last_active":"2024-04-17T05:26:58.274809+0000","last_peered":"2024-04-17T05:26:58.274809+0000","last_clean":"2024-04-17T05:26:58.274809+0000","last_became_active":"2024-04-17T05:26:52.193995+0000","last_became_peered":"2024-04-17T05:26:52.193995+0000","last_unstale":"2024-04-17T05:26:58.274809+0000","last_undegraded":"2024-04-17T05:26:58.274809+0000","last_fullsized":"2024-04-17T05:26:58.274809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:05:28.743450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316290+0000","last_change":"2024-04-17T05:26:57.306563+0000","last_active":"2024-04-17T05:26:59.316290+0000","last_peered":"2024-04-17T05:26:59.316290+0000","last_clean":"2024-04-17T05:26:59.316290+0000","last_became_active":"2024-04-17T05:26:57.305777+0000","last_became_peered":"2024-04-17T05:26:57.305777+0000","last_unstale":"2024-04-17T05:26:59.316290+0000","last_undegraded":"2024-04-17T05:26:59.316290+0000","last_fullsized":"2024-04-17T05:26:59.316290+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:33.395856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273167+0000","last_change":"2024-04-17T05:26:53.229100+0000","last_active":"2024-04-17T05:26:58.273167+0000","last_peered":"2024-04-17T05:26:58.273167+0000","last_clean":"2024-04-17T05:26:58.273167+0000","last_became_active":"2024-04-17T05:26:53.225554+0000","last_became_peered":"2024-04-17T05:26:53.225554+0000","last_unstale":"2024-04-17T05:26:58.273167+0000","last_undegraded":"2024-04-17T05:26:58.273167+0000","last_fullsized":"2024-04-17T05:26:58.273167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:04:57.213834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273220+0000","last_change":"2024-04-17T05:26:52.205214+0000","last_active":"2024-04-17T05:26:58.273220+0000","last_peered":"2024-04-17T05:26:58.273220+0000","last_clean":"2024-04-17T05:26:58.273220+0000","last_became_active":"2024-04-17T05:26:52.204982+0000","last_became_peered":"2024-04-17T05:26:52.204982+0000","last_unstale":"2024-04-17T05:26:58.273220+0000","last_undegraded":"2024-04-17T05:26:58.273220+0000","last_fullsized":"2024-04-17T05:26:58.273220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:12:06.528342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315415+0000","last_change":"2024-04-17T05:26:52.211538+0000","last_active":"2024-04-17T05:26:59.315415+0000","last_peered":"2024-04-17T05:26:59.315415+0000","last_clean":"2024-04-17T05:26:59.315415+0000","last_became_active":"2024-04-17T05:26:52.211242+0000","last_became_peered":"2024-04-17T05:26:52.211242+0000","last_unstale":"2024-04-17T05:26:59.315415+0000","last_undegraded":"2024-04-17T05:26:59.315415+0000","last_fullsized":"2024-04-17T05:26:59.315415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:30:14.163882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314091+0000","last_change":"2024-04-17T05:26:53.239968+0000","last_active":"2024-04-17T05:26:59.314091+0000","last_peered":"2024-04-17T05:26:59.314091+0000","last_clean":"2024-04-17T05:26:59.314091+0000","last_became_active":"2024-04-17T05:26:53.239688+0000","last_became_peered":"2024-04-17T05:26:53.239688+0000","last_unstale":"2024-04-17T05:26:59.314091+0000","last_undegraded":"2024-04-17T05:26:59.314091+0000","last_fullsized":"2024-04-17T05:26:59.314091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:19:17.442103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317082+0000","last_change":"2024-04-17T05:26:57.297209+0000","last_active":"2024-04-17T05:26:59.317082+0000","last_peered":"2024-04-17T05:26:59.317082+0000","last_clean":"2024-04-17T05:26:59.317082+0000","last_became_active":"2024-04-17T05:26:57.295730+0000","last_became_peered":"2024-04-17T05:26:57.295730+0000","last_unstale":"2024-04-17T05:26:59.317082+0000","last_undegraded":"2024-04-17T05:26:59.317082+0000","last_fullsized":"2024-04-17T05:26:59.317082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:47:55.696215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274119+0000","last_change":"2024-04-17T05:26:52.214520+0000","last_active":"2024-04-17T05:26:58.274119+0000","last_peered":"2024-04-17T05:26:58.274119+0000","last_clean":"2024-04-17T05:26:58.274119+0000","last_became_active":"2024-04-17T05:26:52.214153+0000","last_became_peered":"2024-04-17T05:26:52.214153+0000","last_unstale":"2024-04-17T05:26:58.274119+0000","last_undegraded":"2024-04-17T05:26:58.274119+0000","last_fullsized":"2024-04-17T05:26:58.274119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:29:09.631143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.277103+0000","last_change":"2024-04-17T05:26:53.218086+0000","last_active":"2024-04-17T05:26:58.277103+0000","last_peered":"2024-04-17T05:26:58.277103+0000","last_clean":"2024-04-17T05:26:58.277103+0000","last_became_active":"2024-04-17T05:26:53.213566+0000","last_became_peered":"2024-04-17T05:26:53.213566+0000","last_unstale":"2024-04-17T05:26:58.277103+0000","last_undegraded":"2024-04-17T05:26:58.277103+0000","last_fullsized":"2024-04-17T05:26:58.277103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:29.459313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274661+0000","last_change":"2024-04-17T05:26:57.306742+0000","last_active":"2024-04-17T05:26:58.274661+0000","last_peered":"2024-04-17T05:26:58.274661+0000","last_clean":"2024-04-17T05:26:58.274661+0000","last_became_active":"2024-04-17T05:26:57.305115+0000","last_became_peered":"2024-04-17T05:26:57.305115+0000","last_unstale":"2024-04-17T05:26:58.274661+0000","last_undegraded":"2024-04-17T05:26:58.274661+0000","last_fullsized":"2024-04-17T05:26:58.274661+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:48:36.621042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315919+0000","last_change":"2024-04-17T05:26:53.232255+0000","last_active":"2024-04-17T05:26:59.315919+0000","last_peered":"2024-04-17T05:26:59.315919+0000","last_clean":"2024-04-17T05:26:59.315919+0000","last_became_active":"2024-04-17T05:26:53.231624+0000","last_became_peered":"2024-04-17T05:26:53.231624+0000","last_unstale":"2024-04-17T05:26:59.315919+0000","last_undegraded":"2024-04-17T05:26:59.315919+0000","last_fullsized":"2024-04-17T05:26:59.315919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:27:51.120892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316072+0000","last_change":"2024-04-17T05:26:53.222619+0000","last_active":"2024-04-17T05:26:59.316072+0000","last_peered":"2024-04-17T05:26:59.316072+0000","last_clean":"2024-04-17T05:26:59.316072+0000","last_became_active":"2024-04-17T05:26:53.222128+0000","last_became_peered":"2024-04-17T05:26:53.222128+0000","last_unstale":"2024-04-17T05:26:59.316072+0000","last_undegraded":"2024-04-17T05:26:59.316072+0000","last_fullsized":"2024-04-17T05:26:59.316072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:31.494213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.275315+0000","last_change":"2024-04-17T05:26:53.234820+0000","last_active":"2024-04-17T05:26:58.275315+0000","last_peered":"2024-04-17T05:26:58.275315+0000","last_clean":"2024-04-17T05:26:58.275315+0000","last_became_active":"2024-04-17T05:26:53.233708+0000","last_became_peered":"2024-04-17T05:26:53.233708+0000","last_unstale":"2024-04-17T05:26:58.275315+0000","last_undegraded":"2024-04-17T05:26:58.275315+0000","last_fullsized":"2024-04-17T05:26:58.275315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:08:16.322998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313987+0000","last_change":"2024-04-17T05:26:53.234961+0000","last_active":"2024-04-17T05:26:59.313987+0000","last_peered":"2024-04-17T05:26:59.313987+0000","last_clean":"2024-04-17T05:26:59.313987+0000","last_became_active":"2024-04-17T05:26:53.234387+0000","last_became_peered":"2024-04-17T05:26:53.234387+0000","last_unstale":"2024-04-17T05:26:59.313987+0000","last_undegraded":"2024-04-17T05:26:59.313987+0000","last_fullsized":"2024-04-17T05:26:59.313987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:07:47.404346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274284+0000","last_change":"2024-04-17T05:26:53.242359+0000","last_active":"2024-04-17T05:26:58.274284+0000","last_peered":"2024-04-17T05:26:58.274284+0000","last_clean":"2024-04-17T05:26:58.274284+0000","last_became_active":"2024-04-17T05:26:53.236476+0000","last_became_peered":"2024-04-17T05:26:53.236476+0000","last_unstale":"2024-04-17T05:26:58.274284+0000","last_undegraded":"2024-04-17T05:26:58.274284+0000","last_fullsized":"2024-04-17T05:26:58.274284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:08:16.322998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314721+0000","last_change":"2024-04-17T05:26:53.231647+0000","last_active":"2024-04-17T05:26:59.314721+0000","last_peered":"2024-04-17T05:26:59.314721+0000","last_clean":"2024-04-17T05:26:59.314721+0000","last_became_active":"2024-04-17T05:26:53.231335+0000","last_became_peered":"2024-04-17T05:26:53.231335+0000","last_unstale":"2024-04-17T05:26:59.314721+0000","last_undegraded":"2024-04-17T05:26:59.314721+0000","last_fullsized":"2024-04-17T05:26:59.314721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:19:17.442103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316585+0000","last_change":"2024-04-17T05:26:53.234892+0000","last_active":"2024-04-17T05:26:59.316585+0000","last_peered":"2024-04-17T05:26:59.316585+0000","last_clean":"2024-04-17T05:26:59.316585+0000","last_became_active":"2024-04-17T05:26:53.234582+0000","last_became_peered":"2024-04-17T05:26:53.234582+0000","last_unstale":"2024-04-17T05:26:59.316585+0000","last_undegraded":"2024-04-17T05:26:59.316585+0000","last_fullsized":"2024-04-17T05:26:59.316585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:48:56.352270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274951+0000","last_change":"2024-04-17T05:26:53.245242+0000","last_active":"2024-04-17T05:26:58.274951+0000","last_peered":"2024-04-17T05:26:58.274951+0000","last_clean":"2024-04-17T05:26:58.274951+0000","last_became_active":"2024-04-17T05:26:53.244910+0000","last_became_peered":"2024-04-17T05:26:53.244910+0000","last_unstale":"2024-04-17T05:26:58.274951+0000","last_undegraded":"2024-04-17T05:26:58.274951+0000","last_fullsized":"2024-04-17T05:26:58.274951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:45:55.350158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.275241+0000","last_change":"2024-04-17T05:26:53.240582+0000","last_active":"2024-04-17T05:26:58.275241+0000","last_peered":"2024-04-17T05:26:58.275241+0000","last_clean":"2024-04-17T05:26:58.275241+0000","last_became_active":"2024-04-17T05:26:53.240184+0000","last_became_peered":"2024-04-17T05:26:53.240184+0000","last_unstale":"2024-04-17T05:26:58.275241+0000","last_undegraded":"2024-04-17T05:26:58.275241+0000","last_fullsized":"2024-04-17T05:26:58.275241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:32:25.337967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273189+0000","last_change":"2024-04-17T05:26:53.236750+0000","last_active":"2024-04-17T05:26:58.273189+0000","last_peered":"2024-04-17T05:26:58.273189+0000","last_clean":"2024-04-17T05:26:58.273189+0000","last_became_active":"2024-04-17T05:26:53.236386+0000","last_became_peered":"2024-04-17T05:26:53.236386+0000","last_unstale":"2024-04-17T05:26:58.273189+0000","last_undegraded":"2024-04-17T05:26:58.273189+0000","last_fullsized":"2024-04-17T05:26:58.273189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:19:17.442103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.275168+0000","last_change":"2024-04-17T05:26:53.242520+0000","last_active":"2024-04-17T05:26:58.275168+0000","last_peered":"2024-04-17T05:26:58.275168+0000","last_clean":"2024-04-17T05:26:58.275168+0000","last_became_active":"2024-04-17T05:26:53.242213+0000","last_became_peered":"2024-04-17T05:26:53.242213+0000","last_unstale":"2024-04-17T05:26:58.275168+0000","last_undegraded":"2024-04-17T05:26:58.275168+0000","last_fullsized":"2024-04-17T05:26:58.275168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:32.131344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313663+0000","last_change":"2024-04-17T05:26:53.230464+0000","last_active":"2024-04-17T05:26:59.313663+0000","last_peered":"2024-04-17T05:26:59.313663+0000","last_clean":"2024-04-17T05:26:59.313663+0000","last_became_active":"2024-04-17T05:26:53.230146+0000","last_became_peered":"2024-04-17T05:26:53.230146+0000","last_unstale":"2024-04-17T05:26:59.313663+0000","last_undegraded":"2024-04-17T05:26:59.313663+0000","last_fullsized":"2024-04-17T05:26:59.313663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:20:19.035658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315881+0000","last_change":"2024-04-17T05:26:53.252592+0000","last_active":"2024-04-17T05:26:59.315881+0000","last_peered":"2024-04-17T05:26:59.315881+0000","last_clean":"2024-04-17T05:26:59.315881+0000","last_became_active":"2024-04-17T05:26:53.252280+0000","last_became_peered":"2024-04-17T05:26:53.252280+0000","last_unstale":"2024-04-17T05:26:59.315881+0000","last_undegraded":"2024-04-17T05:26:59.315881+0000","last_fullsized":"2024-04-17T05:26:59.315881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:47:18.182576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317653+0000","last_change":"2024-04-17T05:26:53.242405+0000","last_active":"2024-04-17T05:26:59.317653+0000","last_peered":"2024-04-17T05:26:59.317653+0000","last_clean":"2024-04-17T05:26:59.317653+0000","last_became_active":"2024-04-17T05:26:53.242046+0000","last_became_peered":"2024-04-17T05:26:53.242046+0000","last_unstale":"2024-04-17T05:26:59.317653+0000","last_undegraded":"2024-04-17T05:26:59.317653+0000","last_fullsized":"2024-04-17T05:26:59.317653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:25:09.244149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317256+0000","last_change":"2024-04-17T05:26:53.228029+0000","last_active":"2024-04-17T05:26:59.317256+0000","last_peered":"2024-04-17T05:26:59.317256+0000","last_clean":"2024-04-17T05:26:59.317256+0000","last_became_active":"2024-04-17T05:26:53.227572+0000","last_became_peered":"2024-04-17T05:26:53.227572+0000","last_unstale":"2024-04-17T05:26:59.317256+0000","last_undegraded":"2024-04-17T05:26:59.317256+0000","last_fullsized":"2024-04-17T05:26:59.317256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:27.032116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.280108+0000","last_change":"2024-04-17T05:26:53.226283+0000","last_active":"2024-04-17T05:26:58.280108+0000","last_peered":"2024-04-17T05:26:58.280108+0000","last_clean":"2024-04-17T05:26:58.280108+0000","last_became_active":"2024-04-17T05:26:53.225983+0000","last_became_peered":"2024-04-17T05:26:53.225983+0000","last_unstale":"2024-04-17T05:26:58.280108+0000","last_undegraded":"2024-04-17T05:26:58.280108+0000","last_fullsized":"2024-04-17T05:26:58.280108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:40:51.044161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274421+0000","last_change":"2024-04-17T05:26:53.230256+0000","last_active":"2024-04-17T05:26:58.274421+0000","last_peered":"2024-04-17T05:26:58.274421+0000","last_clean":"2024-04-17T05:26:58.274421+0000","last_became_active":"2024-04-17T05:26:53.229888+0000","last_became_peered":"2024-04-17T05:26:53.229888+0000","last_unstale":"2024-04-17T05:26:58.274421+0000","last_undegraded":"2024-04-17T05:26:58.274421+0000","last_fullsized":"2024-04-17T05:26:58.274421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:45:55.350158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314103+0000","last_change":"2024-04-17T05:26:53.211199+0000","last_active":"2024-04-17T05:26:59.314103+0000","last_peered":"2024-04-17T05:26:59.314103+0000","last_clean":"2024-04-17T05:26:59.314103+0000","last_became_active":"2024-04-17T05:26:53.208394+0000","last_became_peered":"2024-04-17T05:26:53.208394+0000","last_unstale":"2024-04-17T05:26:59.314103+0000","last_undegraded":"2024-04-17T05:26:59.314103+0000","last_fullsized":"2024-04-17T05:26:59.314103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:20:19.035658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313253+0000","last_change":"2024-04-17T05:26:53.224930+0000","last_active":"2024-04-17T05:26:59.313253+0000","last_peered":"2024-04-17T05:26:59.313253+0000","last_clean":"2024-04-17T05:26:59.313253+0000","last_became_active":"2024-04-17T05:26:53.224314+0000","last_became_peered":"2024-04-17T05:26:53.224314+0000","last_unstale":"2024-04-17T05:26:59.313253+0000","last_undegraded":"2024-04-17T05:26:59.313253+0000","last_fullsized":"2024-04-17T05:26:59.313253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:00:05.875990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273858+0000","last_change":"2024-04-17T05:26:53.234152+0000","last_active":"2024-04-17T05:26:58.273858+0000","last_peered":"2024-04-17T05:26:58.273858+0000","last_clean":"2024-04-17T05:26:58.273858+0000","last_became_active":"2024-04-17T05:26:53.233885+0000","last_became_peered":"2024-04-17T05:26:53.233885+0000","last_unstale":"2024-04-17T05:26:58.273858+0000","last_undegraded":"2024-04-17T05:26:58.273858+0000","last_fullsized":"2024-04-17T05:26:58.273858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:20:19.035658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.277926+0000","last_change":"2024-04-17T05:26:53.233213+0000","last_active":"2024-04-17T05:26:58.277926+0000","last_peered":"2024-04-17T05:26:58.277926+0000","last_clean":"2024-04-17T05:26:58.277926+0000","last_became_active":"2024-04-17T05:26:53.232809+0000","last_became_peered":"2024-04-17T05:26:53.232809+0000","last_unstale":"2024-04-17T05:26:58.277926+0000","last_undegraded":"2024-04-17T05:26:58.277926+0000","last_fullsized":"2024-04-17T05:26:58.277926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:44.057838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316496+0000","last_change":"2024-04-17T05:26:53.245453+0000","last_active":"2024-04-17T05:26:59.316496+0000","last_peered":"2024-04-17T05:26:59.316496+0000","last_clean":"2024-04-17T05:26:59.316496+0000","last_became_active":"2024-04-17T05:26:53.245051+0000","last_became_peered":"2024-04-17T05:26:53.245051+0000","last_unstale":"2024-04-17T05:26:59.316496+0000","last_undegraded":"2024-04-17T05:26:59.316496+0000","last_fullsized":"2024-04-17T05:26:59.316496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:44:40.424363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316508+0000","last_change":"2024-04-17T05:26:53.241934+0000","last_active":"2024-04-17T05:26:59.316508+0000","last_peered":"2024-04-17T05:26:59.316508+0000","last_clean":"2024-04-17T05:26:59.316508+0000","last_became_active":"2024-04-17T05:26:53.241108+0000","last_became_peered":"2024-04-17T05:26:53.241108+0000","last_unstale":"2024-04-17T05:26:59.316508+0000","last_undegraded":"2024-04-17T05:26:59.316508+0000","last_fullsized":"2024-04-17T05:26:59.316508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:53:43.076144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.318239+0000","last_change":"2024-04-17T05:26:53.248438+0000","last_active":"2024-04-17T05:26:59.318239+0000","last_peered":"2024-04-17T05:26:59.318239+0000","last_clean":"2024-04-17T05:26:59.318239+0000","last_became_active":"2024-04-17T05:26:53.247746+0000","last_became_peered":"2024-04-17T05:26:53.247746+0000","last_unstale":"2024-04-17T05:26:59.318239+0000","last_undegraded":"2024-04-17T05:26:59.318239+0000","last_fullsized":"2024-04-17T05:26:59.318239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:28:32.265291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.272812+0000","last_change":"2024-04-17T05:26:53.244109+0000","last_active":"2024-04-17T05:26:58.272812+0000","last_peered":"2024-04-17T05:26:58.272812+0000","last_clean":"2024-04-17T05:26:58.272812+0000","last_became_active":"2024-04-17T05:26:53.243625+0000","last_became_peered":"2024-04-17T05:26:53.243625+0000","last_unstale":"2024-04-17T05:26:58.272812+0000","last_undegraded":"2024-04-17T05:26:58.272812+0000","last_fullsized":"2024-04-17T05:26:58.272812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:07:47.404346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317613+0000","last_change":"2024-04-17T05:26:53.246489+0000","last_active":"2024-04-17T05:26:59.317613+0000","last_peered":"2024-04-17T05:26:59.317613+0000","last_clean":"2024-04-17T05:26:59.317613+0000","last_became_active":"2024-04-17T05:26:53.246286+0000","last_became_peered":"2024-04-17T05:26:53.246286+0000","last_unstale":"2024-04-17T05:26:59.317613+0000","last_undegraded":"2024-04-17T05:26:59.317613+0000","last_fullsized":"2024-04-17T05:26:59.317613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:45.658070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274944+0000","last_change":"2024-04-17T05:26:53.229115+0000","last_active":"2024-04-17T05:26:58.274944+0000","last_peered":"2024-04-17T05:26:58.274944+0000","last_clean":"2024-04-17T05:26:58.274944+0000","last_became_active":"2024-04-17T05:26:53.228706+0000","last_became_peered":"2024-04-17T05:26:53.228706+0000","last_unstale":"2024-04-17T05:26:58.274944+0000","last_undegraded":"2024-04-17T05:26:58.274944+0000","last_fullsized":"2024-04-17T05:26:58.274944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:19:17.442103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317096+0000","last_change":"2024-04-17T05:26:53.244961+0000","last_active":"2024-04-17T05:26:59.317096+0000","last_peered":"2024-04-17T05:26:59.317096+0000","last_clean":"2024-04-17T05:26:59.317096+0000","last_became_active":"2024-04-17T05:26:53.244595+0000","last_became_peered":"2024-04-17T05:26:53.244595+0000","last_unstale":"2024-04-17T05:26:59.317096+0000","last_undegraded":"2024-04-17T05:26:59.317096+0000","last_fullsized":"2024-04-17T05:26:59.317096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:13:34.455173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276173+0000","last_change":"2024-04-17T05:26:53.241645+0000","last_active":"2024-04-17T05:26:58.276173+0000","last_peered":"2024-04-17T05:26:58.276173+0000","last_clean":"2024-04-17T05:26:58.276173+0000","last_became_active":"2024-04-17T05:26:53.241292+0000","last_became_peered":"2024-04-17T05:26:53.241292+0000","last_unstale":"2024-04-17T05:26:58.276173+0000","last_undegraded":"2024-04-17T05:26:58.276173+0000","last_fullsized":"2024-04-17T05:26:58.276173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:31:26.820940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315030+0000","last_change":"2024-04-17T05:26:53.221256+0000","last_active":"2024-04-17T05:26:59.315030+0000","last_peered":"2024-04-17T05:26:59.315030+0000","last_clean":"2024-04-17T05:26:59.315030+0000","last_became_active":"2024-04-17T05:26:53.220445+0000","last_became_peered":"2024-04-17T05:26:53.220445+0000","last_unstale":"2024-04-17T05:26:59.315030+0000","last_undegraded":"2024-04-17T05:26:59.315030+0000","last_fullsized":"2024-04-17T05:26:59.315030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:08:41.870139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315578+0000","last_change":"2024-04-17T05:26:53.214897+0000","last_active":"2024-04-17T05:26:59.315578+0000","last_peered":"2024-04-17T05:26:59.315578+0000","last_clean":"2024-04-17T05:26:59.315578+0000","last_became_active":"2024-04-17T05:26:53.214591+0000","last_became_peered":"2024-04-17T05:26:53.214591+0000","last_unstale":"2024-04-17T05:26:59.315578+0000","last_undegraded":"2024-04-17T05:26:59.315578+0000","last_fullsized":"2024-04-17T05:26:59.315578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:32.131344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315663+0000","last_change":"2024-04-17T05:26:53.248726+0000","last_active":"2024-04-17T05:26:59.315663+0000","last_peered":"2024-04-17T05:26:59.315663+0000","last_clean":"2024-04-17T05:26:59.315663+0000","last_became_active":"2024-04-17T05:26:53.248143+0000","last_became_peered":"2024-04-17T05:26:53.248143+0000","last_unstale":"2024-04-17T05:26:59.315663+0000","last_undegraded":"2024-04-17T05:26:59.315663+0000","last_fullsized":"2024-04-17T05:26:59.315663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:02:51.306764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":699106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542155,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":111998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542156,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":108246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":108282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542157,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":111998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":108156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542156,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":108316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":880640,"data_stored":699162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T05:27:26.442 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T05:27:26.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.688+0000 7f22ef200640 1 Processor -- start 2024-04-17T05:27:26.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.688+0000 7f22ef200640 1 -- start start 2024-04-17T05:27:26.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.689+0000 7f22ef200640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f22f00b5860 0x7f22f00b2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:26.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.689+0000 7f22ef200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22f00b3b50 0x7f22f00b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:26.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.689+0000 7f22ef200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22f00ae1c0 con 0x7f22f00adde0 2024-04-17T05:27:26.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.689+0000 7f22ef200640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f22f0142320 con 0x7f22f00b5860 2024-04-17T05:27:26.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.689+0000 7f22ef200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f22f01480e0 con 0x7f22f00b3b50 2024-04-17T05:27:26.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.690+0000 7f22ede00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f22f00adde0 0x7f22f0148570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47818/0 (socket says 172.21.15.123:47818) 2024-04-17T05:27:26.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.690+0000 7f22ede00640 1 -- 172.21.15.123:0/1552656761 learned_addr learned my addr 172.21.15.123:0/1552656761 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:27:26.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.690+0000 7f22ed400640 1 --2- 172.21.15.123:0/1552656761 >> v2:172.21.15.164:3300/0 conn(0x7f22f00b5860 0x7f22f00b2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:26.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.690+0000 7f22ee800640 1 --2- 172.21.15.123:0/1552656761 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22f00b3b50 0x7f22f00b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:26.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.690+0000 7f22eca00640 1 -- 172.21.15.123:0/1552656761 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4028102597 0 0) 0x7f22f00ae1c0 con 0x7f22f00adde0 2024-04-17T05:27:26.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.690+0000 7f22eca00640 1 -- 172.21.15.123:0/1552656761 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22d4003520 con 0x7f22f00adde0 2024-04-17T05:27:26.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.691+0000 7f22eca00640 1 -- 172.21.15.123:0/1552656761 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 163633987 0 0) 0x7f22d4003520 con 0x7f22f00adde0 2024-04-17T05:27:26.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.691+0000 7f22eca00640 1 -- 172.21.15.123:0/1552656761 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22f00b3b50 msgr2=0x7f22f00b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:26.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.691+0000 7f22eca00640 1 --2- 172.21.15.123:0/1552656761 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22f00b3b50 0x7f22f00b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:26.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.691+0000 7f22eca00640 1 -- 172.21.15.123:0/1552656761 >> v2:172.21.15.164:3300/0 conn(0x7f22f00b5860 msgr2=0x7f22f00b2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:26.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.691+0000 7f22eca00640 1 --2- 172.21.15.123:0/1552656761 >> v2:172.21.15.164:3300/0 conn(0x7f22f00b5860 0x7f22f00b2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:26.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.691+0000 7f22eca00640 1 -- 172.21.15.123:0/1552656761 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f0147d70 con 0x7f22f00adde0 2024-04-17T05:27:26.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.691+0000 7f22eca00640 1 -- 172.21.15.123:0/1552656761 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1042962670 0 0) 0x7f22e0001670 con 0x7f22f00adde0 2024-04-17T05:27:26.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.691+0000 7f22eca00640 1 -- 172.21.15.123:0/1552656761 >> v1:172.21.15.123:6789/0 conn(0x7f22f00adde0 legacy=0x7f22f0148570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:26.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.691+0000 7f22eca00640 1 --2- 172.21.15.123:0/1552656761 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22d40039b0 0x7f22d4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:26.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.691+0000 7f22eca00640 1 --2- 172.21.15.123:0/1552656761 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22d4004800 0x7f22d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:26.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.691+0000 7f22eca00640 1 --2- 172.21.15.123:0/1552656761 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22f00b3b50 0x7f22d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:26.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.691+0000 7f22eca00640 1 -- 172.21.15.123:0/1552656761 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f22f0142320 con 0x7f22d40039b0 2024-04-17T05:27:26.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.691+0000 7f22eca00640 1 -- 172.21.15.123:0/1552656761 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f22f01480e0 con 0x7f22d4004800 2024-04-17T05:27:26.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.691+0000 7f22eca00640 1 -- 172.21.15.123:0/1552656761 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f22d400b9c0 con 0x7f22f00b3b50 2024-04-17T05:27:26.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.691+0000 7f22ede00640 1 --2- 172.21.15.123:0/1552656761 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22d40039b0 0x7f22d4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:26.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.692+0000 7f22ee800640 1 --2- 172.21.15.123:0/1552656761 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22f00b3b50 0x7f22d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:26.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.692+0000 7f22ed400640 1 --2- 172.21.15.123:0/1552656761 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22d4004800 0x7f22d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:26.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.692+0000 7f22ede00640 1 -- 172.21.15.123:0/1552656761 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22f00b3b50 msgr2=0x7f22d40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:26.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.692+0000 7f22ede00640 1 --2- 172.21.15.123:0/1552656761 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22f00b3b50 0x7f22d40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:26.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.692+0000 7f22ede00640 1 -- 172.21.15.123:0/1552656761 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22d4004800 msgr2=0x7f22d4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:26.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.692+0000 7f22ede00640 1 --2- 172.21.15.123:0/1552656761 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22d4004800 0x7f22d4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:26.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.692+0000 7f22ede00640 1 -- 172.21.15.123:0/1552656761 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d4003520 con 0x7f22d40039b0 2024-04-17T05:27:26.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.692+0000 7f22ed400640 1 --2- 172.21.15.123:0/1552656761 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22d4004800 0x7f22d4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:26.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.692+0000 7f22ee800640 1 --2- 172.21.15.123:0/1552656761 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22f00b3b50 0x7f22d40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:26.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.693+0000 7f22ede00640 1 --2- 172.21.15.123:0/1552656761 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22d40039b0 0x7f22d4003dd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f22e000c270 tx=0x7f22d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=685627953f2a6356 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:26.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.693+0000 7f22eca00640 1 -- 172.21.15.123:0/1552656761 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e0007d30 con 0x7f22d40039b0 2024-04-17T05:27:26.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.693+0000 7f22eca00640 1 -- 172.21.15.123:0/1552656761 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22e0030070 con 0x7f22d40039b0 2024-04-17T05:27:26.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.693+0000 7f22eca00640 1 -- 172.21.15.123:0/1552656761 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e002cd60 con 0x7f22d40039b0 2024-04-17T05:27:26.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.694+0000 7f22ef200640 1 -- 172.21.15.123:0/1552656761 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22d40039b0 msgr2=0x7f22d4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:26.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.694+0000 7f22ef200640 1 --2- 172.21.15.123:0/1552656761 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22d40039b0 0x7f22d4003dd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f22e000c270 tx=0x7f22d4005830 comp rx=0 tx=0).stop 2024-04-17T05:27:26.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.694+0000 7f22ee800640 1 -- 172.21.15.123:0/1552656761 reap_dead start 2024-04-17T05:27:26.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.694+0000 7f22ef200640 1 -- 172.21.15.123:0/1552656761 shutdown_connections 2024-04-17T05:27:26.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.694+0000 7f22ef200640 1 -- 172.21.15.123:0/1552656761 >> 172.21.15.123:0/1552656761 conn(0x7f22f00b9150 msgr2=0x7f22f00b9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:26.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.694+0000 7f22ef200640 1 -- 172.21.15.123:0/1552656761 shutdown_connections 2024-04-17T05:27:26.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.694+0000 7f22ef200640 1 -- 172.21.15.123:0/1552656761 wait complete. 2024-04-17T05:27:26.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.696+0000 7f22ef200640 1 Processor -- start 2024-04-17T05:27:26.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.696+0000 7f22ef200640 1 -- start start 2024-04-17T05:27:26.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.696+0000 7f22ef200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22d40039b0 0x7f22f01e0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:26.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.696+0000 7f22ef200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22f013dad0 0x7f22f01d6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:26.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.696+0000 7f22ef200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22f01d7450 0x7f22f013c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:26.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.696+0000 7f22ef200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f22f00ae690 con 0x7f22d40039b0 2024-04-17T05:27:26.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.696+0000 7f22ef200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f22f00ae510 con 0x7f22f01d7450 2024-04-17T05:27:26.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.696+0000 7f22ef200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f22f00af0c0 con 0x7f22f013dad0 2024-04-17T05:27:26.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.697+0000 7f22ede00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22d40039b0 0x7f22f01e0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:26.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.697+0000 7f22ede00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22d40039b0 0x7f22f01e0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42504/0 (socket says 172.21.15.123:42504) 2024-04-17T05:27:26.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.697+0000 7f22ede00640 1 -- 172.21.15.123:0/3527222691 learned_addr learned my addr 172.21.15.123:0/3527222691 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:26.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.697+0000 7f22ee800640 1 --2- 172.21.15.123:0/3527222691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22f01d7450 0x7f22f013c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:26.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.697+0000 7f22ede00640 1 -- 172.21.15.123:0/3527222691 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22f013dad0 msgr2=0x7f22f01d6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:26.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.697+0000 7f22ed400640 1 --2- 172.21.15.123:0/3527222691 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22f013dad0 0x7f22f01d6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:26.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.697+0000 7f22ede00640 1 --2- 172.21.15.123:0/3527222691 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22f013dad0 0x7f22f01d6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:26.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.697+0000 7f22ede00640 1 -- 172.21.15.123:0/3527222691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22f01d7450 msgr2=0x7f22f013c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:26.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.697+0000 7f22ede00640 1 --2- 172.21.15.123:0/3527222691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22f01d7450 0x7f22f013c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:26.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.697+0000 7f22ede00640 1 -- 172.21.15.123:0/3527222691 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f01e1370 con 0x7f22d40039b0 2024-04-17T05:27:26.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.697+0000 7f22ede00640 1 --2- 172.21.15.123:0/3527222691 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22d40039b0 0x7f22f01e0720 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f22e000c270 tx=0x7f22f0148050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:26.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.698+0000 7f22e6000640 1 -- 172.21.15.123:0/3527222691 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e0007d30 con 0x7f22d40039b0 2024-04-17T05:27:26.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.698+0000 7f22e6000640 1 -- 172.21.15.123:0/3527222691 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22e0004c10 con 0x7f22d40039b0 2024-04-17T05:27:26.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.698+0000 7f22ef200640 1 -- 172.21.15.123:0/3527222691 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22f01e0db0 con 0x7f22d40039b0 2024-04-17T05:27:26.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.698+0000 7f22e6000640 1 -- 172.21.15.123:0/3527222691 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e0001c70 con 0x7f22d40039b0 2024-04-17T05:27:26.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.698+0000 7f22ef200640 1 -- 172.21.15.123:0/3527222691 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22f00729d0 con 0x7f22d40039b0 2024-04-17T05:27:26.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.699+0000 7f22ef200640 1 -- 172.21.15.123:0/3527222691 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22f00735f0 con 0x7f22d40039b0 2024-04-17T05:27:26.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.700+0000 7f22e6000640 1 -- 172.21.15.123:0/3527222691 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f22e0007070 con 0x7f22d40039b0 2024-04-17T05:27:26.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.701+0000 7f22e6000640 1 --2- 172.21.15.123:0/3527222691 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f22d006c920 0x7f22d006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:26.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.701+0000 7f22e6000640 1 -- 172.21.15.123:0/3527222691 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f22e00ad450 con 0x7f22d40039b0 2024-04-17T05:27:26.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.701+0000 7f22ed400640 1 --2- 172.21.15.123:0/3527222691 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f22d006c920 0x7f22d006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:26.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.702+0000 7f22ed400640 1 --2- 172.21.15.123:0/3527222691 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f22d006c920 0x7f22d006ede0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f22f00b4560 tx=0x7f22dc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:26.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.705+0000 7f22e6000640 1 -- 172.21.15.123:0/3527222691 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f22f00735f0 con 0x7f22d40039b0 2024-04-17T05:27:26.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.889+0000 7f22ef200640 1 -- 172.21.15.123:0/3527222691 --> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f22f014bf50 con 0x7f22d006c920 2024-04-17T05:27:26.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.914+0000 7f22e6000640 1 -- 172.21.15.123:0/3527222691 <== mgr.4103 v2:172.21.15.164:6832/4204006015 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332537 (secure 0 0 0) 0x7f22f014bf50 con 0x7f22d006c920 2024-04-17T05:27:26.917 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:27:26.919 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-04-17T05:27:26.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.918+0000 7f22ef200640 1 -- 172.21.15.123:0/3527222691 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f22d006c920 msgr2=0x7f22d006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:26.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.918+0000 7f22ef200640 1 --2- 172.21.15.123:0/3527222691 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f22d006c920 0x7f22d006ede0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f22f00b4560 tx=0x7f22dc008040 comp rx=0 tx=0).stop 2024-04-17T05:27:26.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.918+0000 7f22ef200640 1 -- 172.21.15.123:0/3527222691 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22d40039b0 msgr2=0x7f22f01e0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:26.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.918+0000 7f22ef200640 1 --2- 172.21.15.123:0/3527222691 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22d40039b0 0x7f22f01e0720 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f22e000c270 tx=0x7f22f0148050 comp rx=0 tx=0).stop 2024-04-17T05:27:26.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.919+0000 7f22ef200640 1 -- 172.21.15.123:0/3527222691 shutdown_connections 2024-04-17T05:27:26.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.919+0000 7f22ef200640 1 --2- 172.21.15.123:0/3527222691 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f22f01d7450 0x7f22f013c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:26.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.919+0000 7f22ef200640 1 --2- 172.21.15.123:0/3527222691 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f22d006c920 0x7f22d006ede0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:26.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.919+0000 7f22ef200640 1 --2- 172.21.15.123:0/3527222691 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f22f013dad0 0x7f22f01d6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:26.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.919+0000 7f22ef200640 1 --2- 172.21.15.123:0/3527222691 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22d40039b0 0x7f22f01e0720 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:26.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.919+0000 7f22ef200640 1 -- 172.21.15.123:0/3527222691 >> 172.21.15.123:0/3527222691 conn(0x7f22f00b9150 msgr2=0x7f22f00b31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:26.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.919+0000 7f22ef200640 1 -- 172.21.15.123:0/3527222691 shutdown_connections 2024-04-17T05:27:26.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:26.919+0000 7f22ef200640 1 -- 172.21.15.123:0/3527222691 wait complete. 2024-04-17T05:27:26.936 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-04-17T05:27:26.310479+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219524,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755196,"statfs":{"total":773094113280,"available":772869320704,"internally_reserved":0,"allocated":3448832,"data_stored":2055264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005535"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314325+0000","last_change":"2024-04-17T05:26:52.205802+0000","last_active":"2024-04-17T05:26:59.314325+0000","last_peered":"2024-04-17T05:26:59.314325+0000","last_clean":"2024-04-17T05:26:59.314325+0000","last_became_active":"2024-04-17T05:26:52.205459+0000","last_became_peered":"2024-04-17T05:26:52.205459+0000","last_unstale":"2024-04-17T05:26:59.314325+0000","last_undegraded":"2024-04-17T05:26:59.314325+0000","last_fullsized":"2024-04-17T05:26:59.314325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:12:06.528342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274704+0000","last_change":"2024-04-17T05:26:53.231441+0000","last_active":"2024-04-17T05:26:58.274704+0000","last_peered":"2024-04-17T05:26:58.274704+0000","last_clean":"2024-04-17T05:26:58.274704+0000","last_became_active":"2024-04-17T05:26:53.231139+0000","last_became_peered":"2024-04-17T05:26:53.231139+0000","last_unstale":"2024-04-17T05:26:58.274704+0000","last_undegraded":"2024-04-17T05:26:58.274704+0000","last_fullsized":"2024-04-17T05:26:58.274704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:38:13.010763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273065+0000","last_change":"2024-04-17T05:26:57.347742+0000","last_active":"2024-04-17T05:26:58.273065+0000","last_peered":"2024-04-17T05:26:58.273065+0000","last_clean":"2024-04-17T05:26:58.273065+0000","last_became_active":"2024-04-17T05:26:57.347333+0000","last_became_peered":"2024-04-17T05:26:57.347333+0000","last_unstale":"2024-04-17T05:26:58.273065+0000","last_undegraded":"2024-04-17T05:26:58.273065+0000","last_fullsized":"2024-04-17T05:26:58.273065+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:23:44.724644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274845+0000","last_change":"2024-04-17T05:26:52.203448+0000","last_active":"2024-04-17T05:26:58.274845+0000","last_peered":"2024-04-17T05:26:58.274845+0000","last_clean":"2024-04-17T05:26:58.274845+0000","last_became_active":"2024-04-17T05:26:52.203161+0000","last_became_peered":"2024-04-17T05:26:52.203161+0000","last_unstale":"2024-04-17T05:26:58.274845+0000","last_undegraded":"2024-04-17T05:26:58.274845+0000","last_fullsized":"2024-04-17T05:26:58.274845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:11:26.292397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313463+0000","last_change":"2024-04-17T05:26:53.241735+0000","last_active":"2024-04-17T05:26:59.313463+0000","last_peered":"2024-04-17T05:26:59.313463+0000","last_clean":"2024-04-17T05:26:59.313463+0000","last_became_active":"2024-04-17T05:26:53.241460+0000","last_became_peered":"2024-04-17T05:26:53.241460+0000","last_unstale":"2024-04-17T05:26:59.313463+0000","last_undegraded":"2024-04-17T05:26:59.313463+0000","last_fullsized":"2024-04-17T05:26:59.313463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:32.131344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.275682+0000","last_change":"2024-04-17T05:26:57.310052+0000","last_active":"2024-04-17T05:26:58.275682+0000","last_peered":"2024-04-17T05:26:58.275682+0000","last_clean":"2024-04-17T05:26:58.275682+0000","last_became_active":"2024-04-17T05:26:57.309057+0000","last_became_peered":"2024-04-17T05:26:57.309057+0000","last_unstale":"2024-04-17T05:26:58.275682+0000","last_undegraded":"2024-04-17T05:26:58.275682+0000","last_fullsized":"2024-04-17T05:26:58.275682+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:32:29.420749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317337+0000","last_change":"2024-04-17T05:26:52.217413+0000","last_active":"2024-04-17T05:26:59.317337+0000","last_peered":"2024-04-17T05:26:59.317337+0000","last_clean":"2024-04-17T05:26:59.317337+0000","last_became_active":"2024-04-17T05:26:52.217101+0000","last_became_peered":"2024-04-17T05:26:52.217101+0000","last_unstale":"2024-04-17T05:26:59.317337+0000","last_undegraded":"2024-04-17T05:26:59.317337+0000","last_fullsized":"2024-04-17T05:26:59.317337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:39:51.930934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276312+0000","last_change":"2024-04-17T05:26:53.219012+0000","last_active":"2024-04-17T05:26:58.276312+0000","last_peered":"2024-04-17T05:26:58.276312+0000","last_clean":"2024-04-17T05:26:58.276312+0000","last_became_active":"2024-04-17T05:26:53.216591+0000","last_became_peered":"2024-04-17T05:26:53.216591+0000","last_unstale":"2024-04-17T05:26:58.276312+0000","last_undegraded":"2024-04-17T05:26:58.276312+0000","last_fullsized":"2024-04-17T05:26:58.276312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:02:12.833146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276701+0000","last_change":"2024-04-17T05:26:57.310537+0000","last_active":"2024-04-17T05:26:58.276701+0000","last_peered":"2024-04-17T05:26:58.276701+0000","last_clean":"2024-04-17T05:26:58.276701+0000","last_became_active":"2024-04-17T05:26:57.309381+0000","last_became_peered":"2024-04-17T05:26:57.309381+0000","last_unstale":"2024-04-17T05:26:58.276701+0000","last_undegraded":"2024-04-17T05:26:58.276701+0000","last_fullsized":"2024-04-17T05:26:58.276701+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:38:17.093545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317625+0000","last_change":"2024-04-17T05:26:52.218309+0000","last_active":"2024-04-17T05:26:59.317625+0000","last_peered":"2024-04-17T05:26:59.317625+0000","last_clean":"2024-04-17T05:26:59.317625+0000","last_became_active":"2024-04-17T05:26:52.217898+0000","last_became_peered":"2024-04-17T05:26:52.217898+0000","last_unstale":"2024-04-17T05:26:59.317625+0000","last_undegraded":"2024-04-17T05:26:59.317625+0000","last_fullsized":"2024-04-17T05:26:59.317625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:16:02.152039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276476+0000","last_change":"2024-04-17T05:26:53.232546+0000","last_active":"2024-04-17T05:26:58.276476+0000","last_peered":"2024-04-17T05:26:58.276476+0000","last_clean":"2024-04-17T05:26:58.276476+0000","last_became_active":"2024-04-17T05:26:53.232239+0000","last_became_peered":"2024-04-17T05:26:53.232239+0000","last_unstale":"2024-04-17T05:26:58.276476+0000","last_undegraded":"2024-04-17T05:26:58.276476+0000","last_fullsized":"2024-04-17T05:26:58.276476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:38:13.010763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276356+0000","last_change":"2024-04-17T05:26:57.297256+0000","last_active":"2024-04-17T05:26:58.276356+0000","last_peered":"2024-04-17T05:26:58.276356+0000","last_clean":"2024-04-17T05:26:58.276356+0000","last_became_active":"2024-04-17T05:26:57.296757+0000","last_became_peered":"2024-04-17T05:26:57.296757+0000","last_unstale":"2024-04-17T05:26:58.276356+0000","last_undegraded":"2024-04-17T05:26:58.276356+0000","last_fullsized":"2024-04-17T05:26:58.276356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:45:59.432940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315091+0000","last_change":"2024-04-17T05:26:53.244539+0000","last_active":"2024-04-17T05:26:59.315091+0000","last_peered":"2024-04-17T05:26:59.315091+0000","last_clean":"2024-04-17T05:26:59.315091+0000","last_became_active":"2024-04-17T05:26:53.244104+0000","last_became_peered":"2024-04-17T05:26:53.244104+0000","last_unstale":"2024-04-17T05:26:59.315091+0000","last_undegraded":"2024-04-17T05:26:59.315091+0000","last_fullsized":"2024-04-17T05:26:59.315091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:41:48.514881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317859+0000","last_change":"2024-04-17T05:26:52.214434+0000","last_active":"2024-04-17T05:26:59.317859+0000","last_peered":"2024-04-17T05:26:59.317859+0000","last_clean":"2024-04-17T05:26:59.317859+0000","last_became_active":"2024-04-17T05:26:52.214158+0000","last_became_peered":"2024-04-17T05:26:52.214158+0000","last_unstale":"2024-04-17T05:26:59.317859+0000","last_undegraded":"2024-04-17T05:26:59.317859+0000","last_fullsized":"2024-04-17T05:26:59.317859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:36:56.201576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.278955+0000","last_change":"2024-04-17T05:26:57.307151+0000","last_active":"2024-04-17T05:26:58.278955+0000","last_peered":"2024-04-17T05:26:58.278955+0000","last_clean":"2024-04-17T05:26:58.278955+0000","last_became_active":"2024-04-17T05:26:57.305676+0000","last_became_peered":"2024-04-17T05:26:57.305676+0000","last_unstale":"2024-04-17T05:26:58.278955+0000","last_undegraded":"2024-04-17T05:26:58.278955+0000","last_fullsized":"2024-04-17T05:26:58.278955+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:40:55.126943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273944+0000","last_change":"2024-04-17T05:26:53.230514+0000","last_active":"2024-04-17T05:26:58.273944+0000","last_peered":"2024-04-17T05:26:58.273944+0000","last_clean":"2024-04-17T05:26:58.273944+0000","last_became_active":"2024-04-17T05:26:53.230175+0000","last_became_peered":"2024-04-17T05:26:53.230175+0000","last_unstale":"2024-04-17T05:26:58.273944+0000","last_undegraded":"2024-04-17T05:26:58.273944+0000","last_fullsized":"2024-04-17T05:26:58.273944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:32.131344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315033+0000","last_change":"2024-04-17T05:26:52.207664+0000","last_active":"2024-04-17T05:26:59.315033+0000","last_peered":"2024-04-17T05:26:59.315033+0000","last_clean":"2024-04-17T05:26:59.315033+0000","last_became_active":"2024-04-17T05:26:52.207343+0000","last_became_peered":"2024-04-17T05:26:52.207343+0000","last_unstale":"2024-04-17T05:26:59.315033+0000","last_undegraded":"2024-04-17T05:26:59.315033+0000","last_fullsized":"2024-04-17T05:26:59.315033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:05:28.743450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.277704+0000","last_change":"2024-04-17T05:26:57.311205+0000","last_active":"2024-04-17T05:26:58.277704+0000","last_peered":"2024-04-17T05:26:58.277704+0000","last_clean":"2024-04-17T05:26:58.277704+0000","last_became_active":"2024-04-17T05:26:57.310038+0000","last_became_peered":"2024-04-17T05:26:57.310038+0000","last_unstale":"2024-04-17T05:26:58.277704+0000","last_undegraded":"2024-04-17T05:26:58.277704+0000","last_fullsized":"2024-04-17T05:26:58.277704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:02:16.915928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273375+0000","last_change":"2024-04-17T05:26:53.229416+0000","last_active":"2024-04-17T05:26:58.273375+0000","last_peered":"2024-04-17T05:26:58.273375+0000","last_clean":"2024-04-17T05:26:58.273375+0000","last_became_active":"2024-04-17T05:26:53.227324+0000","last_became_peered":"2024-04-17T05:26:53.227324+0000","last_unstale":"2024-04-17T05:26:58.273375+0000","last_undegraded":"2024-04-17T05:26:58.273375+0000","last_fullsized":"2024-04-17T05:26:58.273375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:08:41.870139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314210+0000","last_change":"2024-04-17T05:26:52.207557+0000","last_active":"2024-04-17T05:26:59.314210+0000","last_peered":"2024-04-17T05:26:59.314210+0000","last_clean":"2024-04-17T05:26:59.314210+0000","last_became_active":"2024-04-17T05:26:52.207019+0000","last_became_peered":"2024-04-17T05:26:52.207019+0000","last_unstale":"2024-04-17T05:26:59.314210+0000","last_undegraded":"2024-04-17T05:26:59.314210+0000","last_fullsized":"2024-04-17T05:26:59.314210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:43.039139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316495+0000","last_change":"2024-04-17T05:26:57.345734+0000","last_active":"2024-04-17T05:26:59.316495+0000","last_peered":"2024-04-17T05:26:59.316495+0000","last_clean":"2024-04-17T05:26:59.316495+0000","last_became_active":"2024-04-17T05:26:57.345300+0000","last_became_peered":"2024-04-17T05:26:57.345300+0000","last_unstale":"2024-04-17T05:26:59.316495+0000","last_undegraded":"2024-04-17T05:26:59.316495+0000","last_fullsized":"2024-04-17T05:26:59.316495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:45:07.123915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276660+0000","last_change":"2024-04-17T05:26:53.218687+0000","last_active":"2024-04-17T05:26:58.276660+0000","last_peered":"2024-04-17T05:26:58.276660+0000","last_clean":"2024-04-17T05:26:58.276660+0000","last_became_active":"2024-04-17T05:26:53.218355+0000","last_became_peered":"2024-04-17T05:26:53.218355+0000","last_unstale":"2024-04-17T05:26:58.276660+0000","last_undegraded":"2024-04-17T05:26:58.276660+0000","last_fullsized":"2024-04-17T05:26:58.276660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:05:29.762149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316846+0000","last_change":"2024-04-17T05:26:52.214868+0000","last_active":"2024-04-17T05:26:59.316846+0000","last_peered":"2024-04-17T05:26:59.316846+0000","last_clean":"2024-04-17T05:26:59.316846+0000","last_became_active":"2024-04-17T05:26:52.214633+0000","last_became_peered":"2024-04-17T05:26:52.214633+0000","last_unstale":"2024-04-17T05:26:59.316846+0000","last_undegraded":"2024-04-17T05:26:59.316846+0000","last_fullsized":"2024-04-17T05:26:59.316846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:10:33.072665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276550+0000","last_change":"2024-04-17T05:26:57.309644+0000","last_active":"2024-04-17T05:26:58.276550+0000","last_peered":"2024-04-17T05:26:58.276550+0000","last_clean":"2024-04-17T05:26:58.276550+0000","last_became_active":"2024-04-17T05:26:57.309175+0000","last_became_peered":"2024-04-17T05:26:57.309175+0000","last_unstale":"2024-04-17T05:26:58.276550+0000","last_undegraded":"2024-04-17T05:26:58.276550+0000","last_fullsized":"2024-04-17T05:26:58.276550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:31:30.903722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314210+0000","last_change":"2024-04-17T05:26:53.220368+0000","last_active":"2024-04-17T05:26:59.314210+0000","last_peered":"2024-04-17T05:26:59.314210+0000","last_clean":"2024-04-17T05:26:59.314210+0000","last_became_active":"2024-04-17T05:26:53.220068+0000","last_became_peered":"2024-04-17T05:26:53.220068+0000","last_unstale":"2024-04-17T05:26:59.314210+0000","last_undegraded":"2024-04-17T05:26:59.314210+0000","last_fullsized":"2024-04-17T05:26:59.314210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:04:57.213834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316683+0000","last_change":"2024-04-17T05:26:52.215954+0000","last_active":"2024-04-17T05:26:59.316683+0000","last_peered":"2024-04-17T05:26:59.316683+0000","last_clean":"2024-04-17T05:26:59.316683+0000","last_became_active":"2024-04-17T05:26:52.215637+0000","last_became_peered":"2024-04-17T05:26:52.215637+0000","last_unstale":"2024-04-17T05:26:59.316683+0000","last_undegraded":"2024-04-17T05:26:59.316683+0000","last_fullsized":"2024-04-17T05:26:59.316683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:05:12.780620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276029+0000","last_change":"2024-04-17T05:26:57.342654+0000","last_active":"2024-04-17T05:26:58.276029+0000","last_peered":"2024-04-17T05:26:58.276029+0000","last_clean":"2024-04-17T05:26:58.276029+0000","last_became_active":"2024-04-17T05:26:57.342205+0000","last_became_peered":"2024-04-17T05:26:57.342205+0000","last_unstale":"2024-04-17T05:26:58.276029+0000","last_undegraded":"2024-04-17T05:26:58.276029+0000","last_fullsized":"2024-04-17T05:26:58.276029+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:08:20.405780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.275085+0000","last_change":"2024-04-17T05:26:53.238192+0000","last_active":"2024-04-17T05:26:58.275085+0000","last_peered":"2024-04-17T05:26:58.275085+0000","last_clean":"2024-04-17T05:26:58.275085+0000","last_became_active":"2024-04-17T05:26:53.237901+0000","last_became_peered":"2024-04-17T05:26:53.237901+0000","last_unstale":"2024-04-17T05:26:58.275085+0000","last_undegraded":"2024-04-17T05:26:58.275085+0000","last_fullsized":"2024-04-17T05:26:58.275085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:31:26.820940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315702+0000","last_change":"2024-04-17T05:26:52.213337+0000","last_active":"2024-04-17T05:26:59.315702+0000","last_peered":"2024-04-17T05:26:59.315702+0000","last_clean":"2024-04-17T05:26:59.315702+0000","last_became_active":"2024-04-17T05:26:52.213091+0000","last_became_peered":"2024-04-17T05:26:52.213091+0000","last_unstale":"2024-04-17T05:26:59.315702+0000","last_undegraded":"2024-04-17T05:26:59.315702+0000","last_fullsized":"2024-04-17T05:26:59.315702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:26.013417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.272624+0000","last_change":"2024-04-17T05:26:57.342025+0000","last_active":"2024-04-17T05:26:58.272624+0000","last_peered":"2024-04-17T05:26:58.272624+0000","last_clean":"2024-04-17T05:26:58.272624+0000","last_became_active":"2024-04-17T05:26:57.341654+0000","last_became_peered":"2024-04-17T05:26:57.341654+0000","last_unstale":"2024-04-17T05:26:58.272624+0000","last_undegraded":"2024-04-17T05:26:58.272624+0000","last_fullsized":"2024-04-17T05:26:58.272624+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:43:39.199679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315923+0000","last_change":"2024-04-17T05:26:53.220626+0000","last_active":"2024-04-17T05:26:59.315923+0000","last_peered":"2024-04-17T05:26:59.315923+0000","last_clean":"2024-04-17T05:26:59.315923+0000","last_became_active":"2024-04-17T05:26:53.220331+0000","last_became_peered":"2024-04-17T05:26:53.220331+0000","last_unstale":"2024-04-17T05:26:59.315923+0000","last_undegraded":"2024-04-17T05:26:59.315923+0000","last_fullsized":"2024-04-17T05:26:59.315923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:32:25.337967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317911+0000","last_change":"2024-04-17T05:26:52.216060+0000","last_active":"2024-04-17T05:26:59.317911+0000","last_peered":"2024-04-17T05:26:59.317911+0000","last_clean":"2024-04-17T05:26:59.317911+0000","last_became_active":"2024-04-17T05:26:52.215771+0000","last_became_peered":"2024-04-17T05:26:52.215771+0000","last_unstale":"2024-04-17T05:26:59.317911+0000","last_undegraded":"2024-04-17T05:26:59.317911+0000","last_fullsized":"2024-04-17T05:26:59.317911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:14:11.769826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313579+0000","last_change":"2024-04-17T05:26:57.343520+0000","last_active":"2024-04-17T05:26:59.313579+0000","last_peered":"2024-04-17T05:26:59.313579+0000","last_clean":"2024-04-17T05:26:59.313579+0000","last_became_active":"2024-04-17T05:26:57.343032+0000","last_became_peered":"2024-04-17T05:26:57.343032+0000","last_unstale":"2024-04-17T05:26:59.313579+0000","last_undegraded":"2024-04-17T05:26:59.313579+0000","last_fullsized":"2024-04-17T05:26:59.313579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:59:04.049982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276726+0000","last_change":"2024-04-17T05:26:53.238977+0000","last_active":"2024-04-17T05:26:58.276726+0000","last_peered":"2024-04-17T05:26:58.276726+0000","last_clean":"2024-04-17T05:26:58.276726+0000","last_became_active":"2024-04-17T05:26:53.238516+0000","last_became_peered":"2024-04-17T05:26:53.238516+0000","last_unstale":"2024-04-17T05:26:58.276726+0000","last_undegraded":"2024-04-17T05:26:58.276726+0000","last_fullsized":"2024-04-17T05:26:58.276726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:59:47.655532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315985+0000","last_change":"2024-04-17T05:26:52.204960+0000","last_active":"2024-04-17T05:26:59.315985+0000","last_peered":"2024-04-17T05:26:59.315985+0000","last_clean":"2024-04-17T05:26:59.315985+0000","last_became_active":"2024-04-17T05:26:52.204529+0000","last_became_peered":"2024-04-17T05:26:52.204529+0000","last_unstale":"2024-04-17T05:26:59.315985+0000","last_undegraded":"2024-04-17T05:26:59.315985+0000","last_fullsized":"2024-04-17T05:26:59.315985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:28.440614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314574+0000","last_change":"2024-04-17T05:26:57.300433+0000","last_active":"2024-04-17T05:26:59.314574+0000","last_peered":"2024-04-17T05:26:59.314574+0000","last_clean":"2024-04-17T05:26:59.314574+0000","last_became_active":"2024-04-17T05:26:57.299625+0000","last_became_peered":"2024-04-17T05:26:57.299625+0000","last_unstale":"2024-04-17T05:26:59.314574+0000","last_undegraded":"2024-04-17T05:26:59.314574+0000","last_fullsized":"2024-04-17T05:26:59.314574+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:59:51.738314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.278228+0000","last_change":"2024-04-17T05:26:53.221039+0000","last_active":"2024-04-17T05:26:58.278228+0000","last_peered":"2024-04-17T05:26:58.278228+0000","last_clean":"2024-04-17T05:26:58.278228+0000","last_became_active":"2024-04-17T05:26:53.220763+0000","last_became_peered":"2024-04-17T05:26:53.220763+0000","last_unstale":"2024-04-17T05:26:58.278228+0000","last_undegraded":"2024-04-17T05:26:58.278228+0000","last_fullsized":"2024-04-17T05:26:58.278228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:06:06.694765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.275564+0000","last_change":"2024-04-17T05:26:52.200059+0000","last_active":"2024-04-17T05:26:58.275564+0000","last_peered":"2024-04-17T05:26:58.275564+0000","last_clean":"2024-04-17T05:26:58.275564+0000","last_became_active":"2024-04-17T05:26:52.199528+0000","last_became_peered":"2024-04-17T05:26:52.199528+0000","last_unstale":"2024-04-17T05:26:58.275564+0000","last_undegraded":"2024-04-17T05:26:58.275564+0000","last_fullsized":"2024-04-17T05:26:58.275564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:39:42.873364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315890+0000","last_change":"2024-04-17T05:26:57.306296+0000","last_active":"2024-04-17T05:26:59.315890+0000","last_peered":"2024-04-17T05:26:59.315890+0000","last_clean":"2024-04-17T05:26:59.315890+0000","last_became_active":"2024-04-17T05:26:57.305013+0000","last_became_peered":"2024-04-17T05:26:57.305013+0000","last_unstale":"2024-04-17T05:26:59.315890+0000","last_undegraded":"2024-04-17T05:26:59.315890+0000","last_fullsized":"2024-04-17T05:26:59.315890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:43:13.615366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313694+0000","last_change":"2024-04-17T05:26:53.225946+0000","last_active":"2024-04-17T05:26:59.313694+0000","last_peered":"2024-04-17T05:26:59.313694+0000","last_clean":"2024-04-17T05:26:59.313694+0000","last_became_active":"2024-04-17T05:26:53.220930+0000","last_became_peered":"2024-04-17T05:26:53.220930+0000","last_unstale":"2024-04-17T05:26:59.313694+0000","last_undegraded":"2024-04-17T05:26:59.313694+0000","last_fullsized":"2024-04-17T05:26:59.313694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:08:41.870139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315801+0000","last_change":"2024-04-17T05:26:52.200139+0000","last_active":"2024-04-17T05:26:59.315801+0000","last_peered":"2024-04-17T05:26:59.315801+0000","last_clean":"2024-04-17T05:26:59.315801+0000","last_became_active":"2024-04-17T05:26:52.199804+0000","last_became_peered":"2024-04-17T05:26:52.199804+0000","last_unstale":"2024-04-17T05:26:59.315801+0000","last_undegraded":"2024-04-17T05:26:59.315801+0000","last_fullsized":"2024-04-17T05:26:59.315801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:05:28.743450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316978+0000","last_change":"2024-04-17T05:26:57.303365+0000","last_active":"2024-04-17T05:26:59.316978+0000","last_peered":"2024-04-17T05:26:59.316978+0000","last_clean":"2024-04-17T05:26:59.316978+0000","last_became_active":"2024-04-17T05:26:57.301101+0000","last_became_peered":"2024-04-17T05:26:57.301101+0000","last_unstale":"2024-04-17T05:26:59.316978+0000","last_undegraded":"2024-04-17T05:26:59.316978+0000","last_fullsized":"2024-04-17T05:26:59.316978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:43:39.199679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.312425+0000","last_change":"2024-04-17T05:26:53.238762+0000","last_active":"2024-04-17T05:26:59.312425+0000","last_peered":"2024-04-17T05:26:59.312425+0000","last_clean":"2024-04-17T05:26:59.312425+0000","last_became_active":"2024-04-17T05:26:53.238488+0000","last_became_peered":"2024-04-17T05:26:53.238488+0000","last_unstale":"2024-04-17T05:26:59.312425+0000","last_undegraded":"2024-04-17T05:26:59.312425+0000","last_fullsized":"2024-04-17T05:26:59.312425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:38.214751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315993+0000","last_change":"2024-04-17T05:26:52.213104+0000","last_active":"2024-04-17T05:26:59.315993+0000","last_peered":"2024-04-17T05:26:59.315993+0000","last_clean":"2024-04-17T05:26:59.315993+0000","last_became_active":"2024-04-17T05:26:52.212838+0000","last_became_peered":"2024-04-17T05:26:52.212838+0000","last_unstale":"2024-04-17T05:26:59.315993+0000","last_undegraded":"2024-04-17T05:26:59.315993+0000","last_fullsized":"2024-04-17T05:26:59.315993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:11:58.913400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313981+0000","last_change":"2024-04-17T05:26:57.342387+0000","last_active":"2024-04-17T05:26:59.313981+0000","last_peered":"2024-04-17T05:26:59.313981+0000","last_clean":"2024-04-17T05:26:59.313981+0000","last_became_active":"2024-04-17T05:26:57.342008+0000","last_became_peered":"2024-04-17T05:26:57.342008+0000","last_unstale":"2024-04-17T05:26:59.313981+0000","last_undegraded":"2024-04-17T05:26:59.313981+0000","last_fullsized":"2024-04-17T05:26:59.313981+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:43:39.199679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273541+0000","last_change":"2024-04-17T05:26:53.243046+0000","last_active":"2024-04-17T05:26:58.273541+0000","last_peered":"2024-04-17T05:26:58.273541+0000","last_clean":"2024-04-17T05:26:58.273541+0000","last_became_active":"2024-04-17T05:26:53.242778+0000","last_became_peered":"2024-04-17T05:26:53.242778+0000","last_unstale":"2024-04-17T05:26:58.273541+0000","last_undegraded":"2024-04-17T05:26:58.273541+0000","last_fullsized":"2024-04-17T05:26:58.273541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:32:25.337967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274750+0000","last_change":"2024-04-17T05:26:52.198125+0000","last_active":"2024-04-17T05:26:58.274750+0000","last_peered":"2024-04-17T05:26:58.274750+0000","last_clean":"2024-04-17T05:26:58.274750+0000","last_became_active":"2024-04-17T05:26:52.197762+0000","last_became_peered":"2024-04-17T05:26:52.197762+0000","last_unstale":"2024-04-17T05:26:58.274750+0000","last_undegraded":"2024-04-17T05:26:58.274750+0000","last_fullsized":"2024-04-17T05:26:58.274750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:28.440614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316306+0000","last_change":"2024-04-17T05:26:48.072527+0000","last_active":"2024-04-17T05:26:59.316306+0000","last_peered":"2024-04-17T05:26:59.316306+0000","last_clean":"2024-04-17T05:26:59.316306+0000","last_became_active":"2024-04-17T05:26:48.070585+0000","last_became_peered":"2024-04-17T05:26:48.070585+0000","last_unstale":"2024-04-17T05:26:59.316306+0000","last_undegraded":"2024-04-17T05:26:59.316306+0000","last_fullsized":"2024-04-17T05:26:59.316306+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:46.995002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:46.995002+0000","last_clean_scrub_stamp":"2024-04-17T05:26:46.995002+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:48:35.792125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316121+0000","last_change":"2024-04-17T05:26:57.346681+0000","last_active":"2024-04-17T05:26:59.316121+0000","last_peered":"2024-04-17T05:26:59.316121+0000","last_clean":"2024-04-17T05:26:59.316121+0000","last_became_active":"2024-04-17T05:26:57.345320+0000","last_became_peered":"2024-04-17T05:26:57.345320+0000","last_unstale":"2024-04-17T05:26:59.316121+0000","last_undegraded":"2024-04-17T05:26:59.316121+0000","last_fullsized":"2024-04-17T05:26:59.316121+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:14:02.473527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316740+0000","last_change":"2024-04-17T05:26:53.251585+0000","last_active":"2024-04-17T05:26:59.316740+0000","last_peered":"2024-04-17T05:26:59.316740+0000","last_clean":"2024-04-17T05:26:59.316740+0000","last_became_active":"2024-04-17T05:26:53.249490+0000","last_became_peered":"2024-04-17T05:26:53.249490+0000","last_unstale":"2024-04-17T05:26:59.316740+0000","last_undegraded":"2024-04-17T05:26:59.316740+0000","last_fullsized":"2024-04-17T05:26:59.316740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:32:48.533935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317029+0000","last_change":"2024-04-17T05:26:52.209276+0000","last_active":"2024-04-17T05:26:59.317029+0000","last_peered":"2024-04-17T05:26:59.317029+0000","last_clean":"2024-04-17T05:26:59.317029+0000","last_became_active":"2024-04-17T05:26:52.208422+0000","last_became_peered":"2024-04-17T05:26:52.208422+0000","last_unstale":"2024-04-17T05:26:59.317029+0000","last_undegraded":"2024-04-17T05:26:59.317029+0000","last_fullsized":"2024-04-17T05:26:59.317029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:39:42.873364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315187+0000","last_change":"2024-04-17T05:26:57.342209+0000","last_active":"2024-04-17T05:26:59.315187+0000","last_peered":"2024-04-17T05:26:59.315187+0000","last_clean":"2024-04-17T05:26:59.315187+0000","last_became_active":"2024-04-17T05:26:57.341658+0000","last_became_peered":"2024-04-17T05:26:57.341658+0000","last_unstale":"2024-04-17T05:26:59.315187+0000","last_undegraded":"2024-04-17T05:26:59.315187+0000","last_fullsized":"2024-04-17T05:26:59.315187+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:49.740852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276430+0000","last_change":"2024-04-17T05:26:53.239720+0000","last_active":"2024-04-17T05:26:58.276430+0000","last_peered":"2024-04-17T05:26:58.276430+0000","last_clean":"2024-04-17T05:26:58.276430+0000","last_became_active":"2024-04-17T05:26:53.238669+0000","last_became_peered":"2024-04-17T05:26:53.238669+0000","last_unstale":"2024-04-17T05:26:58.276430+0000","last_undegraded":"2024-04-17T05:26:58.276430+0000","last_fullsized":"2024-04-17T05:26:58.276430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:58:59.967200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316067+0000","last_change":"2024-04-17T05:26:52.202596+0000","last_active":"2024-04-17T05:26:59.316067+0000","last_peered":"2024-04-17T05:26:59.316067+0000","last_clean":"2024-04-17T05:26:59.316067+0000","last_became_active":"2024-04-17T05:26:52.202246+0000","last_became_peered":"2024-04-17T05:26:52.202246+0000","last_unstale":"2024-04-17T05:26:59.316067+0000","last_undegraded":"2024-04-17T05:26:59.316067+0000","last_fullsized":"2024-04-17T05:26:59.316067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:30.475514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313919+0000","last_change":"2024-04-17T05:26:57.303069+0000","last_active":"2024-04-17T05:26:59.313919+0000","last_peered":"2024-04-17T05:26:59.313919+0000","last_clean":"2024-04-17T05:26:59.313919+0000","last_became_active":"2024-04-17T05:26:57.302457+0000","last_became_peered":"2024-04-17T05:26:57.302457+0000","last_unstale":"2024-04-17T05:26:59.313919+0000","last_undegraded":"2024-04-17T05:26:59.313919+0000","last_fullsized":"2024-04-17T05:26:59.313919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:45:07.123915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.318354+0000","last_change":"2024-04-17T05:26:53.255140+0000","last_active":"2024-04-17T05:26:59.318354+0000","last_peered":"2024-04-17T05:26:59.318354+0000","last_clean":"2024-04-17T05:26:59.318354+0000","last_became_active":"2024-04-17T05:26:53.254371+0000","last_became_peered":"2024-04-17T05:26:53.254371+0000","last_unstale":"2024-04-17T05:26:59.318354+0000","last_undegraded":"2024-04-17T05:26:59.318354+0000","last_fullsized":"2024-04-17T05:26:59.318354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:33:12.651636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317435+0000","last_change":"2024-04-17T05:26:52.204598+0000","last_active":"2024-04-17T05:26:59.317435+0000","last_peered":"2024-04-17T05:26:59.317435+0000","last_clean":"2024-04-17T05:26:59.317435+0000","last_became_active":"2024-04-17T05:26:52.204139+0000","last_became_peered":"2024-04-17T05:26:52.204139+0000","last_unstale":"2024-04-17T05:26:59.317435+0000","last_undegraded":"2024-04-17T05:26:59.317435+0000","last_fullsized":"2024-04-17T05:26:59.317435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:11:26.292397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274608+0000","last_change":"2024-04-17T05:26:57.345152+0000","last_active":"2024-04-17T05:26:58.274608+0000","last_peered":"2024-04-17T05:26:58.274608+0000","last_clean":"2024-04-17T05:26:58.274608+0000","last_became_active":"2024-04-17T05:26:57.342006+0000","last_became_peered":"2024-04-17T05:26:57.342006+0000","last_unstale":"2024-04-17T05:26:58.274608+0000","last_undegraded":"2024-04-17T05:26:58.274608+0000","last_fullsized":"2024-04-17T05:26:58.274608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:56:05.345989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317476+0000","last_change":"2024-04-17T05:26:53.253746+0000","last_active":"2024-04-17T05:26:59.317476+0000","last_peered":"2024-04-17T05:26:59.317476+0000","last_clean":"2024-04-17T05:26:59.317476+0000","last_became_active":"2024-04-17T05:26:53.253395+0000","last_became_peered":"2024-04-17T05:26:53.253395+0000","last_unstale":"2024-04-17T05:26:59.317476+0000","last_undegraded":"2024-04-17T05:26:59.317476+0000","last_fullsized":"2024-04-17T05:26:59.317476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:46:38.091860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.277646+0000","last_change":"2024-04-17T05:26:52.199105+0000","last_active":"2024-04-17T05:26:58.277646+0000","last_peered":"2024-04-17T05:26:58.277646+0000","last_clean":"2024-04-17T05:26:58.277646+0000","last_became_active":"2024-04-17T05:26:52.198798+0000","last_became_peered":"2024-04-17T05:26:52.198798+0000","last_unstale":"2024-04-17T05:26:58.277646+0000","last_undegraded":"2024-04-17T05:26:58.277646+0000","last_fullsized":"2024-04-17T05:26:58.277646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:34:06.405382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274283+0000","last_change":"2024-04-17T05:26:57.306130+0000","last_active":"2024-04-17T05:26:58.274283+0000","last_peered":"2024-04-17T05:26:58.274283+0000","last_clean":"2024-04-17T05:26:58.274283+0000","last_became_active":"2024-04-17T05:26:57.305415+0000","last_became_peered":"2024-04-17T05:26:57.305415+0000","last_unstale":"2024-04-17T05:26:58.274283+0000","last_undegraded":"2024-04-17T05:26:58.274283+0000","last_fullsized":"2024-04-17T05:26:58.274283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:36.214126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317844+0000","last_change":"2024-04-17T05:26:53.253524+0000","last_active":"2024-04-17T05:26:59.317844+0000","last_peered":"2024-04-17T05:26:59.317844+0000","last_clean":"2024-04-17T05:26:59.317844+0000","last_became_active":"2024-04-17T05:26:53.251408+0000","last_became_peered":"2024-04-17T05:26:53.251408+0000","last_unstale":"2024-04-17T05:26:59.317844+0000","last_undegraded":"2024-04-17T05:26:59.317844+0000","last_fullsized":"2024-04-17T05:26:59.317844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:13:58.390745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315457+0000","last_change":"2024-04-17T05:26:52.197556+0000","last_active":"2024-04-17T05:26:59.315457+0000","last_peered":"2024-04-17T05:26:59.315457+0000","last_clean":"2024-04-17T05:26:59.315457+0000","last_became_active":"2024-04-17T05:26:52.197250+0000","last_became_peered":"2024-04-17T05:26:52.197250+0000","last_unstale":"2024-04-17T05:26:59.315457+0000","last_undegraded":"2024-04-17T05:26:59.315457+0000","last_fullsized":"2024-04-17T05:26:59.315457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:12:06.528342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313911+0000","last_change":"2024-04-17T05:26:57.296438+0000","last_active":"2024-04-17T05:26:59.313911+0000","last_peered":"2024-04-17T05:26:59.313911+0000","last_clean":"2024-04-17T05:26:59.313911+0000","last_became_active":"2024-04-17T05:26:57.296040+0000","last_became_peered":"2024-04-17T05:26:57.296040+0000","last_unstale":"2024-04-17T05:26:59.313911+0000","last_undegraded":"2024-04-17T05:26:59.313911+0000","last_fullsized":"2024-04-17T05:26:59.313911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:43:13.615366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315063+0000","last_change":"2024-04-17T05:26:53.231338+0000","last_active":"2024-04-17T05:26:59.315063+0000","last_peered":"2024-04-17T05:26:59.315063+0000","last_clean":"2024-04-17T05:26:59.315063+0000","last_became_active":"2024-04-17T05:26:53.230987+0000","last_became_peered":"2024-04-17T05:26:53.230987+0000","last_unstale":"2024-04-17T05:26:59.315063+0000","last_undegraded":"2024-04-17T05:26:59.315063+0000","last_fullsized":"2024-04-17T05:26:59.315063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:08:10.489719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315083+0000","last_change":"2024-04-17T05:26:52.207087+0000","last_active":"2024-04-17T05:26:59.315083+0000","last_peered":"2024-04-17T05:26:59.315083+0000","last_clean":"2024-04-17T05:26:59.315083+0000","last_became_active":"2024-04-17T05:26:52.206401+0000","last_became_peered":"2024-04-17T05:26:52.206401+0000","last_unstale":"2024-04-17T05:26:59.315083+0000","last_undegraded":"2024-04-17T05:26:59.315083+0000","last_fullsized":"2024-04-17T05:26:59.315083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:56:53.915549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.275125+0000","last_change":"2024-04-17T05:26:57.346955+0000","last_active":"2024-04-17T05:26:58.275125+0000","last_peered":"2024-04-17T05:26:58.275125+0000","last_clean":"2024-04-17T05:26:58.275125+0000","last_became_active":"2024-04-17T05:26:57.346516+0000","last_became_peered":"2024-04-17T05:26:57.346516+0000","last_unstale":"2024-04-17T05:26:58.275125+0000","last_undegraded":"2024-04-17T05:26:58.275125+0000","last_fullsized":"2024-04-17T05:26:58.275125+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:00:55.830345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317606+0000","last_change":"2024-04-17T05:26:53.254195+0000","last_active":"2024-04-17T05:26:59.317606+0000","last_peered":"2024-04-17T05:26:59.317606+0000","last_clean":"2024-04-17T05:26:59.317606+0000","last_became_active":"2024-04-17T05:26:53.253813+0000","last_became_peered":"2024-04-17T05:26:53.253813+0000","last_unstale":"2024-04-17T05:26:59.317606+0000","last_undegraded":"2024-04-17T05:26:59.317606+0000","last_fullsized":"2024-04-17T05:26:59.317606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:18:31.208224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.275423+0000","last_change":"2024-04-17T05:26:52.211664+0000","last_active":"2024-04-17T05:26:58.275423+0000","last_peered":"2024-04-17T05:26:58.275423+0000","last_clean":"2024-04-17T05:26:58.275423+0000","last_became_active":"2024-04-17T05:26:52.210106+0000","last_became_peered":"2024-04-17T05:26:52.210106+0000","last_unstale":"2024-04-17T05:26:58.275423+0000","last_undegraded":"2024-04-17T05:26:58.275423+0000","last_fullsized":"2024-04-17T05:26:58.275423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:11:26.292397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274110+0000","last_change":"2024-04-17T05:26:57.344473+0000","last_active":"2024-04-17T05:26:58.274110+0000","last_peered":"2024-04-17T05:26:58.274110+0000","last_clean":"2024-04-17T05:26:58.274110+0000","last_became_active":"2024-04-17T05:26:57.341999+0000","last_became_peered":"2024-04-17T05:26:57.341999+0000","last_unstale":"2024-04-17T05:26:58.274110+0000","last_undegraded":"2024-04-17T05:26:58.274110+0000","last_fullsized":"2024-04-17T05:26:58.274110+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:35:19.879335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313364+0000","last_change":"2024-04-17T05:26:53.235732+0000","last_active":"2024-04-17T05:26:59.313364+0000","last_peered":"2024-04-17T05:26:59.313364+0000","last_clean":"2024-04-17T05:26:59.313364+0000","last_became_active":"2024-04-17T05:26:53.233202+0000","last_became_peered":"2024-04-17T05:26:53.233202+0000","last_unstale":"2024-04-17T05:26:59.313364+0000","last_undegraded":"2024-04-17T05:26:59.313364+0000","last_fullsized":"2024-04-17T05:26:59.313364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:58:23.088108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314205+0000","last_change":"2024-04-17T05:26:52.194788+0000","last_active":"2024-04-17T05:26:59.314205+0000","last_peered":"2024-04-17T05:26:59.314205+0000","last_clean":"2024-04-17T05:26:59.314205+0000","last_became_active":"2024-04-17T05:26:52.194504+0000","last_became_peered":"2024-04-17T05:26:52.194504+0000","last_unstale":"2024-04-17T05:26:59.314205+0000","last_undegraded":"2024-04-17T05:26:59.314205+0000","last_fullsized":"2024-04-17T05:26:59.314205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:29:09.631143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276321+0000","last_change":"2024-04-17T05:26:57.344052+0000","last_active":"2024-04-17T05:26:58.276321+0000","last_peered":"2024-04-17T05:26:58.276321+0000","last_clean":"2024-04-17T05:26:58.276321+0000","last_became_active":"2024-04-17T05:26:57.343479+0000","last_became_peered":"2024-04-17T05:26:57.343479+0000","last_unstale":"2024-04-17T05:26:58.276321+0000","last_undegraded":"2024-04-17T05:26:58.276321+0000","last_fullsized":"2024-04-17T05:26:58.276321+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:23:44.724644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316499+0000","last_change":"2024-04-17T05:26:53.250744+0000","last_active":"2024-04-17T05:26:59.316499+0000","last_peered":"2024-04-17T05:26:59.316499+0000","last_clean":"2024-04-17T05:26:59.316499+0000","last_became_active":"2024-04-17T05:26:53.249125+0000","last_became_peered":"2024-04-17T05:26:53.249125+0000","last_unstale":"2024-04-17T05:26:59.316499+0000","last_undegraded":"2024-04-17T05:26:59.316499+0000","last_fullsized":"2024-04-17T05:26:59.316499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:29.313074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:27:10.814542+0000","last_change":"2024-04-17T05:26:52.208074+0000","last_active":"2024-04-17T05:27:10.814542+0000","last_peered":"2024-04-17T05:27:10.814542+0000","last_clean":"2024-04-17T05:27:10.814542+0000","last_became_active":"2024-04-17T05:26:52.207696+0000","last_became_peered":"2024-04-17T05:26:52.207696+0000","last_unstale":"2024-04-17T05:27:10.814542+0000","last_undegraded":"2024-04-17T05:27:10.814542+0000","last_fullsized":"2024-04-17T05:27:10.814542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:10:33.072665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314836+0000","last_change":"2024-04-17T05:26:57.303649+0000","last_active":"2024-04-17T05:26:59.314836+0000","last_peered":"2024-04-17T05:26:59.314836+0000","last_clean":"2024-04-17T05:26:59.314836+0000","last_became_active":"2024-04-17T05:26:57.303124+0000","last_became_peered":"2024-04-17T05:26:57.303124+0000","last_unstale":"2024-04-17T05:26:59.314836+0000","last_undegraded":"2024-04-17T05:26:59.314836+0000","last_fullsized":"2024-04-17T05:26:59.314836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:59:04.049982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.277954+0000","last_change":"2024-04-17T05:26:53.232911+0000","last_active":"2024-04-17T05:26:58.277954+0000","last_peered":"2024-04-17T05:26:58.277954+0000","last_clean":"2024-04-17T05:26:58.277954+0000","last_became_active":"2024-04-17T05:26:53.232624+0000","last_became_peered":"2024-04-17T05:26:53.232624+0000","last_unstale":"2024-04-17T05:26:58.277954+0000","last_undegraded":"2024-04-17T05:26:58.277954+0000","last_fullsized":"2024-04-17T05:26:58.277954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:31.494213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315869+0000","last_change":"2024-04-17T05:26:52.207484+0000","last_active":"2024-04-17T05:26:59.315869+0000","last_peered":"2024-04-17T05:26:59.315869+0000","last_clean":"2024-04-17T05:26:59.315869+0000","last_became_active":"2024-04-17T05:26:52.207181+0000","last_became_peered":"2024-04-17T05:26:52.207181+0000","last_unstale":"2024-04-17T05:26:59.315869+0000","last_undegraded":"2024-04-17T05:26:59.315869+0000","last_fullsized":"2024-04-17T05:26:59.315869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:06:05.676066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.277617+0000","last_change":"2024-04-17T05:26:57.310269+0000","last_active":"2024-04-17T05:26:58.277617+0000","last_peered":"2024-04-17T05:26:58.277617+0000","last_clean":"2024-04-17T05:26:58.277617+0000","last_became_active":"2024-04-17T05:26:57.308888+0000","last_became_peered":"2024-04-17T05:26:57.308888+0000","last_unstale":"2024-04-17T05:26:58.277617+0000","last_undegraded":"2024-04-17T05:26:58.277617+0000","last_fullsized":"2024-04-17T05:26:58.277617+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:52:36.475652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314048+0000","last_change":"2024-04-17T05:26:53.241678+0000","last_active":"2024-04-17T05:26:59.314048+0000","last_peered":"2024-04-17T05:26:59.314048+0000","last_clean":"2024-04-17T05:26:59.314048+0000","last_became_active":"2024-04-17T05:26:53.241388+0000","last_became_peered":"2024-04-17T05:26:53.241388+0000","last_unstale":"2024-04-17T05:26:59.314048+0000","last_undegraded":"2024-04-17T05:26:59.314048+0000","last_fullsized":"2024-04-17T05:26:59.314048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:32:25.337967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.277856+0000","last_change":"2024-04-17T05:26:52.213786+0000","last_active":"2024-04-17T05:26:58.277856+0000","last_peered":"2024-04-17T05:26:58.277856+0000","last_clean":"2024-04-17T05:26:58.277856+0000","last_became_active":"2024-04-17T05:26:52.212440+0000","last_became_peered":"2024-04-17T05:26:52.212440+0000","last_unstale":"2024-04-17T05:26:58.277856+0000","last_undegraded":"2024-04-17T05:26:58.277856+0000","last_fullsized":"2024-04-17T05:26:58.277856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:06:05.676066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273308+0000","last_change":"2024-04-17T05:26:57.300596+0000","last_active":"2024-04-17T05:26:58.273308+0000","last_peered":"2024-04-17T05:26:58.273308+0000","last_clean":"2024-04-17T05:26:58.273308+0000","last_became_active":"2024-04-17T05:26:57.300156+0000","last_became_peered":"2024-04-17T05:26:57.300156+0000","last_unstale":"2024-04-17T05:26:58.273308+0000","last_undegraded":"2024-04-17T05:26:58.273308+0000","last_fullsized":"2024-04-17T05:26:58.273308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:11:16.497552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.277619+0000","last_change":"2024-04-17T05:26:53.238893+0000","last_active":"2024-04-17T05:26:58.277619+0000","last_peered":"2024-04-17T05:26:58.277619+0000","last_clean":"2024-04-17T05:26:58.277619+0000","last_became_active":"2024-04-17T05:26:53.238566+0000","last_became_peered":"2024-04-17T05:26:53.238566+0000","last_unstale":"2024-04-17T05:26:58.277619+0000","last_undegraded":"2024-04-17T05:26:58.277619+0000","last_fullsized":"2024-04-17T05:26:58.277619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:52:32.392870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316389+0000","last_change":"2024-04-17T05:26:52.215304+0000","last_active":"2024-04-17T05:26:59.316389+0000","last_peered":"2024-04-17T05:26:59.316389+0000","last_clean":"2024-04-17T05:26:59.316389+0000","last_became_active":"2024-04-17T05:26:52.214958+0000","last_became_peered":"2024-04-17T05:26:52.214958+0000","last_unstale":"2024-04-17T05:26:59.316389+0000","last_undegraded":"2024-04-17T05:26:59.316389+0000","last_fullsized":"2024-04-17T05:26:59.316389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:13:25.702517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273063+0000","last_change":"2024-04-17T05:26:57.342083+0000","last_active":"2024-04-17T05:26:58.273063+0000","last_peered":"2024-04-17T05:26:58.273063+0000","last_clean":"2024-04-17T05:26:58.273063+0000","last_became_active":"2024-04-17T05:26:57.341304+0000","last_became_peered":"2024-04-17T05:26:57.341304+0000","last_unstale":"2024-04-17T05:26:58.273063+0000","last_undegraded":"2024-04-17T05:26:58.273063+0000","last_fullsized":"2024-04-17T05:26:58.273063+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:56:05.345989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313536+0000","last_change":"2024-04-17T05:26:57.342446+0000","last_active":"2024-04-17T05:26:59.313536+0000","last_peered":"2024-04-17T05:26:59.313536+0000","last_clean":"2024-04-17T05:26:59.313536+0000","last_became_active":"2024-04-17T05:26:57.342076+0000","last_became_peered":"2024-04-17T05:26:57.342076+0000","last_unstale":"2024-04-17T05:26:59.313536+0000","last_undegraded":"2024-04-17T05:26:59.313536+0000","last_fullsized":"2024-04-17T05:26:59.313536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:59:51.738314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314000+0000","last_change":"2024-04-17T05:26:53.228706+0000","last_active":"2024-04-17T05:26:59.314000+0000","last_peered":"2024-04-17T05:26:59.314000+0000","last_clean":"2024-04-17T05:26:59.314000+0000","last_became_active":"2024-04-17T05:26:53.228381+0000","last_became_peered":"2024-04-17T05:26:53.228381+0000","last_unstale":"2024-04-17T05:26:59.314000+0000","last_undegraded":"2024-04-17T05:26:59.314000+0000","last_fullsized":"2024-04-17T05:26:59.314000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:04:57.213834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274809+0000","last_change":"2024-04-17T05:26:52.195697+0000","last_active":"2024-04-17T05:26:58.274809+0000","last_peered":"2024-04-17T05:26:58.274809+0000","last_clean":"2024-04-17T05:26:58.274809+0000","last_became_active":"2024-04-17T05:26:52.193995+0000","last_became_peered":"2024-04-17T05:26:52.193995+0000","last_unstale":"2024-04-17T05:26:58.274809+0000","last_undegraded":"2024-04-17T05:26:58.274809+0000","last_fullsized":"2024-04-17T05:26:58.274809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:05:28.743450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316290+0000","last_change":"2024-04-17T05:26:57.306563+0000","last_active":"2024-04-17T05:26:59.316290+0000","last_peered":"2024-04-17T05:26:59.316290+0000","last_clean":"2024-04-17T05:26:59.316290+0000","last_became_active":"2024-04-17T05:26:57.305777+0000","last_became_peered":"2024-04-17T05:26:57.305777+0000","last_unstale":"2024-04-17T05:26:59.316290+0000","last_undegraded":"2024-04-17T05:26:59.316290+0000","last_fullsized":"2024-04-17T05:26:59.316290+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:33.395856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273167+0000","last_change":"2024-04-17T05:26:53.229100+0000","last_active":"2024-04-17T05:26:58.273167+0000","last_peered":"2024-04-17T05:26:58.273167+0000","last_clean":"2024-04-17T05:26:58.273167+0000","last_became_active":"2024-04-17T05:26:53.225554+0000","last_became_peered":"2024-04-17T05:26:53.225554+0000","last_unstale":"2024-04-17T05:26:58.273167+0000","last_undegraded":"2024-04-17T05:26:58.273167+0000","last_fullsized":"2024-04-17T05:26:58.273167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:04:57.213834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273220+0000","last_change":"2024-04-17T05:26:52.205214+0000","last_active":"2024-04-17T05:26:58.273220+0000","last_peered":"2024-04-17T05:26:58.273220+0000","last_clean":"2024-04-17T05:26:58.273220+0000","last_became_active":"2024-04-17T05:26:52.204982+0000","last_became_peered":"2024-04-17T05:26:52.204982+0000","last_unstale":"2024-04-17T05:26:58.273220+0000","last_undegraded":"2024-04-17T05:26:58.273220+0000","last_fullsized":"2024-04-17T05:26:58.273220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:12:06.528342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315415+0000","last_change":"2024-04-17T05:26:52.211538+0000","last_active":"2024-04-17T05:26:59.315415+0000","last_peered":"2024-04-17T05:26:59.315415+0000","last_clean":"2024-04-17T05:26:59.315415+0000","last_became_active":"2024-04-17T05:26:52.211242+0000","last_became_peered":"2024-04-17T05:26:52.211242+0000","last_unstale":"2024-04-17T05:26:59.315415+0000","last_undegraded":"2024-04-17T05:26:59.315415+0000","last_fullsized":"2024-04-17T05:26:59.315415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:30:14.163882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314091+0000","last_change":"2024-04-17T05:26:53.239968+0000","last_active":"2024-04-17T05:26:59.314091+0000","last_peered":"2024-04-17T05:26:59.314091+0000","last_clean":"2024-04-17T05:26:59.314091+0000","last_became_active":"2024-04-17T05:26:53.239688+0000","last_became_peered":"2024-04-17T05:26:53.239688+0000","last_unstale":"2024-04-17T05:26:59.314091+0000","last_undegraded":"2024-04-17T05:26:59.314091+0000","last_fullsized":"2024-04-17T05:26:59.314091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:19:17.442103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317082+0000","last_change":"2024-04-17T05:26:57.297209+0000","last_active":"2024-04-17T05:26:59.317082+0000","last_peered":"2024-04-17T05:26:59.317082+0000","last_clean":"2024-04-17T05:26:59.317082+0000","last_became_active":"2024-04-17T05:26:57.295730+0000","last_became_peered":"2024-04-17T05:26:57.295730+0000","last_unstale":"2024-04-17T05:26:59.317082+0000","last_undegraded":"2024-04-17T05:26:59.317082+0000","last_fullsized":"2024-04-17T05:26:59.317082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:47:55.696215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274119+0000","last_change":"2024-04-17T05:26:52.214520+0000","last_active":"2024-04-17T05:26:58.274119+0000","last_peered":"2024-04-17T05:26:58.274119+0000","last_clean":"2024-04-17T05:26:58.274119+0000","last_became_active":"2024-04-17T05:26:52.214153+0000","last_became_peered":"2024-04-17T05:26:52.214153+0000","last_unstale":"2024-04-17T05:26:58.274119+0000","last_undegraded":"2024-04-17T05:26:58.274119+0000","last_fullsized":"2024-04-17T05:26:58.274119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:29:09.631143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.277103+0000","last_change":"2024-04-17T05:26:53.218086+0000","last_active":"2024-04-17T05:26:58.277103+0000","last_peered":"2024-04-17T05:26:58.277103+0000","last_clean":"2024-04-17T05:26:58.277103+0000","last_became_active":"2024-04-17T05:26:53.213566+0000","last_became_peered":"2024-04-17T05:26:53.213566+0000","last_unstale":"2024-04-17T05:26:58.277103+0000","last_undegraded":"2024-04-17T05:26:58.277103+0000","last_fullsized":"2024-04-17T05:26:58.277103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:29.459313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274661+0000","last_change":"2024-04-17T05:26:57.306742+0000","last_active":"2024-04-17T05:26:58.274661+0000","last_peered":"2024-04-17T05:26:58.274661+0000","last_clean":"2024-04-17T05:26:58.274661+0000","last_became_active":"2024-04-17T05:26:57.305115+0000","last_became_peered":"2024-04-17T05:26:57.305115+0000","last_unstale":"2024-04-17T05:26:58.274661+0000","last_undegraded":"2024-04-17T05:26:58.274661+0000","last_fullsized":"2024-04-17T05:26:58.274661+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:48:36.621042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315919+0000","last_change":"2024-04-17T05:26:53.232255+0000","last_active":"2024-04-17T05:26:59.315919+0000","last_peered":"2024-04-17T05:26:59.315919+0000","last_clean":"2024-04-17T05:26:59.315919+0000","last_became_active":"2024-04-17T05:26:53.231624+0000","last_became_peered":"2024-04-17T05:26:53.231624+0000","last_unstale":"2024-04-17T05:26:59.315919+0000","last_undegraded":"2024-04-17T05:26:59.315919+0000","last_fullsized":"2024-04-17T05:26:59.315919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:27:51.120892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316072+0000","last_change":"2024-04-17T05:26:53.222619+0000","last_active":"2024-04-17T05:26:59.316072+0000","last_peered":"2024-04-17T05:26:59.316072+0000","last_clean":"2024-04-17T05:26:59.316072+0000","last_became_active":"2024-04-17T05:26:53.222128+0000","last_became_peered":"2024-04-17T05:26:53.222128+0000","last_unstale":"2024-04-17T05:26:59.316072+0000","last_undegraded":"2024-04-17T05:26:59.316072+0000","last_fullsized":"2024-04-17T05:26:59.316072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:31.494213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.275315+0000","last_change":"2024-04-17T05:26:53.234820+0000","last_active":"2024-04-17T05:26:58.275315+0000","last_peered":"2024-04-17T05:26:58.275315+0000","last_clean":"2024-04-17T05:26:58.275315+0000","last_became_active":"2024-04-17T05:26:53.233708+0000","last_became_peered":"2024-04-17T05:26:53.233708+0000","last_unstale":"2024-04-17T05:26:58.275315+0000","last_undegraded":"2024-04-17T05:26:58.275315+0000","last_fullsized":"2024-04-17T05:26:58.275315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:08:16.322998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313987+0000","last_change":"2024-04-17T05:26:53.234961+0000","last_active":"2024-04-17T05:26:59.313987+0000","last_peered":"2024-04-17T05:26:59.313987+0000","last_clean":"2024-04-17T05:26:59.313987+0000","last_became_active":"2024-04-17T05:26:53.234387+0000","last_became_peered":"2024-04-17T05:26:53.234387+0000","last_unstale":"2024-04-17T05:26:59.313987+0000","last_undegraded":"2024-04-17T05:26:59.313987+0000","last_fullsized":"2024-04-17T05:26:59.313987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:07:47.404346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274284+0000","last_change":"2024-04-17T05:26:53.242359+0000","last_active":"2024-04-17T05:26:58.274284+0000","last_peered":"2024-04-17T05:26:58.274284+0000","last_clean":"2024-04-17T05:26:58.274284+0000","last_became_active":"2024-04-17T05:26:53.236476+0000","last_became_peered":"2024-04-17T05:26:53.236476+0000","last_unstale":"2024-04-17T05:26:58.274284+0000","last_undegraded":"2024-04-17T05:26:58.274284+0000","last_fullsized":"2024-04-17T05:26:58.274284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:08:16.322998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314721+0000","last_change":"2024-04-17T05:26:53.231647+0000","last_active":"2024-04-17T05:26:59.314721+0000","last_peered":"2024-04-17T05:26:59.314721+0000","last_clean":"2024-04-17T05:26:59.314721+0000","last_became_active":"2024-04-17T05:26:53.231335+0000","last_became_peered":"2024-04-17T05:26:53.231335+0000","last_unstale":"2024-04-17T05:26:59.314721+0000","last_undegraded":"2024-04-17T05:26:59.314721+0000","last_fullsized":"2024-04-17T05:26:59.314721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:19:17.442103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316585+0000","last_change":"2024-04-17T05:26:53.234892+0000","last_active":"2024-04-17T05:26:59.316585+0000","last_peered":"2024-04-17T05:26:59.316585+0000","last_clean":"2024-04-17T05:26:59.316585+0000","last_became_active":"2024-04-17T05:26:53.234582+0000","last_became_peered":"2024-04-17T05:26:53.234582+0000","last_unstale":"2024-04-17T05:26:59.316585+0000","last_undegraded":"2024-04-17T05:26:59.316585+0000","last_fullsized":"2024-04-17T05:26:59.316585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:48:56.352270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274951+0000","last_change":"2024-04-17T05:26:53.245242+0000","last_active":"2024-04-17T05:26:58.274951+0000","last_peered":"2024-04-17T05:26:58.274951+0000","last_clean":"2024-04-17T05:26:58.274951+0000","last_became_active":"2024-04-17T05:26:53.244910+0000","last_became_peered":"2024-04-17T05:26:53.244910+0000","last_unstale":"2024-04-17T05:26:58.274951+0000","last_undegraded":"2024-04-17T05:26:58.274951+0000","last_fullsized":"2024-04-17T05:26:58.274951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:45:55.350158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.275241+0000","last_change":"2024-04-17T05:26:53.240582+0000","last_active":"2024-04-17T05:26:58.275241+0000","last_peered":"2024-04-17T05:26:58.275241+0000","last_clean":"2024-04-17T05:26:58.275241+0000","last_became_active":"2024-04-17T05:26:53.240184+0000","last_became_peered":"2024-04-17T05:26:53.240184+0000","last_unstale":"2024-04-17T05:26:58.275241+0000","last_undegraded":"2024-04-17T05:26:58.275241+0000","last_fullsized":"2024-04-17T05:26:58.275241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:32:25.337967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273189+0000","last_change":"2024-04-17T05:26:53.236750+0000","last_active":"2024-04-17T05:26:58.273189+0000","last_peered":"2024-04-17T05:26:58.273189+0000","last_clean":"2024-04-17T05:26:58.273189+0000","last_became_active":"2024-04-17T05:26:53.236386+0000","last_became_peered":"2024-04-17T05:26:53.236386+0000","last_unstale":"2024-04-17T05:26:58.273189+0000","last_undegraded":"2024-04-17T05:26:58.273189+0000","last_fullsized":"2024-04-17T05:26:58.273189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:19:17.442103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.275168+0000","last_change":"2024-04-17T05:26:53.242520+0000","last_active":"2024-04-17T05:26:58.275168+0000","last_peered":"2024-04-17T05:26:58.275168+0000","last_clean":"2024-04-17T05:26:58.275168+0000","last_became_active":"2024-04-17T05:26:53.242213+0000","last_became_peered":"2024-04-17T05:26:53.242213+0000","last_unstale":"2024-04-17T05:26:58.275168+0000","last_undegraded":"2024-04-17T05:26:58.275168+0000","last_fullsized":"2024-04-17T05:26:58.275168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:32.131344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313663+0000","last_change":"2024-04-17T05:26:53.230464+0000","last_active":"2024-04-17T05:26:59.313663+0000","last_peered":"2024-04-17T05:26:59.313663+0000","last_clean":"2024-04-17T05:26:59.313663+0000","last_became_active":"2024-04-17T05:26:53.230146+0000","last_became_peered":"2024-04-17T05:26:53.230146+0000","last_unstale":"2024-04-17T05:26:59.313663+0000","last_undegraded":"2024-04-17T05:26:59.313663+0000","last_fullsized":"2024-04-17T05:26:59.313663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:20:19.035658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315881+0000","last_change":"2024-04-17T05:26:53.252592+0000","last_active":"2024-04-17T05:26:59.315881+0000","last_peered":"2024-04-17T05:26:59.315881+0000","last_clean":"2024-04-17T05:26:59.315881+0000","last_became_active":"2024-04-17T05:26:53.252280+0000","last_became_peered":"2024-04-17T05:26:53.252280+0000","last_unstale":"2024-04-17T05:26:59.315881+0000","last_undegraded":"2024-04-17T05:26:59.315881+0000","last_fullsized":"2024-04-17T05:26:59.315881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:47:18.182576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317653+0000","last_change":"2024-04-17T05:26:53.242405+0000","last_active":"2024-04-17T05:26:59.317653+0000","last_peered":"2024-04-17T05:26:59.317653+0000","last_clean":"2024-04-17T05:26:59.317653+0000","last_became_active":"2024-04-17T05:26:53.242046+0000","last_became_peered":"2024-04-17T05:26:53.242046+0000","last_unstale":"2024-04-17T05:26:59.317653+0000","last_undegraded":"2024-04-17T05:26:59.317653+0000","last_fullsized":"2024-04-17T05:26:59.317653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:25:09.244149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317256+0000","last_change":"2024-04-17T05:26:53.228029+0000","last_active":"2024-04-17T05:26:59.317256+0000","last_peered":"2024-04-17T05:26:59.317256+0000","last_clean":"2024-04-17T05:26:59.317256+0000","last_became_active":"2024-04-17T05:26:53.227572+0000","last_became_peered":"2024-04-17T05:26:53.227572+0000","last_unstale":"2024-04-17T05:26:59.317256+0000","last_undegraded":"2024-04-17T05:26:59.317256+0000","last_fullsized":"2024-04-17T05:26:59.317256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:27.032116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.280108+0000","last_change":"2024-04-17T05:26:53.226283+0000","last_active":"2024-04-17T05:26:58.280108+0000","last_peered":"2024-04-17T05:26:58.280108+0000","last_clean":"2024-04-17T05:26:58.280108+0000","last_became_active":"2024-04-17T05:26:53.225983+0000","last_became_peered":"2024-04-17T05:26:53.225983+0000","last_unstale":"2024-04-17T05:26:58.280108+0000","last_undegraded":"2024-04-17T05:26:58.280108+0000","last_fullsized":"2024-04-17T05:26:58.280108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:40:51.044161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274421+0000","last_change":"2024-04-17T05:26:53.230256+0000","last_active":"2024-04-17T05:26:58.274421+0000","last_peered":"2024-04-17T05:26:58.274421+0000","last_clean":"2024-04-17T05:26:58.274421+0000","last_became_active":"2024-04-17T05:26:53.229888+0000","last_became_peered":"2024-04-17T05:26:53.229888+0000","last_unstale":"2024-04-17T05:26:58.274421+0000","last_undegraded":"2024-04-17T05:26:58.274421+0000","last_fullsized":"2024-04-17T05:26:58.274421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:45:55.350158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.314103+0000","last_change":"2024-04-17T05:26:53.211199+0000","last_active":"2024-04-17T05:26:59.314103+0000","last_peered":"2024-04-17T05:26:59.314103+0000","last_clean":"2024-04-17T05:26:59.314103+0000","last_became_active":"2024-04-17T05:26:53.208394+0000","last_became_peered":"2024-04-17T05:26:53.208394+0000","last_unstale":"2024-04-17T05:26:59.314103+0000","last_undegraded":"2024-04-17T05:26:59.314103+0000","last_fullsized":"2024-04-17T05:26:59.314103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:20:19.035658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.313253+0000","last_change":"2024-04-17T05:26:53.224930+0000","last_active":"2024-04-17T05:26:59.313253+0000","last_peered":"2024-04-17T05:26:59.313253+0000","last_clean":"2024-04-17T05:26:59.313253+0000","last_became_active":"2024-04-17T05:26:53.224314+0000","last_became_peered":"2024-04-17T05:26:53.224314+0000","last_unstale":"2024-04-17T05:26:59.313253+0000","last_undegraded":"2024-04-17T05:26:59.313253+0000","last_fullsized":"2024-04-17T05:26:59.313253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:00:05.875990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.273858+0000","last_change":"2024-04-17T05:26:53.234152+0000","last_active":"2024-04-17T05:26:58.273858+0000","last_peered":"2024-04-17T05:26:58.273858+0000","last_clean":"2024-04-17T05:26:58.273858+0000","last_became_active":"2024-04-17T05:26:53.233885+0000","last_became_peered":"2024-04-17T05:26:53.233885+0000","last_unstale":"2024-04-17T05:26:58.273858+0000","last_undegraded":"2024-04-17T05:26:58.273858+0000","last_fullsized":"2024-04-17T05:26:58.273858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:20:19.035658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.277926+0000","last_change":"2024-04-17T05:26:53.233213+0000","last_active":"2024-04-17T05:26:58.277926+0000","last_peered":"2024-04-17T05:26:58.277926+0000","last_clean":"2024-04-17T05:26:58.277926+0000","last_became_active":"2024-04-17T05:26:53.232809+0000","last_became_peered":"2024-04-17T05:26:53.232809+0000","last_unstale":"2024-04-17T05:26:58.277926+0000","last_undegraded":"2024-04-17T05:26:58.277926+0000","last_fullsized":"2024-04-17T05:26:58.277926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:44.057838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316496+0000","last_change":"2024-04-17T05:26:53.245453+0000","last_active":"2024-04-17T05:26:59.316496+0000","last_peered":"2024-04-17T05:26:59.316496+0000","last_clean":"2024-04-17T05:26:59.316496+0000","last_became_active":"2024-04-17T05:26:53.245051+0000","last_became_peered":"2024-04-17T05:26:53.245051+0000","last_unstale":"2024-04-17T05:26:59.316496+0000","last_undegraded":"2024-04-17T05:26:59.316496+0000","last_fullsized":"2024-04-17T05:26:59.316496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:44:40.424363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.316508+0000","last_change":"2024-04-17T05:26:53.241934+0000","last_active":"2024-04-17T05:26:59.316508+0000","last_peered":"2024-04-17T05:26:59.316508+0000","last_clean":"2024-04-17T05:26:59.316508+0000","last_became_active":"2024-04-17T05:26:53.241108+0000","last_became_peered":"2024-04-17T05:26:53.241108+0000","last_unstale":"2024-04-17T05:26:59.316508+0000","last_undegraded":"2024-04-17T05:26:59.316508+0000","last_fullsized":"2024-04-17T05:26:59.316508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:53:43.076144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.318239+0000","last_change":"2024-04-17T05:26:53.248438+0000","last_active":"2024-04-17T05:26:59.318239+0000","last_peered":"2024-04-17T05:26:59.318239+0000","last_clean":"2024-04-17T05:26:59.318239+0000","last_became_active":"2024-04-17T05:26:53.247746+0000","last_became_peered":"2024-04-17T05:26:53.247746+0000","last_unstale":"2024-04-17T05:26:59.318239+0000","last_undegraded":"2024-04-17T05:26:59.318239+0000","last_fullsized":"2024-04-17T05:26:59.318239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:28:32.265291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.272812+0000","last_change":"2024-04-17T05:26:53.244109+0000","last_active":"2024-04-17T05:26:58.272812+0000","last_peered":"2024-04-17T05:26:58.272812+0000","last_clean":"2024-04-17T05:26:58.272812+0000","last_became_active":"2024-04-17T05:26:53.243625+0000","last_became_peered":"2024-04-17T05:26:53.243625+0000","last_unstale":"2024-04-17T05:26:58.272812+0000","last_undegraded":"2024-04-17T05:26:58.272812+0000","last_fullsized":"2024-04-17T05:26:58.272812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:07:47.404346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317613+0000","last_change":"2024-04-17T05:26:53.246489+0000","last_active":"2024-04-17T05:26:59.317613+0000","last_peered":"2024-04-17T05:26:59.317613+0000","last_clean":"2024-04-17T05:26:59.317613+0000","last_became_active":"2024-04-17T05:26:53.246286+0000","last_became_peered":"2024-04-17T05:26:53.246286+0000","last_unstale":"2024-04-17T05:26:59.317613+0000","last_undegraded":"2024-04-17T05:26:59.317613+0000","last_fullsized":"2024-04-17T05:26:59.317613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:45.658070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.274944+0000","last_change":"2024-04-17T05:26:53.229115+0000","last_active":"2024-04-17T05:26:58.274944+0000","last_peered":"2024-04-17T05:26:58.274944+0000","last_clean":"2024-04-17T05:26:58.274944+0000","last_became_active":"2024-04-17T05:26:53.228706+0000","last_became_peered":"2024-04-17T05:26:53.228706+0000","last_unstale":"2024-04-17T05:26:58.274944+0000","last_undegraded":"2024-04-17T05:26:58.274944+0000","last_fullsized":"2024-04-17T05:26:58.274944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:19:17.442103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.317096+0000","last_change":"2024-04-17T05:26:53.244961+0000","last_active":"2024-04-17T05:26:59.317096+0000","last_peered":"2024-04-17T05:26:59.317096+0000","last_clean":"2024-04-17T05:26:59.317096+0000","last_became_active":"2024-04-17T05:26:53.244595+0000","last_became_peered":"2024-04-17T05:26:53.244595+0000","last_unstale":"2024-04-17T05:26:59.317096+0000","last_undegraded":"2024-04-17T05:26:59.317096+0000","last_fullsized":"2024-04-17T05:26:59.317096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:13:34.455173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:58.276173+0000","last_change":"2024-04-17T05:26:53.241645+0000","last_active":"2024-04-17T05:26:58.276173+0000","last_peered":"2024-04-17T05:26:58.276173+0000","last_clean":"2024-04-17T05:26:58.276173+0000","last_became_active":"2024-04-17T05:26:53.241292+0000","last_became_peered":"2024-04-17T05:26:53.241292+0000","last_unstale":"2024-04-17T05:26:58.276173+0000","last_undegraded":"2024-04-17T05:26:58.276173+0000","last_fullsized":"2024-04-17T05:26:58.276173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:31:26.820940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315030+0000","last_change":"2024-04-17T05:26:53.221256+0000","last_active":"2024-04-17T05:26:59.315030+0000","last_peered":"2024-04-17T05:26:59.315030+0000","last_clean":"2024-04-17T05:26:59.315030+0000","last_became_active":"2024-04-17T05:26:53.220445+0000","last_became_peered":"2024-04-17T05:26:53.220445+0000","last_unstale":"2024-04-17T05:26:59.315030+0000","last_undegraded":"2024-04-17T05:26:59.315030+0000","last_fullsized":"2024-04-17T05:26:59.315030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:08:41.870139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315578+0000","last_change":"2024-04-17T05:26:53.214897+0000","last_active":"2024-04-17T05:26:59.315578+0000","last_peered":"2024-04-17T05:26:59.315578+0000","last_clean":"2024-04-17T05:26:59.315578+0000","last_became_active":"2024-04-17T05:26:53.214591+0000","last_became_peered":"2024-04-17T05:26:53.214591+0000","last_unstale":"2024-04-17T05:26:59.315578+0000","last_undegraded":"2024-04-17T05:26:59.315578+0000","last_fullsized":"2024-04-17T05:26:59.315578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:32.131344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-17T05:26:59.315663+0000","last_change":"2024-04-17T05:26:53.248726+0000","last_active":"2024-04-17T05:26:59.315663+0000","last_peered":"2024-04-17T05:26:59.315663+0000","last_clean":"2024-04-17T05:26:59.315663+0000","last_became_active":"2024-04-17T05:26:53.248143+0000","last_became_peered":"2024-04-17T05:26:53.248143+0000","last_unstale":"2024-04-17T05:26:59.315663+0000","last_undegraded":"2024-04-17T05:26:59.315663+0000","last_fullsized":"2024-04-17T05:26:59.315663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:02:51.306764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":872448,"data_stored":699106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542155,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":111998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542156,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":108246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":108282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542157,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":111998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":108156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542156,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":108316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":880640,"data_stored":699162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T05:27:26.941 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-17T05:27:26.941 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-17T05:27:26.942 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-17T05:27:26.942 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-17T05:27:27.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.187+0000 7f9c09000640 1 Processor -- start 2024-04-17T05:27:27.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.187+0000 7f9c09000640 1 -- start start 2024-04-17T05:27:27.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.189+0000 7f9c09000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c040ba6a0 0x7f9c040b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:27.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.189+0000 7f9c09000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9c04141a00 0x7f9c04141e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:27.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.189+0000 7f9c09000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c04148240 con 0x7f9c040b9a80 2024-04-17T05:27:27.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.189+0000 7f9c09000640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f9c040b5e10 con 0x7f9c04141a00 2024-04-17T05:27:27.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.189+0000 7f9c09000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f9c040b71d0 con 0x7f9c040ba6a0 2024-04-17T05:27:27.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.189+0000 7f9c03e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9c04141a00 0x7f9c04141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:27.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.189+0000 7f9c03e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9c04141a00 0x7f9c04141e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42514/0 (socket says 172.21.15.123:42514) 2024-04-17T05:27:27.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.189+0000 7f9c03e00640 1 -- 172.21.15.123:0/1724662138 learned_addr learned my addr 172.21.15.123:0/1724662138 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:27.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.189+0000 7f9c03400640 1 --2- 172.21.15.123:0/1724662138 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c040ba6a0 0x7f9c040b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:27.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.190+0000 7f9c03e00640 1 -- 172.21.15.123:0/1724662138 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c040ba6a0 msgr2=0x7f9c040b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:27.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.190+0000 7f9c03e00640 1 --2- 172.21.15.123:0/1724662138 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c040ba6a0 0x7f9c040b48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:27.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.190+0000 7f9c03e00640 1 -- 172.21.15.123:0/1724662138 >> v1:172.21.15.123:6789/0 conn(0x7f9c040b9a80 legacy=0x7f9c04147b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:27.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.190+0000 7f9c03e00640 1 -- 172.21.15.123:0/1724662138 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c040b57e0 con 0x7f9c04141a00 2024-04-17T05:27:27.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.191+0000 7f9c03e00640 1 --2- 172.21.15.123:0/1724662138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c04141a00 0x7f9c04141e90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc009870 tx=0x7f9bfc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c329e676db2152d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:27.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.191+0000 7f9c02000640 1 -- 172.21.15.123:0/1724662138 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc035020 con 0x7f9c04141a00 2024-04-17T05:27:27.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.191+0000 7f9c02000640 1 -- 172.21.15.123:0/1724662138 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bfc031640 con 0x7f9c04141a00 2024-04-17T05:27:27.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.191+0000 7f9c02000640 1 -- 172.21.15.123:0/1724662138 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc02d040 con 0x7f9c04141a00 2024-04-17T05:27:27.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.191+0000 7f9c09000640 1 -- 172.21.15.123:0/1724662138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c04141a00 msgr2=0x7f9c04141e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:27.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.192+0000 7f9c09000640 1 --2- 172.21.15.123:0/1724662138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c04141a00 0x7f9c04141e90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc009870 tx=0x7f9bfc02b8f0 comp rx=0 tx=0).stop 2024-04-17T05:27:27.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.192+0000 7f9c09000640 1 -- 172.21.15.123:0/1724662138 shutdown_connections 2024-04-17T05:27:27.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.192+0000 7f9c09000640 1 --2- 172.21.15.123:0/1724662138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c04141a00 0x7f9c04141e90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:27.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.192+0000 7f9c09000640 1 --2- 172.21.15.123:0/1724662138 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c040ba6a0 0x7f9c040b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:27.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.192+0000 7f9c09000640 1 -- 172.21.15.123:0/1724662138 >> 172.21.15.123:0/1724662138 conn(0x7f9c0406bda0 msgr2=0x7f9c0406c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:27.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.192+0000 7f9c09000640 1 -- 172.21.15.123:0/1724662138 shutdown_connections 2024-04-17T05:27:27.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.192+0000 7f9c09000640 1 -- 172.21.15.123:0/1724662138 wait complete. 2024-04-17T05:27:27.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.193+0000 7f9c09000640 1 Processor -- start 2024-04-17T05:27:27.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.193+0000 7f9c09000640 1 -- start start 2024-04-17T05:27:27.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.194+0000 7f9c09000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c040b9a80 0x7f9c04144f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:27.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.194+0000 7f9c09000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c040ba6a0 0x7f9c04142b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:27.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.194+0000 7f9c09000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c04141a00 0x7f9c041430b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:27.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.194+0000 7f9c09000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9c040b62a0 con 0x7f9c040ba6a0 2024-04-17T05:27:27.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.194+0000 7f9c09000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9c040b5a80 con 0x7f9c040b9a80 2024-04-17T05:27:27.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.194+0000 7f9c09000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f9c040b6420 con 0x7f9c04141a00 2024-04-17T05:27:27.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.194+0000 7f9c02a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c040ba6a0 0x7f9c04142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:27.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.195+0000 7f9c02a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c040ba6a0 0x7f9c04142b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42524/0 (socket says 172.21.15.123:42524) 2024-04-17T05:27:27.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.195+0000 7f9c02a00640 1 -- 172.21.15.123:0/4187280043 learned_addr learned my addr 172.21.15.123:0/4187280043 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:27.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.195+0000 7f9c03400640 1 --2- 172.21.15.123:0/4187280043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c040b9a80 0x7f9c04144f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:27.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.195+0000 7f9c02a00640 1 -- 172.21.15.123:0/4187280043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c04141a00 msgr2=0x7f9c041430b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:27.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.195+0000 7f9c03e00640 1 --2- 172.21.15.123:0/4187280043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c04141a00 0x7f9c041430b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:27.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.195+0000 7f9c02a00640 1 --2- 172.21.15.123:0/4187280043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c04141a00 0x7f9c041430b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:27.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.195+0000 7f9c02a00640 1 -- 172.21.15.123:0/4187280043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c040b9a80 msgr2=0x7f9c04144f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:27.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.195+0000 7f9c02a00640 1 --2- 172.21.15.123:0/4187280043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c040b9a80 0x7f9c04144f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:27.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.195+0000 7f9c02a00640 1 -- 172.21.15.123:0/4187280043 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c04144530 con 0x7f9c040ba6a0 2024-04-17T05:27:27.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.195+0000 7f9c02a00640 1 --2- 172.21.15.123:0/4187280043 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c040ba6a0 0x7f9c04142b70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9bec00c3c0 tx=0x7f9bec00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:27.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.195+0000 7f9bfb400640 1 -- 172.21.15.123:0/4187280043 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bec0052d0 con 0x7f9c040ba6a0 2024-04-17T05:27:27.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.196+0000 7f9bfb400640 1 -- 172.21.15.123:0/4187280043 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bec005490 con 0x7f9c040ba6a0 2024-04-17T05:27:27.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.196+0000 7f9c09000640 1 -- 172.21.15.123:0/4187280043 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c0413c730 con 0x7f9c040ba6a0 2024-04-17T05:27:27.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.196+0000 7f9bfb400640 1 -- 172.21.15.123:0/4187280043 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bec007260 con 0x7f9c040ba6a0 2024-04-17T05:27:27.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.196+0000 7f9c09000640 1 -- 172.21.15.123:0/4187280043 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c0413b540 con 0x7f9c040ba6a0 2024-04-17T05:27:27.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.197+0000 7f9c09000640 1 -- 172.21.15.123:0/4187280043 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c040759b0 con 0x7f9c040ba6a0 2024-04-17T05:27:27.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.198+0000 7f9bfb400640 1 -- 172.21.15.123:0/4187280043 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9bec007400 con 0x7f9c040ba6a0 2024-04-17T05:27:27.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.199+0000 7f9bfb400640 1 --2- 172.21.15.123:0/4187280043 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f9be006c8f0 0x7f9be006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:27.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.199+0000 7f9bfb400640 1 -- 172.21.15.123:0/4187280043 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9bec08b360 con 0x7f9c040ba6a0 2024-04-17T05:27:27.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.200+0000 7f9c03400640 1 --2- 172.21.15.123:0/4187280043 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f9be006c8f0 0x7f9be006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:27.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.201+0000 7f9c03400640 1 --2- 172.21.15.123:0/4187280043 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f9be006c8f0 0x7f9be006edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9c0413efc0 tx=0x7f9bf40039b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:27.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.204+0000 7f9bfb400640 1 -- 172.21.15.123:0/4187280043 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f9bec059440 con 0x7f9c040ba6a0 2024-04-17T05:27:27.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.438+0000 7f9c09000640 1 -- 172.21.15.123:0/4187280043 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9c0413baa0 con 0x7f9c040ba6a0 2024-04-17T05:27:27.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.439+0000 7f9bfb400640 1 -- 172.21.15.123:0/4187280043 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f9bec058d40 con 0x7f9c040ba6a0 2024-04-17T05:27:27.438 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:27:27.438 INFO:teuthology.orchestra.run.smithi123.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-17T05:27:27.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.441+0000 7f9c09000640 1 -- 172.21.15.123:0/4187280043 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f9be006c8f0 msgr2=0x7f9be006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:27.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.441+0000 7f9c09000640 1 --2- 172.21.15.123:0/4187280043 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f9be006c8f0 0x7f9be006edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9c0413efc0 tx=0x7f9bf40039b0 comp rx=0 tx=0).stop 2024-04-17T05:27:27.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.441+0000 7f9c09000640 1 -- 172.21.15.123:0/4187280043 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c040ba6a0 msgr2=0x7f9c04142b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:27.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.441+0000 7f9c09000640 1 --2- 172.21.15.123:0/4187280043 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c040ba6a0 0x7f9c04142b70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9bec00c3c0 tx=0x7f9bec00c880 comp rx=0 tx=0).stop 2024-04-17T05:27:27.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.442+0000 7f9c09000640 1 -- 172.21.15.123:0/4187280043 shutdown_connections 2024-04-17T05:27:27.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.442+0000 7f9c09000640 1 --2- 172.21.15.123:0/4187280043 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f9be006c8f0 0x7f9be006edb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:27.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.442+0000 7f9c09000640 1 --2- 172.21.15.123:0/4187280043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c04141a00 0x7f9c041430b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:27.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.442+0000 7f9c09000640 1 --2- 172.21.15.123:0/4187280043 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c040ba6a0 0x7f9c04142b70 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:27.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.442+0000 7f9c09000640 1 --2- 172.21.15.123:0/4187280043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c040b9a80 0x7f9c04144f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:27.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.442+0000 7f9c09000640 1 -- 172.21.15.123:0/4187280043 >> 172.21.15.123:0/4187280043 conn(0x7f9c0406bda0 msgr2=0x7f9c040bb2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:27.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.442+0000 7f9c09000640 1 -- 172.21.15.123:0/4187280043 shutdown_connections 2024-04-17T05:27:27.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.442+0000 7f9c09000640 1 -- 172.21.15.123:0/4187280043 wait complete. 2024-04-17T05:27:27.458 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-17T05:27:27.458 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T05:27:27.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.664+0000 7fbd37400640 1 Processor -- start 2024-04-17T05:27:27.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.665+0000 7fbd37400640 1 -- start start 2024-04-17T05:27:27.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.666+0000 7fbd37400640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fbd3009c6d0 0x7fbd300b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:27.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.666+0000 7fbd37400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbd3006d770 0x7fbd3014f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:27.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.666+0000 7fbd37400640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd3009cab0 con 0x7fbd3009d410 2024-04-17T05:27:27.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.666+0000 7fbd37400640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7fbd300ae850 con 0x7fbd3009c6d0 2024-04-17T05:27:27.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.666+0000 7fbd37400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fbd3009d930 con 0x7fbd3006d770 2024-04-17T05:27:27.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.666+0000 7fbd34a00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fbd3009c6d0 0x7fbd300b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:27.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.667+0000 7fbd34a00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fbd3009c6d0 0x7fbd300b53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.123:43124/0 (socket says 172.21.15.123:43124) 2024-04-17T05:27:27.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.667+0000 7fbd34a00640 1 -- 172.21.15.123:0/1307012420 learned_addr learned my addr 172.21.15.123:0/1307012420 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:27.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.667+0000 7fbd35400640 1 --2- 172.21.15.123:0/1307012420 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbd3006d770 0x7fbd3014f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:27.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.667+0000 7fbd34a00640 1 -- 172.21.15.123:0/1307012420 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbd3006d770 msgr2=0x7fbd3014f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:27.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.667+0000 7fbd34a00640 1 --2- 172.21.15.123:0/1307012420 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbd3006d770 0x7fbd3014f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:27.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.667+0000 7fbd34a00640 1 -- 172.21.15.123:0/1307012420 >> v1:172.21.15.164:6789/0 conn(0x7fbd3009d410 legacy=0x7fbd3006d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:27.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.667+0000 7fbd34a00640 1 -- 172.21.15.123:0/1307012420 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd3009dc10 con 0x7fbd3009c6d0 2024-04-17T05:27:27.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.669+0000 7fbd34a00640 1 --2- 172.21.15.123:0/1307012420 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd3009c6d0 0x7fbd300b53a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbd20009870 tx=0x7fbd2002b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c693ff7922862028 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:27.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.669+0000 7fbd2fe00640 1 -- 172.21.15.123:0/1307012420 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd200317c0 con 0x7fbd3009c6d0 2024-04-17T05:27:27.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.669+0000 7fbd2fe00640 1 -- 172.21.15.123:0/1307012420 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd20037070 con 0x7fbd3009c6d0 2024-04-17T05:27:27.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.669+0000 7fbd2fe00640 1 -- 172.21.15.123:0/1307012420 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd20031b80 con 0x7fbd3009c6d0 2024-04-17T05:27:27.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.670+0000 7fbd37400640 1 -- 172.21.15.123:0/1307012420 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd3009c6d0 msgr2=0x7fbd300b53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:27.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.670+0000 7fbd37400640 1 --2- 172.21.15.123:0/1307012420 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd3009c6d0 0x7fbd300b53a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbd20009870 tx=0x7fbd2002b860 comp rx=0 tx=0).stop 2024-04-17T05:27:27.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.670+0000 7fbd37400640 1 -- 172.21.15.123:0/1307012420 shutdown_connections 2024-04-17T05:27:27.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.670+0000 7fbd37400640 1 --2- 172.21.15.123:0/1307012420 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbd3006d770 0x7fbd3014f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:27.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.670+0000 7fbd37400640 1 --2- 172.21.15.123:0/1307012420 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd3009c6d0 0x7fbd300b53a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:27.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.670+0000 7fbd37400640 1 -- 172.21.15.123:0/1307012420 >> 172.21.15.123:0/1307012420 conn(0x7fbd300b93b0 msgr2=0x7fbd300b97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:27.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.670+0000 7fbd37400640 1 -- 172.21.15.123:0/1307012420 shutdown_connections 2024-04-17T05:27:27.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.670+0000 7fbd37400640 1 -- 172.21.15.123:0/1307012420 wait complete. 2024-04-17T05:27:27.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.672+0000 7fbd37400640 1 Processor -- start 2024-04-17T05:27:27.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.672+0000 7fbd37400640 1 -- start start 2024-04-17T05:27:27.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.673+0000 7fbd37400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbd3006d770 0x7fbd30140e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:27.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.673+0000 7fbd37400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd3009c6d0 0x7fbd3013d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:27.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.673+0000 7fbd37400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd3009d410 0x7fbd3013c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:27.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.673+0000 7fbd37400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbd300b5bf0 con 0x7fbd3009d410 2024-04-17T05:27:27.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.673+0000 7fbd37400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fbd300b58e0 con 0x7fbd3009c6d0 2024-04-17T05:27:27.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.673+0000 7fbd37400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fbd30148130 con 0x7fbd3006d770 2024-04-17T05:27:27.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.673+0000 7fbd35400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd3009d410 0x7fbd3013c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:27.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.673+0000 7fbd35400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd3009d410 0x7fbd3013c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42536/0 (socket says 172.21.15.123:42536) 2024-04-17T05:27:27.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.673+0000 7fbd35400640 1 -- 172.21.15.123:0/415276436 learned_addr learned my addr 172.21.15.123:0/415276436 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:27.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.673+0000 7fbd34a00640 1 --2- 172.21.15.123:0/415276436 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbd3006d770 0x7fbd30140e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:27.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.673+0000 7fbd27e00640 1 --2- 172.21.15.123:0/415276436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd3009c6d0 0x7fbd3013d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:27.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.673+0000 7fbd35400640 1 -- 172.21.15.123:0/415276436 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbd3006d770 msgr2=0x7fbd30140e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:27.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.673+0000 7fbd35400640 1 --2- 172.21.15.123:0/415276436 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbd3006d770 0x7fbd30140e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:27.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.673+0000 7fbd35400640 1 -- 172.21.15.123:0/415276436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd3009c6d0 msgr2=0x7fbd3013d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:27.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.673+0000 7fbd35400640 1 --2- 172.21.15.123:0/415276436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd3009c6d0 0x7fbd3013d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:27.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.673+0000 7fbd35400640 1 -- 172.21.15.123:0/415276436 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd3013bfa0 con 0x7fbd3009d410 2024-04-17T05:27:27.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.674+0000 7fbd34a00640 1 --2- 172.21.15.123:0/415276436 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbd3006d770 0x7fbd30140e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:27.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.674+0000 7fbd35400640 1 --2- 172.21.15.123:0/415276436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd3009d410 0x7fbd3013c3e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbd28009dd0 tx=0x7fbd2800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:27.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.674+0000 7fbd2d600640 1 -- 172.21.15.123:0/415276436 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd28018020 con 0x7fbd3009d410 2024-04-17T05:27:27.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.674+0000 7fbd2d600640 1 -- 172.21.15.123:0/415276436 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd28014480 con 0x7fbd3009d410 2024-04-17T05:27:27.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.674+0000 7fbd37400640 1 -- 172.21.15.123:0/415276436 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd3013ce80 con 0x7fbd3009d410 2024-04-17T05:27:27.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.674+0000 7fbd2d600640 1 -- 172.21.15.123:0/415276436 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd28014870 con 0x7fbd3009d410 2024-04-17T05:27:27.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.674+0000 7fbd37400640 1 -- 172.21.15.123:0/415276436 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd30144030 con 0x7fbd3009d410 2024-04-17T05:27:27.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.676+0000 7fbd37400640 1 -- 172.21.15.123:0/415276436 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd30068a40 con 0x7fbd3009d410 2024-04-17T05:27:27.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.676+0000 7fbd2d600640 1 -- 172.21.15.123:0/415276436 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbd28005d10 con 0x7fbd3009d410 2024-04-17T05:27:27.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.678+0000 7fbd2d600640 1 --2- 172.21.15.123:0/415276436 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fbd0c06c8f0 0x7fbd0c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:27.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.678+0000 7fbd2d600640 1 -- 172.21.15.123:0/415276436 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fbd2808c900 con 0x7fbd3009d410 2024-04-17T05:27:27.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.678+0000 7fbd34a00640 1 --2- 172.21.15.123:0/415276436 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fbd0c06c8f0 0x7fbd0c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:27.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.680+0000 7fbd34a00640 1 --2- 172.21.15.123:0/415276436 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fbd0c06c8f0 0x7fbd0c06edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbd20036000 tx=0x7fbd20008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:27.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.682+0000 7fbd2d600640 1 -- 172.21.15.123:0/415276436 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fbd28022070 con 0x7fbd3009d410 2024-04-17T05:27:27.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.882+0000 7fbd37400640 1 -- 172.21.15.123:0/415276436 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbd3006e100 con 0x7fbd3009d410 2024-04-17T05:27:27.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.886+0000 7fbd2d600640 1 -- 172.21.15.123:0/415276436 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18526 (secure 0 0 0) 0x7fbd28010040 con 0x7fbd3009d410 2024-04-17T05:27:27.885 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:27:27.885 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":26,"fsid":"0787c5c0-e77a-4102-a899-30db48b19c68","created":"2024-04-17T05:26:33.031507+0000","modified":"2024-04-17T05:26:57.743352+0000","last_up_change":"2024-04-17T05:26:44.988433+0000","last_in_change":"2024-04-17T05:26:36.682131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T05:26:46.329778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T05:26:50.600195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T05:26:51.626498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T05:26:55.264044+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15c87cdb-9415-45a6-a2a6-ea6bec9daece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6801","nonce":840753170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6803","nonce":840753170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6807","nonce":840753170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6805","nonce":840753170}]},"public_addr":"172.21.15.123:6801/840753170","cluster_addr":"172.21.15.123:6803/840753170","heartbeat_back_addr":"172.21.15.123:6807/840753170","heartbeat_front_addr":"172.21.15.123:6805/840753170","state":["exists","up"]},{"osd":1,"uuid":"281751b5-486d-4845-b4aa-b308bf7cec62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6822","nonce":2231878927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6827","nonce":2231878927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6831","nonce":2231878927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6829","nonce":2231878927}]},"public_addr":"172.21.15.123:6822/2231878927","cluster_addr":"172.21.15.123:6827/2231878927","heartbeat_back_addr":"172.21.15.123:6831/2231878927","heartbeat_front_addr":"172.21.15.123:6829/2231878927","state":["exists","up"]},{"osd":2,"uuid":"b42257d3-bd20-4db5-aa37-1bf5c512d0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6817","nonce":754360844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6820","nonce":754360844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6825","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6826","nonce":754360844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6823","nonce":754360844}]},"public_addr":"172.21.15.123:6817/754360844","cluster_addr":"172.21.15.123:6820/754360844","heartbeat_back_addr":"172.21.15.123:6826/754360844","heartbeat_front_addr":"172.21.15.123:6823/754360844","state":["exists","up"]},{"osd":3,"uuid":"0f26b891-bbe6-478e-8dee-78e69bb48cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6809","nonce":2898088574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6811","nonce":2898088574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6815","nonce":2898088574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6813","nonce":2898088574}]},"public_addr":"172.21.15.123:6809/2898088574","cluster_addr":"172.21.15.123:6811/2898088574","heartbeat_back_addr":"172.21.15.123:6815/2898088574","heartbeat_front_addr":"172.21.15.123:6813/2898088574","state":["exists","up"]},{"osd":4,"uuid":"43e59318-2740-4625-9d64-eec1fd43c322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6801","nonce":606484349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6804","nonce":606484349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6812","nonce":606484349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6808","nonce":606484349}]},"public_addr":"172.21.15.164:6801/606484349","cluster_addr":"172.21.15.164:6804/606484349","heartbeat_back_addr":"172.21.15.164:6812/606484349","heartbeat_front_addr":"172.21.15.164:6808/606484349","state":["exists","up"]},{"osd":5,"uuid":"aaa3acf4-4adc-4337-aba3-363851d35310","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6805","nonce":1376989593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6809","nonce":1376989593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6815","nonce":1376989593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6813","nonce":1376989593}]},"public_addr":"172.21.15.164:6805/1376989593","cluster_addr":"172.21.15.164:6809/1376989593","heartbeat_back_addr":"172.21.15.164:6815/1376989593","heartbeat_front_addr":"172.21.15.164:6813/1376989593","state":["exists","up"]},{"osd":6,"uuid":"6f765b27-7377-4d81-9192-23a965651145","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6817","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6821","nonce":1594306924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6823","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6826","nonce":1594306924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6831","nonce":1594306924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6829","nonce":1594306924}]},"public_addr":"172.21.15.164:6821/1594306924","cluster_addr":"172.21.15.164:6826/1594306924","heartbeat_back_addr":"172.21.15.164:6831/1594306924","heartbeat_front_addr":"172.21.15.164:6829/1594306924","state":["exists","up"]},{"osd":7,"uuid":"5547394b-ec2f-4311-846d-369af4b1acf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6818","nonce":295402697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6819","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6820","nonce":295402697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6825","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6827","nonce":295402697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6824","nonce":295402697}]},"public_addr":"172.21.15.164:6818/295402697","cluster_addr":"172.21.15.164:6820/295402697","heartbeat_back_addr":"172.21.15.164:6827/295402697","heartbeat_front_addr":"172.21.15.164:6824/295402697","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.034807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.022201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.751897+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.850533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.083608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.047524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.314753+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.413586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T05:27:27.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.888+0000 7fbd37400640 1 -- 172.21.15.123:0/415276436 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fbd0c06c8f0 msgr2=0x7fbd0c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:27.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.888+0000 7fbd37400640 1 --2- 172.21.15.123:0/415276436 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fbd0c06c8f0 0x7fbd0c06edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbd20036000 tx=0x7fbd20008030 comp rx=0 tx=0).stop 2024-04-17T05:27:27.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.888+0000 7fbd37400640 1 -- 172.21.15.123:0/415276436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd3009d410 msgr2=0x7fbd3013c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:27.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.888+0000 7fbd37400640 1 --2- 172.21.15.123:0/415276436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd3009d410 0x7fbd3013c3e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbd28009dd0 tx=0x7fbd2800c490 comp rx=0 tx=0).stop 2024-04-17T05:27:27.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.889+0000 7fbd37400640 1 -- 172.21.15.123:0/415276436 shutdown_connections 2024-04-17T05:27:27.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.889+0000 7fbd37400640 1 --2- 172.21.15.123:0/415276436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd3009d410 0x7fbd3013c3e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:27.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.889+0000 7fbd37400640 1 --2- 172.21.15.123:0/415276436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd3009c6d0 0x7fbd3013d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:27.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.889+0000 7fbd37400640 1 --2- 172.21.15.123:0/415276436 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fbd0c06c8f0 0x7fbd0c06edb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:27.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.889+0000 7fbd37400640 1 --2- 172.21.15.123:0/415276436 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbd3006d770 0x7fbd30140e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:27.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.889+0000 7fbd37400640 1 -- 172.21.15.123:0/415276436 >> 172.21.15.123:0/415276436 conn(0x7fbd300b93b0 msgr2=0x7fbd30073920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:27.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.889+0000 7fbd37400640 1 -- 172.21.15.123:0/415276436 shutdown_connections 2024-04-17T05:27:27.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:27.889+0000 7fbd37400640 1 -- 172.21.15.123:0/415276436 wait complete. 2024-04-17T05:27:27.907 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T05:26:46.329778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T05:26:50.600195+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T05:26:51.626498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T05:26:55.264044+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T05:27:27.907 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T05:27:28.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.115+0000 7fa977600640 1 Processor -- start 2024-04-17T05:27:28.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.116+0000 7fa977600640 1 -- start start 2024-04-17T05:27:28.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.117+0000 7fa977600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa9700b9b20 0x7fa9700b7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:28.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.117+0000 7fa977600640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa97014c3e0 con 0x7fa9700b7ee0 2024-04-17T05:27:28.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.117+0000 7fa977600640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa97006d870 con 0x7fa9700b8390 2024-04-17T05:27:28.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.117+0000 7fa977600640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fa9700b8800 con 0x7fa9700b9b20 2024-04-17T05:27:28.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.117+0000 7fa974c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa9700b9b20 0x7fa9700b7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:28.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.117+0000 7fa967e00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa9700b7ee0 0x7fa97014b5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47830/0 (socket says 172.21.15.123:47830) 2024-04-17T05:27:28.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.117+0000 7fa967e00640 1 -- 172.21.15.123:0/622642033 learned_addr learned my addr 172.21.15.123:0/622642033 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:27:28.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.118+0000 7fa974c00640 1 -- 172.21.15.123:0/622642033 >> v1:172.21.15.164:6789/0 conn(0x7fa9700b8390 legacy=0x7fa97014bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:28.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.118+0000 7fa974c00640 1 -- 172.21.15.123:0/622642033 >> v1:172.21.15.123:6789/0 conn(0x7fa9700b7ee0 legacy=0x7fa97014b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:28.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.118+0000 7fa974c00640 1 -- 172.21.15.123:0/622642033 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9700b9f00 con 0x7fa9700b9b20 2024-04-17T05:27:28.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.118+0000 7fa96fe00640 1 -- 172.21.15.123:0/622642033 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3435909778 0 0) 0x7fa97014c3e0 con 0x7fa9700b7ee0 2024-04-17T05:27:28.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.119+0000 7fa974c00640 1 --2- 172.21.15.123:0/622642033 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9700b9b20 0x7fa9700b7290 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa9600097a0 tx=0x7fa96002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e82590145399a20a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:28.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.119+0000 7fa96fe00640 1 -- 172.21.15.123:0/622642033 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa960035020 con 0x7fa9700b9b20 2024-04-17T05:27:28.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.119+0000 7fa96fe00640 1 -- 172.21.15.123:0/622642033 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa960031830 con 0x7fa9700b9b20 2024-04-17T05:27:28.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.119+0000 7fa96fe00640 1 -- 172.21.15.123:0/622642033 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa960031c00 con 0x7fa9700b9b20 2024-04-17T05:27:28.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.120+0000 7fa977600640 1 -- 172.21.15.123:0/622642033 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9700b9b20 msgr2=0x7fa9700b7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:28.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.120+0000 7fa977600640 1 --2- 172.21.15.123:0/622642033 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9700b9b20 0x7fa9700b7290 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa9600097a0 tx=0x7fa96002b8d0 comp rx=0 tx=0).stop 2024-04-17T05:27:28.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.120+0000 7fa977600640 1 -- 172.21.15.123:0/622642033 shutdown_connections 2024-04-17T05:27:28.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.120+0000 7fa977600640 1 --2- 172.21.15.123:0/622642033 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9700b9b20 0x7fa9700b7290 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:28.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.120+0000 7fa977600640 1 -- 172.21.15.123:0/622642033 >> 172.21.15.123:0/622642033 conn(0x7fa97006bda0 msgr2=0x7fa97006c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:28.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.120+0000 7fa977600640 1 -- 172.21.15.123:0/622642033 shutdown_connections 2024-04-17T05:27:28.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.120+0000 7fa977600640 1 -- 172.21.15.123:0/622642033 wait complete. 2024-04-17T05:27:28.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.121+0000 7fa977600640 1 Processor -- start 2024-04-17T05:27:28.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.121+0000 7fa977600640 1 -- start start 2024-04-17T05:27:28.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.122+0000 7fa977600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9700b7ee0 0x7fa9700b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:28.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.122+0000 7fa977600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9700b8390 0x7fa9701e1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:28.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.122+0000 7fa977600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9700b9b20 0x7fa9701e17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:28.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.122+0000 7fa977600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa9700b43c0 con 0x7fa9700b9b20 2024-04-17T05:27:28.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.122+0000 7fa977600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fa97006de80 con 0x7fa9700b7ee0 2024-04-17T05:27:28.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.122+0000 7fa977600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fa9700b6c90 con 0x7fa9700b8390 2024-04-17T05:27:28.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.123+0000 7fa975600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9700b9b20 0x7fa9701e17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:28.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.123+0000 7fa975600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9700b9b20 0x7fa9701e17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42558/0 (socket says 172.21.15.123:42558) 2024-04-17T05:27:28.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.123+0000 7fa975600640 1 -- 172.21.15.123:0/2919214936 learned_addr learned my addr 172.21.15.123:0/2919214936 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:28.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.123+0000 7fa974c00640 1 --2- 172.21.15.123:0/2919214936 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9700b7ee0 0x7fa9700b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:28.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.123+0000 7fa967e00640 1 --2- 172.21.15.123:0/2919214936 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9700b8390 0x7fa9701e1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:28.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.123+0000 7fa975600640 1 -- 172.21.15.123:0/2919214936 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9700b8390 msgr2=0x7fa9701e1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:28.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.123+0000 7fa975600640 1 --2- 172.21.15.123:0/2919214936 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9700b8390 0x7fa9701e1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:28.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.123+0000 7fa975600640 1 -- 172.21.15.123:0/2919214936 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9700b7ee0 msgr2=0x7fa9700b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:28.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.123+0000 7fa975600640 1 --2- 172.21.15.123:0/2919214936 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9700b7ee0 0x7fa9700b2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:28.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.123+0000 7fa975600640 1 -- 172.21.15.123:0/2919214936 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9700b1980 con 0x7fa9700b9b20 2024-04-17T05:27:28.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.123+0000 7fa975600640 1 --2- 172.21.15.123:0/2919214936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9700b9b20 0x7fa9701e17b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa96800c780 tx=0x7fa96800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:28.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.124+0000 7fa96d600640 1 -- 172.21.15.123:0/2919214936 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa968004b10 con 0x7fa9700b9b20 2024-04-17T05:27:28.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.124+0000 7fa96d600640 1 -- 172.21.15.123:0/2919214936 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa968004cb0 con 0x7fa9700b9b20 2024-04-17T05:27:28.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.124+0000 7fa96d600640 1 -- 172.21.15.123:0/2919214936 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96800aa90 con 0x7fa9700b9b20 2024-04-17T05:27:28.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.124+0000 7fa977600640 1 -- 172.21.15.123:0/2919214936 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9700b1c00 con 0x7fa9700b9b20 2024-04-17T05:27:28.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.124+0000 7fa977600640 1 -- 172.21.15.123:0/2919214936 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9700b2480 con 0x7fa9700b9b20 2024-04-17T05:27:28.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.125+0000 7fa977600640 1 -- 172.21.15.123:0/2919214936 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9701e0f70 con 0x7fa9700b9b20 2024-04-17T05:27:28.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.126+0000 7fa96d600640 1 -- 172.21.15.123:0/2919214936 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa96800ac30 con 0x7fa9700b9b20 2024-04-17T05:27:28.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.127+0000 7fa96d600640 1 --2- 172.21.15.123:0/2919214936 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fa94c06c8f0 0x7fa94c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:28.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.127+0000 7fa96d600640 1 -- 172.21.15.123:0/2919214936 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa96808c310 con 0x7fa9700b9b20 2024-04-17T05:27:28.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.127+0000 7fa974c00640 1 --2- 172.21.15.123:0/2919214936 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fa94c06c8f0 0x7fa94c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:28.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.128+0000 7fa974c00640 1 --2- 172.21.15.123:0/2919214936 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fa94c06c8f0 0x7fa94c06edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa960036000 tx=0x7fa96003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:28.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.131+0000 7fa96d600640 1 -- 172.21.15.123:0/2919214936 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fa9701e0f70 con 0x7fa9700b9b20 2024-04-17T05:27:28.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.317+0000 7fa977600640 1 -- 172.21.15.123:0/2919214936 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa970075bd0 con 0x7fa9700b9b20 2024-04-17T05:27:28.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.318+0000 7fa96d600640 1 -- 172.21.15.123:0/2919214936 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fa9700b1980 con 0x7fa9700b9b20 2024-04-17T05:27:28.317 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-04-17T05:27:28.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.321+0000 7fa977600640 1 -- 172.21.15.123:0/2919214936 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fa94c06c8f0 msgr2=0x7fa94c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:28.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.321+0000 7fa977600640 1 --2- 172.21.15.123:0/2919214936 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fa94c06c8f0 0x7fa94c06edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa960036000 tx=0x7fa96003c040 comp rx=0 tx=0).stop 2024-04-17T05:27:28.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.321+0000 7fa977600640 1 -- 172.21.15.123:0/2919214936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9700b9b20 msgr2=0x7fa9701e17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:28.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.321+0000 7fa977600640 1 --2- 172.21.15.123:0/2919214936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9700b9b20 0x7fa9701e17b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa96800c780 tx=0x7fa96800cc40 comp rx=0 tx=0).stop 2024-04-17T05:27:28.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.321+0000 7fa977600640 1 -- 172.21.15.123:0/2919214936 shutdown_connections 2024-04-17T05:27:28.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.321+0000 7fa977600640 1 --2- 172.21.15.123:0/2919214936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9700b9b20 0x7fa9701e17b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:28.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.321+0000 7fa977600640 1 --2- 172.21.15.123:0/2919214936 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fa94c06c8f0 0x7fa94c06edb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:28.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.321+0000 7fa977600640 1 --2- 172.21.15.123:0/2919214936 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa9700b8390 0x7fa9701e1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:28.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.321+0000 7fa977600640 1 --2- 172.21.15.123:0/2919214936 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9700b7ee0 0x7fa9700b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:28.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.321+0000 7fa977600640 1 -- 172.21.15.123:0/2919214936 >> 172.21.15.123:0/2919214936 conn(0x7fa97006bda0 msgr2=0x7fa97014be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:28.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.321+0000 7fa977600640 1 -- 172.21.15.123:0/2919214936 shutdown_connections 2024-04-17T05:27:28.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.321+0000 7fa977600640 1 -- 172.21.15.123:0/2919214936 wait complete. 2024-04-17T05:27:28.337 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T05:27:28.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.548+0000 7fdcb9800640 1 Processor -- start 2024-04-17T05:27:28.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.549+0000 7fdcb9800640 1 -- start start 2024-04-17T05:27:28.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.550+0000 7fdcb9800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdcb40b58b0 0x7fdcb40b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:28.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.550+0000 7fdcb9800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdcb40b7e90 0x7fdcb41486a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:28.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.550+0000 7fdcb9800640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcb40b5c90 con 0x7fdcb414b1d0 2024-04-17T05:27:28.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.550+0000 7fdcb9800640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fdcb4148210 con 0x7fdcb40b7e90 2024-04-17T05:27:28.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.550+0000 7fdcb9800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fdcb40b67a0 con 0x7fdcb40b58b0 2024-04-17T05:27:28.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.550+0000 7fdcb2000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdcb40b7e90 0x7fdcb41486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:28.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.550+0000 7fdcb3400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fdcb414b1d0 0x7fdcb414b660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47832/0 (socket says 172.21.15.123:47832) 2024-04-17T05:27:28.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.550+0000 7fdcb3400640 1 -- 172.21.15.123:0/1991296871 learned_addr learned my addr 172.21.15.123:0/1991296871 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:27:28.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.551+0000 7fdcb2a00640 1 --2- 172.21.15.123:0/1991296871 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdcb40b58b0 0x7fdcb40b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:28.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.551+0000 7fdcb2000640 1 -- 172.21.15.123:0/1991296871 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdcb40b58b0 msgr2=0x7fdcb40b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:28.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.551+0000 7fdcb2000640 1 --2- 172.21.15.123:0/1991296871 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdcb40b58b0 0x7fdcb40b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:28.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.551+0000 7fdcb2000640 1 -- 172.21.15.123:0/1991296871 >> v1:172.21.15.123:6789/0 conn(0x7fdcb414b1d0 legacy=0x7fdcb414b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:28.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.551+0000 7fdcb2000640 1 -- 172.21.15.123:0/1991296871 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcb4147be0 con 0x7fdcb40b7e90 2024-04-17T05:27:28.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.551+0000 7fdcb1600640 1 -- 172.21.15.123:0/1991296871 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1029474208 0 0) 0x7fdcb40b5c90 con 0x7fdcb414b1d0 2024-04-17T05:27:28.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.552+0000 7fdcb2000640 1 --2- 172.21.15.123:0/1991296871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcb40b7e90 0x7fdcb41486a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdca00097d0 tx=0x7fdca002b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f566f760a06a006 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:28.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.552+0000 7fdcb1600640 1 -- 172.21.15.123:0/1991296871 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca0031770 con 0x7fdcb40b7e90 2024-04-17T05:27:28.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.552+0000 7fdcb1600640 1 -- 172.21.15.123:0/1991296871 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdca0037070 con 0x7fdcb40b7e90 2024-04-17T05:27:28.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.552+0000 7fdcb1600640 1 -- 172.21.15.123:0/1991296871 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca0031b30 con 0x7fdcb40b7e90 2024-04-17T05:27:28.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.553+0000 7fdcb9800640 1 -- 172.21.15.123:0/1991296871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcb40b7e90 msgr2=0x7fdcb41486a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:28.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.553+0000 7fdcb9800640 1 --2- 172.21.15.123:0/1991296871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcb40b7e90 0x7fdcb41486a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdca00097d0 tx=0x7fdca002b810 comp rx=0 tx=0).stop 2024-04-17T05:27:28.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.553+0000 7fdcb9800640 1 -- 172.21.15.123:0/1991296871 shutdown_connections 2024-04-17T05:27:28.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.553+0000 7fdcb9800640 1 --2- 172.21.15.123:0/1991296871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcb40b7e90 0x7fdcb41486a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:28.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.553+0000 7fdcb9800640 1 --2- 172.21.15.123:0/1991296871 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdcb40b58b0 0x7fdcb40b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:28.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.553+0000 7fdcb9800640 1 -- 172.21.15.123:0/1991296871 >> 172.21.15.123:0/1991296871 conn(0x7fdcb40bd6f0 msgr2=0x7fdcb40bdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:28.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.553+0000 7fdcb9800640 1 -- 172.21.15.123:0/1991296871 shutdown_connections 2024-04-17T05:27:28.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.553+0000 7fdcb9800640 1 -- 172.21.15.123:0/1991296871 wait complete. 2024-04-17T05:27:28.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.555+0000 7fdcb9800640 1 Processor -- start 2024-04-17T05:27:28.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.555+0000 7fdcb9800640 1 -- start start 2024-04-17T05:27:28.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.556+0000 7fdcb9800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdcb40b58b0 0x7fdcb413fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:28.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.556+0000 7fdcb9800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcb40b7e90 0x7fdcb41dd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:28.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.556+0000 7fdcb9800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcb414b1d0 0x7fdcb41dde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:28.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.556+0000 7fdcb9800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb4148be0 con 0x7fdcb414b1d0 2024-04-17T05:27:28.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.556+0000 7fdcb9800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb40b76b0 con 0x7fdcb40b7e90 2024-04-17T05:27:28.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.556+0000 7fdcb9800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fdcb4147ea0 con 0x7fdcb40b58b0 2024-04-17T05:27:28.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.556+0000 7fdcb3400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcb414b1d0 0x7fdcb41dde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:28.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.556+0000 7fdcb3400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcb414b1d0 0x7fdcb41dde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42574/0 (socket says 172.21.15.123:42574) 2024-04-17T05:27:28.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.556+0000 7fdcb3400640 1 -- 172.21.15.123:0/567546828 learned_addr learned my addr 172.21.15.123:0/567546828 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:28.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.556+0000 7fdcb2a00640 1 --2- 172.21.15.123:0/567546828 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdcb40b58b0 0x7fdcb413fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:28.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.556+0000 7fdcb2000640 1 --2- 172.21.15.123:0/567546828 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcb40b7e90 0x7fdcb41dd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:28.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.557+0000 7fdcb3400640 1 -- 172.21.15.123:0/567546828 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdcb40b58b0 msgr2=0x7fdcb413fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:28.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.557+0000 7fdcb3400640 1 --2- 172.21.15.123:0/567546828 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdcb40b58b0 0x7fdcb413fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:28.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.557+0000 7fdcb3400640 1 -- 172.21.15.123:0/567546828 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcb40b7e90 msgr2=0x7fdcb41dd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:28.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.557+0000 7fdcb3400640 1 --2- 172.21.15.123:0/567546828 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcb40b7e90 0x7fdcb41dd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:28.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.557+0000 7fdcb3400640 1 -- 172.21.15.123:0/567546828 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcb41429b0 con 0x7fdcb414b1d0 2024-04-17T05:27:28.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.557+0000 7fdcb3400640 1 --2- 172.21.15.123:0/567546828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcb414b1d0 0x7fdcb41dde80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdcac00c700 tx=0x7fdcac00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:28.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.557+0000 7fdcaaa00640 1 -- 172.21.15.123:0/567546828 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcac018070 con 0x7fdcb414b1d0 2024-04-17T05:27:28.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.557+0000 7fdcaaa00640 1 -- 172.21.15.123:0/567546828 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcac00ce10 con 0x7fdcb414b1d0 2024-04-17T05:27:28.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.557+0000 7fdcaaa00640 1 -- 172.21.15.123:0/567546828 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcac00a800 con 0x7fdcb414b1d0 2024-04-17T05:27:28.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.557+0000 7fdcb9800640 1 -- 172.21.15.123:0/567546828 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcb41e13f0 con 0x7fdcb414b1d0 2024-04-17T05:27:28.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.557+0000 7fdcb9800640 1 -- 172.21.15.123:0/567546828 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcb41426d0 con 0x7fdcb414b1d0 2024-04-17T05:27:28.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.559+0000 7fdcb9800640 1 -- 172.21.15.123:0/567546828 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcb4068a40 con 0x7fdcb414b1d0 2024-04-17T05:27:28.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.559+0000 7fdcaaa00640 1 -- 172.21.15.123:0/567546828 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdcac01b070 con 0x7fdcb414b1d0 2024-04-17T05:27:28.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.560+0000 7fdcaaa00640 1 --2- 172.21.15.123:0/567546828 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fdc9406c8f0 0x7fdc9406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:28.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.561+0000 7fdcaaa00640 1 -- 172.21.15.123:0/567546828 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fdcac08b3f0 con 0x7fdcb414b1d0 2024-04-17T05:27:28.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.561+0000 7fdcb2a00640 1 --2- 172.21.15.123:0/567546828 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fdc9406c8f0 0x7fdc9406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:28.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.562+0000 7fdcb2a00640 1 --2- 172.21.15.123:0/567546828 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fdc9406c8f0 0x7fdc9406edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdca4006fd0 tx=0x7fdca4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:28.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.565+0000 7fdcaaa00640 1 -- 172.21.15.123:0/567546828 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fdcac0594d0 con 0x7fdcb414b1d0 2024-04-17T05:27:28.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.761+0000 7fdcb9800640 1 -- 172.21.15.123:0/567546828 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fdcb41489c0 con 0x7fdcb414b1d0 2024-04-17T05:27:28.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.762+0000 7fdcaaa00640 1 -- 172.21.15.123:0/567546828 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7fdcac058dd0 con 0x7fdcb414b1d0 2024-04-17T05:27:28.762 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-04-17T05:27:28.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.765+0000 7fdcb9800640 1 -- 172.21.15.123:0/567546828 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fdc9406c8f0 msgr2=0x7fdc9406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:28.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.765+0000 7fdcb9800640 1 --2- 172.21.15.123:0/567546828 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fdc9406c8f0 0x7fdc9406edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdca4006fd0 tx=0x7fdca4008040 comp rx=0 tx=0).stop 2024-04-17T05:27:28.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.765+0000 7fdcb9800640 1 -- 172.21.15.123:0/567546828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcb414b1d0 msgr2=0x7fdcb41dde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:28.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.765+0000 7fdcb9800640 1 --2- 172.21.15.123:0/567546828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcb414b1d0 0x7fdcb41dde80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdcac00c700 tx=0x7fdcac00cbc0 comp rx=0 tx=0).stop 2024-04-17T05:27:28.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.765+0000 7fdcb9800640 1 -- 172.21.15.123:0/567546828 shutdown_connections 2024-04-17T05:27:28.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.765+0000 7fdcb9800640 1 --2- 172.21.15.123:0/567546828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdcb414b1d0 0x7fdcb41dde80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:28.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.765+0000 7fdcb9800640 1 --2- 172.21.15.123:0/567546828 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdcb40b7e90 0x7fdcb41dd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:28.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.765+0000 7fdcb9800640 1 --2- 172.21.15.123:0/567546828 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fdc9406c8f0 0x7fdc9406edb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:28.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.765+0000 7fdcb9800640 1 --2- 172.21.15.123:0/567546828 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fdcb40b58b0 0x7fdcb413fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:28.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.765+0000 7fdcb9800640 1 -- 172.21.15.123:0/567546828 >> 172.21.15.123:0/567546828 conn(0x7fdcb40bd6f0 msgr2=0x7fdcb40b8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:28.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.765+0000 7fdcb9800640 1 -- 172.21.15.123:0/567546828 shutdown_connections 2024-04-17T05:27:28.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.766+0000 7fdcb9800640 1 -- 172.21.15.123:0/567546828 wait complete. 2024-04-17T05:27:28.784 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T05:27:28.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.999+0000 7fc146200640 1 Processor -- start 2024-04-17T05:27:28.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:28.999+0000 7fc146200640 1 -- start start 2024-04-17T05:27:29.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.001+0000 7fc146200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc1400b66c0 0x7fc1400afd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:29.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.001+0000 7fc146200640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc1400b3fa0 0x7fc14014fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:29.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.001+0000 7fc146200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1400b6aa0 con 0x7fc1401500b0 2024-04-17T05:27:29.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.001+0000 7fc146200640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7fc1400b3d20 con 0x7fc1400b3fa0 2024-04-17T05:27:29.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.001+0000 7fc146200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fc140150520 con 0x7fc1400b66c0 2024-04-17T05:27:29.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.001+0000 7fc145800640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc1401500b0 0x7fc14006cdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47846/0 (socket says 172.21.15.123:47846) 2024-04-17T05:27:29.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.001+0000 7fc145800640 1 -- 172.21.15.123:0/3187396245 learned_addr learned my addr 172.21.15.123:0/3187396245 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:27:29.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.001+0000 7fc137e00640 1 --2- 172.21.15.123:0/3187396245 >> v2:172.21.15.164:3300/0 conn(0x7fc1400b3fa0 0x7fc14014fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:29.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.001+0000 7fc144e00640 1 --2- 172.21.15.123:0/3187396245 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc1400b66c0 0x7fc1400afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:29.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.002+0000 7fc13fe00640 1 -- 172.21.15.123:0/3187396245 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2669081102 0 0) 0x7fc1400b6aa0 con 0x7fc1401500b0 2024-04-17T05:27:29.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.002+0000 7fc13fe00640 1 -- 172.21.15.123:0/3187396245 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc120003520 con 0x7fc1401500b0 2024-04-17T05:27:29.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.002+0000 7fc13fe00640 1 -- 172.21.15.123:0/3187396245 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4103678408 0 0) 0x7fc120003520 con 0x7fc1401500b0 2024-04-17T05:27:29.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.002+0000 7fc13fe00640 1 -- 172.21.15.123:0/3187396245 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc1400b66c0 msgr2=0x7fc1400afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:29.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.002+0000 7fc13fe00640 1 --2- 172.21.15.123:0/3187396245 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc1400b66c0 0x7fc1400afd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:29.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.002+0000 7fc13fe00640 1 -- 172.21.15.123:0/3187396245 >> v2:172.21.15.164:3300/0 conn(0x7fc1400b3fa0 msgr2=0x7fc14014fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:29.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.002+0000 7fc13fe00640 1 --2- 172.21.15.123:0/3187396245 >> v2:172.21.15.164:3300/0 conn(0x7fc1400b3fa0 0x7fc14014fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:29.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.002+0000 7fc13fe00640 1 -- 172.21.15.123:0/3187396245 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1400b5650 con 0x7fc1401500b0 2024-04-17T05:27:29.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.002+0000 7fc13fe00640 1 -- 172.21.15.123:0/3187396245 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1042962670 0 0) 0x7fc1380019f0 con 0x7fc1401500b0 2024-04-17T05:27:29.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.002+0000 7fc13fe00640 1 -- 172.21.15.123:0/3187396245 >> v1:172.21.15.123:6789/0 conn(0x7fc1401500b0 legacy=0x7fc14006cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:29.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.002+0000 7fc13fe00640 1 --2- 172.21.15.123:0/3187396245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1200039e0 0x7fc120003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:29.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.002+0000 7fc13fe00640 1 --2- 172.21.15.123:0/3187396245 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc120004800 0x7fc120004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:29.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.002+0000 7fc13fe00640 1 --2- 172.21.15.123:0/3187396245 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc1400b66c0 0x7fc1200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:29.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.002+0000 7fc13fe00640 1 -- 172.21.15.123:0/3187396245 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc140150520 con 0x7fc1200039e0 2024-04-17T05:27:29.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.002+0000 7fc13fe00640 1 -- 172.21.15.123:0/3187396245 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc12000b9c0 con 0x7fc120004800 2024-04-17T05:27:29.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.002+0000 7fc13fe00640 1 -- 172.21.15.123:0/3187396245 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fc12000bb70 con 0x7fc1400b66c0 2024-04-17T05:27:29.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.002+0000 7fc144e00640 1 --2- 172.21.15.123:0/3187396245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1200039e0 0x7fc120003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:29.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.003+0000 7fc144e00640 1 -- 172.21.15.123:0/3187396245 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc1400b66c0 msgr2=0x7fc1200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:29.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.003+0000 7fc144e00640 1 --2- 172.21.15.123:0/3187396245 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc1400b66c0 0x7fc1200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:29.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.003+0000 7fc144e00640 1 -- 172.21.15.123:0/3187396245 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc120004800 msgr2=0x7fc120004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:29.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.003+0000 7fc144e00640 1 --2- 172.21.15.123:0/3187396245 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc120004800 0x7fc120004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:29.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.003+0000 7fc144e00640 1 -- 172.21.15.123:0/3187396245 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc120003520 con 0x7fc1200039e0 2024-04-17T05:27:29.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.004+0000 7fc144e00640 1 --2- 172.21.15.123:0/3187396245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1200039e0 0x7fc120003e00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc128009ac0 tx=0x7fc120005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3ca4f625f1dd41e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:29.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.004+0000 7fc13fe00640 1 -- 172.21.15.123:0/3187396245 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128039070 con 0x7fc1200039e0 2024-04-17T05:27:29.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.004+0000 7fc13fe00640 1 -- 172.21.15.123:0/3187396245 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc12802c6d0 con 0x7fc1200039e0 2024-04-17T05:27:29.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.004+0000 7fc13fe00640 1 -- 172.21.15.123:0/3187396245 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128009690 con 0x7fc1200039e0 2024-04-17T05:27:29.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.005+0000 7fc146200640 1 -- 172.21.15.123:0/3187396245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1200039e0 msgr2=0x7fc120003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:29.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.005+0000 7fc146200640 1 --2- 172.21.15.123:0/3187396245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1200039e0 0x7fc120003e00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc128009ac0 tx=0x7fc120005830 comp rx=0 tx=0).stop 2024-04-17T05:27:29.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.005+0000 7fc145800640 1 -- 172.21.15.123:0/3187396245 reap_dead start 2024-04-17T05:27:29.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.005+0000 7fc146200640 1 -- 172.21.15.123:0/3187396245 shutdown_connections 2024-04-17T05:27:29.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.005+0000 7fc146200640 1 -- 172.21.15.123:0/3187396245 >> 172.21.15.123:0/3187396245 conn(0x7fc1400b9a30 msgr2=0x7fc1400b5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:29.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.005+0000 7fc146200640 1 -- 172.21.15.123:0/3187396245 shutdown_connections 2024-04-17T05:27:29.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.005+0000 7fc146200640 1 -- 172.21.15.123:0/3187396245 wait complete. 2024-04-17T05:27:29.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.006+0000 7fc146200640 1 Processor -- start 2024-04-17T05:27:29.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.007+0000 7fc146200640 1 -- start start 2024-04-17T05:27:29.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.007+0000 7fc146200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1200039e0 0x7fc14009edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:29.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.007+0000 7fc146200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc140071a30 0x7fc1400705b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:29.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.007+0000 7fc146200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc1401480a0 0x7fc140148520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:29.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.007+0000 7fc146200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc14014f5f0 con 0x7fc1200039e0 2024-04-17T05:27:29.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.007+0000 7fc146200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc1400b4ed0 con 0x7fc140071a30 2024-04-17T05:27:29.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.007+0000 7fc146200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fc1400ae260 con 0x7fc1401480a0 2024-04-17T05:27:29.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.008+0000 7fc144e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1200039e0 0x7fc14009edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:29.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.008+0000 7fc144e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1200039e0 0x7fc14009edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42592/0 (socket says 172.21.15.123:42592) 2024-04-17T05:27:29.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.008+0000 7fc144e00640 1 -- 172.21.15.123:0/1334921987 learned_addr learned my addr 172.21.15.123:0/1334921987 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:29.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.008+0000 7fc137e00640 1 --2- 172.21.15.123:0/1334921987 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc140071a30 0x7fc1400705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:29.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.008+0000 7fc145800640 1 --2- 172.21.15.123:0/1334921987 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc1401480a0 0x7fc140148520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:29.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.008+0000 7fc144e00640 1 -- 172.21.15.123:0/1334921987 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc1401480a0 msgr2=0x7fc140148520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:29.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.008+0000 7fc144e00640 1 --2- 172.21.15.123:0/1334921987 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc1401480a0 0x7fc140148520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:29.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.008+0000 7fc144e00640 1 -- 172.21.15.123:0/1334921987 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc140071a30 msgr2=0x7fc1400705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:29.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.008+0000 7fc144e00640 1 --2- 172.21.15.123:0/1334921987 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc140071a30 0x7fc1400705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:29.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.008+0000 7fc144e00640 1 -- 172.21.15.123:0/1334921987 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc140072180 con 0x7fc1200039e0 2024-04-17T05:27:29.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.008+0000 7fc137e00640 1 --2- 172.21.15.123:0/1334921987 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc140071a30 0x7fc1400705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:29.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.009+0000 7fc144e00640 1 --2- 172.21.15.123:0/1334921987 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1200039e0 0x7fc14009edf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc128000c00 tx=0x7fc128004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:29.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.009+0000 7fc13d600640 1 -- 172.21.15.123:0/1334921987 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128039050 con 0x7fc1200039e0 2024-04-17T05:27:29.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.009+0000 7fc13d600640 1 -- 172.21.15.123:0/1334921987 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc128045070 con 0x7fc1200039e0 2024-04-17T05:27:29.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.009+0000 7fc13d600640 1 -- 172.21.15.123:0/1334921987 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128003a50 con 0x7fc1200039e0 2024-04-17T05:27:29.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.009+0000 7fc146200640 1 -- 172.21.15.123:0/1334921987 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc140071eb0 con 0x7fc1200039e0 2024-04-17T05:27:29.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.009+0000 7fc146200640 1 -- 172.21.15.123:0/1334921987 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc140072b20 con 0x7fc1200039e0 2024-04-17T05:27:29.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.010+0000 7fc146200640 1 -- 172.21.15.123:0/1334921987 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc14009e050 con 0x7fc1200039e0 2024-04-17T05:27:29.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.011+0000 7fc13d600640 1 -- 172.21.15.123:0/1334921987 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc128003bf0 con 0x7fc1200039e0 2024-04-17T05:27:29.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.012+0000 7fc13d600640 1 --2- 172.21.15.123:0/1334921987 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc11c06c8f0 0x7fc11c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:29.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.012+0000 7fc13d600640 1 -- 172.21.15.123:0/1334921987 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc1280ad9d0 con 0x7fc1200039e0 2024-04-17T05:27:29.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.013+0000 7fc137e00640 1 --2- 172.21.15.123:0/1334921987 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc11c06c8f0 0x7fc11c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:29.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.014+0000 7fc137e00640 1 --2- 172.21.15.123:0/1334921987 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc11c06c8f0 0x7fc11c06edb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc140149840 tx=0x7fc130008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:29.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.016+0000 7fc13d600640 1 -- 172.21.15.123:0/1334921987 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fc14009e050 con 0x7fc1200039e0 2024-04-17T05:27:29.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.215+0000 7fc146200640 1 -- 172.21.15.123:0/1334921987 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc140075b30 con 0x7fc1200039e0 2024-04-17T05:27:29.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.216+0000 7fc13d600640 1 -- 172.21.15.123:0/1334921987 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fc12804e020 con 0x7fc1200039e0 2024-04-17T05:27:29.216 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-04-17T05:27:29.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.219+0000 7fc146200640 1 -- 172.21.15.123:0/1334921987 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc11c06c8f0 msgr2=0x7fc11c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:29.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.219+0000 7fc146200640 1 --2- 172.21.15.123:0/1334921987 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc11c06c8f0 0x7fc11c06edb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc140149840 tx=0x7fc130008040 comp rx=0 tx=0).stop 2024-04-17T05:27:29.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.219+0000 7fc146200640 1 -- 172.21.15.123:0/1334921987 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1200039e0 msgr2=0x7fc14009edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:29.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.219+0000 7fc146200640 1 --2- 172.21.15.123:0/1334921987 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1200039e0 0x7fc14009edf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc128000c00 tx=0x7fc128004730 comp rx=0 tx=0).stop 2024-04-17T05:27:29.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.219+0000 7fc146200640 1 -- 172.21.15.123:0/1334921987 shutdown_connections 2024-04-17T05:27:29.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.219+0000 7fc146200640 1 --2- 172.21.15.123:0/1334921987 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc11c06c8f0 0x7fc11c06edb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:29.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.219+0000 7fc146200640 1 --2- 172.21.15.123:0/1334921987 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc1401480a0 0x7fc140148520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:29.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.219+0000 7fc146200640 1 --2- 172.21.15.123:0/1334921987 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc140071a30 0x7fc1400705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:29.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.219+0000 7fc146200640 1 --2- 172.21.15.123:0/1334921987 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc1200039e0 0x7fc14009edf0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:29.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.219+0000 7fc146200640 1 -- 172.21.15.123:0/1334921987 >> 172.21.15.123:0/1334921987 conn(0x7fc1400b9a30 msgr2=0x7fc14006cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:29.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.219+0000 7fc146200640 1 -- 172.21.15.123:0/1334921987 shutdown_connections 2024-04-17T05:27:29.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.219+0000 7fc146200640 1 -- 172.21.15.123:0/1334921987 wait complete. 2024-04-17T05:27:29.238 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T05:27:29.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.453+0000 7f8cd2c00640 1 Processor -- start 2024-04-17T05:27:29.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.453+0000 7f8cd2c00640 1 -- start start 2024-04-17T05:27:29.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.455+0000 7f8cd2c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8ccc1499f0 0x7f8ccc09da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:29.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.455+0000 7f8cd2c00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f8ccc142b30 0x7f8ccc142fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:29.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.455+0000 7f8cd2c00640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ccc09cc30 con 0x7f8ccc09d630 2024-04-17T05:27:29.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.455+0000 7f8cd2c00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f8ccc09bcf0 con 0x7f8ccc142b30 2024-04-17T05:27:29.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.455+0000 7f8cd2c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f8ccc09cea0 con 0x7f8ccc1499f0 2024-04-17T05:27:29.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.455+0000 7f8cc3e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8ccc1499f0 0x7f8ccc09da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:29.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.455+0000 7f8cd0c00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f8ccc142b30 0x7f8ccc142fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:29.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.455+0000 7f8cc3e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8ccc1499f0 0x7f8ccc09da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.123:48454/0 (socket says 172.21.15.123:48454) 2024-04-17T05:27:29.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.455+0000 7f8cc3e00640 1 -- 172.21.15.123:0/484813803 learned_addr learned my addr 172.21.15.123:0/484813803 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:29.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.456+0000 7f8cd0c00640 1 -- 172.21.15.123:0/484813803 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8ccc1499f0 msgr2=0x7f8ccc09da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:29.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.456+0000 7f8cd0c00640 1 --2- 172.21.15.123:0/484813803 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8ccc1499f0 0x7f8ccc09da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:29.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.456+0000 7f8cd0c00640 1 -- 172.21.15.123:0/484813803 >> v1:172.21.15.164:6789/0 conn(0x7f8ccc09d630 legacy=0x7f8ccc1492e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:29.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.456+0000 7f8cd0c00640 1 -- 172.21.15.123:0/484813803 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ccc09b3c0 con 0x7f8ccc142b30 2024-04-17T05:27:29.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.457+0000 7f8cd0c00640 1 --2- 172.21.15.123:0/484813803 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ccc142b30 0x7f8ccc142fc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4009d90 tx=0x7f8cc402be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ceb72bdf7c6971a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:29.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.458+0000 7f8ccb400640 1 -- 172.21.15.123:0/484813803 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4039070 con 0x7f8ccc142b30 2024-04-17T05:27:29.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.458+0000 7f8ccb400640 1 -- 172.21.15.123:0/484813803 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cc402cbc0 con 0x7f8ccc142b30 2024-04-17T05:27:29.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.458+0000 7f8ccb400640 1 -- 172.21.15.123:0/484813803 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4034440 con 0x7f8ccc142b30 2024-04-17T05:27:29.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.458+0000 7f8cd2c00640 1 -- 172.21.15.123:0/484813803 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ccc142b30 msgr2=0x7f8ccc142fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:29.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.458+0000 7f8cd2c00640 1 --2- 172.21.15.123:0/484813803 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ccc142b30 0x7f8ccc142fc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4009d90 tx=0x7f8cc402be10 comp rx=0 tx=0).stop 2024-04-17T05:27:29.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.459+0000 7f8cd2c00640 1 -- 172.21.15.123:0/484813803 shutdown_connections 2024-04-17T05:27:29.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.459+0000 7f8cd2c00640 1 --2- 172.21.15.123:0/484813803 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ccc142b30 0x7f8ccc142fc0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:29.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.459+0000 7f8cd2c00640 1 --2- 172.21.15.123:0/484813803 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8ccc1499f0 0x7f8ccc09da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:29.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.459+0000 7f8cd2c00640 1 -- 172.21.15.123:0/484813803 >> 172.21.15.123:0/484813803 conn(0x7f8ccc0b93b0 msgr2=0x7f8ccc0b97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:29.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.459+0000 7f8cd2c00640 1 -- 172.21.15.123:0/484813803 shutdown_connections 2024-04-17T05:27:29.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.459+0000 7f8cd2c00640 1 -- 172.21.15.123:0/484813803 wait complete. 2024-04-17T05:27:29.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.460+0000 7f8cd2c00640 1 Processor -- start 2024-04-17T05:27:29.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.460+0000 7f8cd2c00640 1 -- start start 2024-04-17T05:27:29.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.461+0000 7f8cd2c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8ccc09d630 0x7f8ccc0b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:29.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.461+0000 7f8cd2c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ccc142b30 0x7f8ccc141b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:29.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.461+0000 7f8cd2c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ccc1499f0 0x7f8ccc1de990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:29.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.461+0000 7f8cd2c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8ccc0b5b10 con 0x7f8ccc1499f0 2024-04-17T05:27:29.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.461+0000 7f8cd2c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8ccc09b720 con 0x7f8ccc142b30 2024-04-17T05:27:29.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.461+0000 7f8cd2c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f8ccc0b5c90 con 0x7f8ccc09d630 2024-04-17T05:27:29.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.462+0000 7f8cd0c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ccc1499f0 0x7f8ccc1de990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:29.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.462+0000 7f8cd0c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ccc1499f0 0x7f8ccc1de990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42598/0 (socket says 172.21.15.123:42598) 2024-04-17T05:27:29.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.462+0000 7f8cd0c00640 1 -- 172.21.15.123:0/1188843522 learned_addr learned my addr 172.21.15.123:0/1188843522 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:29.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.462+0000 7f8cc3e00640 1 --2- 172.21.15.123:0/1188843522 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ccc142b30 0x7f8ccc141b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:29.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.462+0000 7f8ccbe00640 1 --2- 172.21.15.123:0/1188843522 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8ccc09d630 0x7f8ccc0b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:29.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.462+0000 7f8cd0c00640 1 -- 172.21.15.123:0/1188843522 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8ccc09d630 msgr2=0x7f8ccc0b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:29.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.462+0000 7f8cd0c00640 1 --2- 172.21.15.123:0/1188843522 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8ccc09d630 0x7f8ccc0b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:29.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.462+0000 7f8cd0c00640 1 -- 172.21.15.123:0/1188843522 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ccc142b30 msgr2=0x7f8ccc141b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:29.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.462+0000 7f8cd0c00640 1 --2- 172.21.15.123:0/1188843522 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ccc142b30 0x7f8ccc141b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:29.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.462+0000 7f8cd0c00640 1 -- 172.21.15.123:0/1188843522 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ccc0b28b0 con 0x7f8ccc1499f0 2024-04-17T05:27:29.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.462+0000 7f8cd0c00640 1 --2- 172.21.15.123:0/1188843522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ccc1499f0 0x7f8ccc1de990 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4009d90 tx=0x7f8cc4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:29.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.463+0000 7f8cc8c00640 1 -- 172.21.15.123:0/1188843522 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4039050 con 0x7f8ccc1499f0 2024-04-17T05:27:29.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.463+0000 7f8cc8c00640 1 -- 172.21.15.123:0/1188843522 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cc4045070 con 0x7f8ccc1499f0 2024-04-17T05:27:29.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.463+0000 7f8cc8c00640 1 -- 172.21.15.123:0/1188843522 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4009450 con 0x7f8ccc1499f0 2024-04-17T05:27:29.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.463+0000 7f8cd2c00640 1 -- 172.21.15.123:0/1188843522 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ccc0b2b90 con 0x7f8ccc1499f0 2024-04-17T05:27:29.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.463+0000 7f8cd2c00640 1 -- 172.21.15.123:0/1188843522 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ccc0b3300 con 0x7f8ccc1499f0 2024-04-17T05:27:29.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.464+0000 7f8cd2c00640 1 -- 172.21.15.123:0/1188843522 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ccc068a40 con 0x7f8ccc1499f0 2024-04-17T05:27:29.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.465+0000 7f8cc8c00640 1 -- 172.21.15.123:0/1188843522 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8cc403e850 con 0x7f8ccc1499f0 2024-04-17T05:27:29.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.466+0000 7f8cc8c00640 1 --2- 172.21.15.123:0/1188843522 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8ca806c8f0 0x7f8ca806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:29.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.466+0000 7f8cc8c00640 1 -- 172.21.15.123:0/1188843522 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f8cc40aeae0 con 0x7f8ccc1499f0 2024-04-17T05:27:29.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.466+0000 7f8ccbe00640 1 --2- 172.21.15.123:0/1188843522 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8ca806c8f0 0x7f8ca806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:29.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.467+0000 7f8ccbe00640 1 --2- 172.21.15.123:0/1188843522 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8ca806c8f0 0x7f8ca806edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc0af130 tx=0x7f8cbc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:29.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.470+0000 7f8cc8c00640 1 -- 172.21.15.123:0/1188843522 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f8cc407cbc0 con 0x7f8ccc1499f0 2024-04-17T05:27:29.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.672+0000 7f8cd2c00640 1 -- 172.21.15.123:0/1188843522 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f8ccc0af5e0 con 0x7f8ccc1499f0 2024-04-17T05:27:29.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.673+0000 7f8cc8c00640 1 -- 172.21.15.123:0/1188843522 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f8cc407c4c0 con 0x7f8ccc1499f0 2024-04-17T05:27:29.672 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-04-17T05:27:29.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.676+0000 7f8cd2c00640 1 -- 172.21.15.123:0/1188843522 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8ca806c8f0 msgr2=0x7f8ca806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:29.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.676+0000 7f8cd2c00640 1 --2- 172.21.15.123:0/1188843522 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8ca806c8f0 0x7f8ca806edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc0af130 tx=0x7f8cbc009040 comp rx=0 tx=0).stop 2024-04-17T05:27:29.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.676+0000 7f8cd2c00640 1 -- 172.21.15.123:0/1188843522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ccc1499f0 msgr2=0x7f8ccc1de990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:29.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.676+0000 7f8cd2c00640 1 --2- 172.21.15.123:0/1188843522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ccc1499f0 0x7f8ccc1de990 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4009d90 tx=0x7f8cc4004a40 comp rx=0 tx=0).stop 2024-04-17T05:27:29.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.676+0000 7f8cd2c00640 1 -- 172.21.15.123:0/1188843522 shutdown_connections 2024-04-17T05:27:29.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.676+0000 7f8cd2c00640 1 --2- 172.21.15.123:0/1188843522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ccc1499f0 0x7f8ccc1de990 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:29.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.676+0000 7f8cd2c00640 1 --2- 172.21.15.123:0/1188843522 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8ccc142b30 0x7f8ccc141b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:29.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.676+0000 7f8cd2c00640 1 --2- 172.21.15.123:0/1188843522 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8ca806c8f0 0x7f8ca806edb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:29.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.676+0000 7f8cd2c00640 1 --2- 172.21.15.123:0/1188843522 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8ccc09d630 0x7f8ccc0b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:29.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.676+0000 7f8cd2c00640 1 -- 172.21.15.123:0/1188843522 >> 172.21.15.123:0/1188843522 conn(0x7f8ccc0b93b0 msgr2=0x7f8ccc0b5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:29.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.676+0000 7f8cd2c00640 1 -- 172.21.15.123:0/1188843522 shutdown_connections 2024-04-17T05:27:29.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.676+0000 7f8cd2c00640 1 -- 172.21.15.123:0/1188843522 wait complete. 2024-04-17T05:27:29.694 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T05:27:29.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.898+0000 7fd959400640 1 Processor -- start 2024-04-17T05:27:29.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.898+0000 7fd959400640 1 -- start start 2024-04-17T05:27:29.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.899+0000 7fd959400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd9541485f0 0x7fd95413e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:29.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.899+0000 7fd959400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9540b5910 con 0x7fd95413e920 2024-04-17T05:27:29.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.899+0000 7fd959400640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9540b1870 con 0x7fd9540b3dc0 2024-04-17T05:27:29.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.899+0000 7fd959400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd9540b2c80 con 0x7fd9541485f0 2024-04-17T05:27:29.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.900+0000 7fd953400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd9541485f0 0x7fd95413e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:29.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.900+0000 7fd958a00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd95413e920 0x7fd95414f090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47848/0 (socket says 172.21.15.123:47848) 2024-04-17T05:27:29.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.900+0000 7fd958a00640 1 -- 172.21.15.123:0/816793921 learned_addr learned my addr 172.21.15.123:0/816793921 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:27:29.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.900+0000 7fd953400640 1 -- 172.21.15.123:0/816793921 >> v1:172.21.15.164:6789/0 conn(0x7fd9540b3dc0 legacy=0x7fd954147ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:29.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.900+0000 7fd953400640 1 -- 172.21.15.123:0/816793921 >> v1:172.21.15.123:6789/0 conn(0x7fd95413e920 legacy=0x7fd95414f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:29.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.900+0000 7fd953400640 1 -- 172.21.15.123:0/816793921 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9540b41a0 con 0x7fd9541485f0 2024-04-17T05:27:29.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.900+0000 7fd952a00640 1 -- 172.21.15.123:0/816793921 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 649611491 0 0) 0x7fd9540b5910 con 0x7fd95413e920 2024-04-17T05:27:29.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.901+0000 7fd953400640 1 --2- 172.21.15.123:0/816793921 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9541485f0 0x7fd95413e3e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd9400097a0 tx=0x7fd94002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59292ef958f2a2ad server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:29.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.902+0000 7fd952a00640 1 -- 172.21.15.123:0/816793921 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9400315a0 con 0x7fd9541485f0 2024-04-17T05:27:29.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.902+0000 7fd952a00640 1 -- 172.21.15.123:0/816793921 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd940037070 con 0x7fd9541485f0 2024-04-17T05:27:29.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.902+0000 7fd952a00640 1 -- 172.21.15.123:0/816793921 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd940031960 con 0x7fd9541485f0 2024-04-17T05:27:29.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.902+0000 7fd959400640 1 -- 172.21.15.123:0/816793921 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9541485f0 msgr2=0x7fd95413e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:29.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.902+0000 7fd959400640 1 --2- 172.21.15.123:0/816793921 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9541485f0 0x7fd95413e3e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd9400097a0 tx=0x7fd94002b840 comp rx=0 tx=0).stop 2024-04-17T05:27:29.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.902+0000 7fd959400640 1 -- 172.21.15.123:0/816793921 shutdown_connections 2024-04-17T05:27:29.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.902+0000 7fd959400640 1 --2- 172.21.15.123:0/816793921 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9541485f0 0x7fd95413e3e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:29.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.902+0000 7fd959400640 1 -- 172.21.15.123:0/816793921 >> 172.21.15.123:0/816793921 conn(0x7fd9540b9150 msgr2=0x7fd9540b9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:29.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.903+0000 7fd959400640 1 -- 172.21.15.123:0/816793921 shutdown_connections 2024-04-17T05:27:29.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.903+0000 7fd959400640 1 -- 172.21.15.123:0/816793921 wait complete. 2024-04-17T05:27:29.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.904+0000 7fd959400640 1 Processor -- start 2024-04-17T05:27:29.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.904+0000 7fd959400640 1 -- start start 2024-04-17T05:27:29.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.905+0000 7fd959400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9540b3dc0 0x7fd9541e0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:29.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.905+0000 7fd959400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd95413e920 0x7fd9540adff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:29.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.905+0000 7fd959400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9541485f0 0x7fd954140d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:29.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.905+0000 7fd959400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd9540b1b10 con 0x7fd9541485f0 2024-04-17T05:27:29.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.905+0000 7fd959400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd9540708c0 con 0x7fd9540b3dc0 2024-04-17T05:27:29.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.905+0000 7fd959400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fd9540b2a00 con 0x7fd95413e920 2024-04-17T05:27:29.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.905+0000 7fd958a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9541485f0 0x7fd954140d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:29.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.905+0000 7fd958a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9541485f0 0x7fd954140d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42610/0 (socket says 172.21.15.123:42610) 2024-04-17T05:27:29.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.905+0000 7fd958a00640 1 -- 172.21.15.123:0/1143515657 learned_addr learned my addr 172.21.15.123:0/1143515657 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:29.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.906+0000 7fd953400640 1 --2- 172.21.15.123:0/1143515657 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd95413e920 0x7fd9540adff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:29.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.906+0000 7fd958a00640 1 -- 172.21.15.123:0/1143515657 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd95413e920 msgr2=0x7fd9540adff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:29.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.906+0000 7fd958a00640 1 --2- 172.21.15.123:0/1143515657 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd95413e920 0x7fd9540adff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:29.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.906+0000 7fd958a00640 1 -- 172.21.15.123:0/1143515657 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9540b3dc0 msgr2=0x7fd9541e0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:29.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.906+0000 7fd958a00640 1 --2- 172.21.15.123:0/1143515657 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9540b3dc0 0x7fd9541e0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:29.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.906+0000 7fd958a00640 1 -- 172.21.15.123:0/1143515657 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9541e18e0 con 0x7fd9541485f0 2024-04-17T05:27:29.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.906+0000 7fd958a00640 1 --2- 172.21.15.123:0/1143515657 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9541485f0 0x7fd954140d50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd94c00ca40 tx=0x7fd94c00cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:29.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.906+0000 7fd94be00640 1 -- 172.21.15.123:0/1143515657 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94c00abd0 con 0x7fd9541485f0 2024-04-17T05:27:29.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.906+0000 7fd94be00640 1 -- 172.21.15.123:0/1143515657 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd94c00adb0 con 0x7fd9541485f0 2024-04-17T05:27:29.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.906+0000 7fd959400640 1 -- 172.21.15.123:0/1143515657 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd95413f310 con 0x7fd9541485f0 2024-04-17T05:27:29.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.906+0000 7fd94be00640 1 -- 172.21.15.123:0/1143515657 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94c012640 con 0x7fd9541485f0 2024-04-17T05:27:29.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.906+0000 7fd959400640 1 -- 172.21.15.123:0/1143515657 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd954072f80 con 0x7fd9541485f0 2024-04-17T05:27:29.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.907+0000 7fd959400640 1 -- 172.21.15.123:0/1143515657 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9540759b0 con 0x7fd9541485f0 2024-04-17T05:27:29.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.908+0000 7fd94be00640 1 -- 172.21.15.123:0/1143515657 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd94c0127e0 con 0x7fd9541485f0 2024-04-17T05:27:29.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.909+0000 7fd94be00640 1 --2- 172.21.15.123:0/1143515657 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fd93406c8f0 0x7fd93406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:29.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.909+0000 7fd94be00640 1 -- 172.21.15.123:0/1143515657 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd94c08c480 con 0x7fd9541485f0 2024-04-17T05:27:29.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.910+0000 7fd953e00640 1 --2- 172.21.15.123:0/1143515657 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fd93406c8f0 0x7fd93406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:29.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.911+0000 7fd953e00640 1 --2- 172.21.15.123:0/1143515657 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fd93406c8f0 0x7fd93406edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd944003cc0 tx=0x7fd9440079b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:29.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:29.913+0000 7fd94be00640 1 -- 172.21.15.123:0/1143515657 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fd94c05a560 con 0x7fd9541485f0 2024-04-17T05:27:30.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.152+0000 7fd959400640 1 -- 172.21.15.123:0/1143515657 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9541e1500 con 0x7fd9541485f0 2024-04-17T05:27:30.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.153+0000 7fd94be00640 1 -- 172.21.15.123:0/1143515657 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+3550 (secure 0 0 0) 0x7fd94c059e60 con 0x7fd9541485f0 2024-04-17T05:27:30.152 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:27:30.152 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/515699398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":515699398},{"type":"v1","addr":"172.21.15.123:6833","nonce":515699398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T05:26:52.642446+0000","modified":"2024-04-17T05:27:18.881148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4243},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4243":{"gid":4243,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/1946746019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1946746019},{"type":"v1","addr":"172.21.15.164:6835","nonce":1946746019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4243,"qdb_cluster":[4243]},"id":1}]} 2024-04-17T05:27:30.152 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 9 2024-04-17T05:27:30.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.155+0000 7fd959400640 1 -- 172.21.15.123:0/1143515657 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fd93406c8f0 msgr2=0x7fd93406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:30.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.155+0000 7fd959400640 1 --2- 172.21.15.123:0/1143515657 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fd93406c8f0 0x7fd93406edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd944003cc0 tx=0x7fd9440079b0 comp rx=0 tx=0).stop 2024-04-17T05:27:30.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.155+0000 7fd959400640 1 -- 172.21.15.123:0/1143515657 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9541485f0 msgr2=0x7fd954140d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:30.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.155+0000 7fd959400640 1 --2- 172.21.15.123:0/1143515657 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9541485f0 0x7fd954140d50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd94c00ca40 tx=0x7fd94c00cf00 comp rx=0 tx=0).stop 2024-04-17T05:27:30.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.155+0000 7fd959400640 1 -- 172.21.15.123:0/1143515657 shutdown_connections 2024-04-17T05:27:30.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.155+0000 7fd959400640 1 --2- 172.21.15.123:0/1143515657 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9541485f0 0x7fd954140d50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:30.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.155+0000 7fd959400640 1 --2- 172.21.15.123:0/1143515657 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fd93406c8f0 0x7fd93406edb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:30.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.155+0000 7fd959400640 1 --2- 172.21.15.123:0/1143515657 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd95413e920 0x7fd9540adff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:30.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.155+0000 7fd959400640 1 --2- 172.21.15.123:0/1143515657 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9540b3dc0 0x7fd9541e0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:30.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.155+0000 7fd959400640 1 -- 172.21.15.123:0/1143515657 >> 172.21.15.123:0/1143515657 conn(0x7fd9540b9150 msgr2=0x7fd95413c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:30.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.156+0000 7fd959400640 1 -- 172.21.15.123:0/1143515657 shutdown_connections 2024-04-17T05:27:30.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.156+0000 7fd959400640 1 -- 172.21.15.123:0/1143515657 wait complete. 2024-04-17T05:27:30.173 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T05:27:30.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.380+0000 7f7b89c00640 1 Processor -- start 2024-04-17T05:27:30.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.380+0000 7f7b89c00640 1 -- start start 2024-04-17T05:27:30.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.381+0000 7f7b89c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7b841499f0 0x7f7b8409da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:30.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.381+0000 7f7b89c00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b8409cc30 con 0x7f7b84142b30 2024-04-17T05:27:30.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.381+0000 7f7b89c00640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b8409b3c0 con 0x7f7b8409d630 2024-04-17T05:27:30.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.381+0000 7f7b89c00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f7b8409bcf0 con 0x7f7b841499f0 2024-04-17T05:27:30.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.382+0000 7f7b82000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7b841499f0 0x7f7b8409da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:30.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.382+0000 7f7b82000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7b841499f0 0x7f7b8409da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42626/0 (socket says 172.21.15.123:42626) 2024-04-17T05:27:30.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.382+0000 7f7b82000640 1 -- 172.21.15.123:0/3305874291 learned_addr learned my addr 172.21.15.123:0/3305874291 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:30.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.382+0000 7f7b83400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7b84142b30 0x7f7b84142f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47858/0 (socket says 172.21.15.123:47858) 2024-04-17T05:27:30.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.382+0000 7f7b82000640 1 -- 172.21.15.123:0/3305874291 >> v1:172.21.15.164:6789/0 conn(0x7f7b8409d630 legacy=0x7f7b841492e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:30.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.382+0000 7f7b82000640 1 -- 172.21.15.123:0/3305874291 >> v1:172.21.15.123:6789/0 conn(0x7f7b84142b30 legacy=0x7f7b84142f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:30.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.382+0000 7f7b82000640 1 -- 172.21.15.123:0/3305874291 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b8409b6a0 con 0x7f7b841499f0 2024-04-17T05:27:30.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.383+0000 7f7b82000640 1 --2- 172.21.15.123:0/3305874291 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b841499f0 0x7f7b8409da10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7b8409be70 tx=0x7f7b7002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f439ecd1bcf1b75b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:30.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.383+0000 7f7b81600640 1 -- 172.21.15.123:0/3305874291 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b70035020 con 0x7f7b841499f0 2024-04-17T05:27:30.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.383+0000 7f7b81600640 1 -- 172.21.15.123:0/3305874291 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b70031640 con 0x7f7b841499f0 2024-04-17T05:27:30.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.383+0000 7f7b81600640 1 -- 172.21.15.123:0/3305874291 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7002d040 con 0x7f7b841499f0 2024-04-17T05:27:30.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.384+0000 7f7b89c00640 1 -- 172.21.15.123:0/3305874291 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b841499f0 msgr2=0x7f7b8409da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:30.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.384+0000 7f7b89c00640 1 --2- 172.21.15.123:0/3305874291 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b841499f0 0x7f7b8409da10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7b8409be70 tx=0x7f7b7002b8f0 comp rx=0 tx=0).stop 2024-04-17T05:27:30.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.384+0000 7f7b89c00640 1 -- 172.21.15.123:0/3305874291 shutdown_connections 2024-04-17T05:27:30.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.384+0000 7f7b89c00640 1 --2- 172.21.15.123:0/3305874291 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b841499f0 0x7f7b8409da10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:30.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.384+0000 7f7b89c00640 1 -- 172.21.15.123:0/3305874291 >> 172.21.15.123:0/3305874291 conn(0x7f7b840b93b0 msgr2=0x7f7b840b97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:30.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.384+0000 7f7b89c00640 1 -- 172.21.15.123:0/3305874291 shutdown_connections 2024-04-17T05:27:30.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.384+0000 7f7b89c00640 1 -- 172.21.15.123:0/3305874291 wait complete. 2024-04-17T05:27:30.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.386+0000 7f7b89c00640 1 Processor -- start 2024-04-17T05:27:30.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.386+0000 7f7b89c00640 1 -- start start 2024-04-17T05:27:30.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.387+0000 7f7b89c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b8409d630 0x7f7b84072600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:30.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.387+0000 7f7b89c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b84142b30 0x7f7b840712e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:30.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.387+0000 7f7b89c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b841499f0 0x7f7b8413ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:30.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.387+0000 7f7b89c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7b840b5c90 con 0x7f7b84142b30 2024-04-17T05:27:30.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.387+0000 7f7b89c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f7b840b5b10 con 0x7f7b841499f0 2024-04-17T05:27:30.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.387+0000 7f7b89c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f7b84143640 con 0x7f7b8409d630 2024-04-17T05:27:30.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.387+0000 7f7b82000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b84142b30 0x7f7b840712e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:30.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.387+0000 7f7b82000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b84142b30 0x7f7b840712e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42640/0 (socket says 172.21.15.123:42640) 2024-04-17T05:27:30.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.387+0000 7f7b82000640 1 -- 172.21.15.123:0/3168984701 learned_addr learned my addr 172.21.15.123:0/3168984701 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:30.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.387+0000 7f7b82000640 1 -- 172.21.15.123:0/3168984701 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b8409d630 msgr2=0x7f7b84072600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:30.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.387+0000 7f7b83400640 1 --2- 172.21.15.123:0/3168984701 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b841499f0 0x7f7b8413ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:30.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.387+0000 7f7b82a00640 1 --2- 172.21.15.123:0/3168984701 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b8409d630 0x7f7b84072600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:30.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.387+0000 7f7b82000640 1 --2- 172.21.15.123:0/3168984701 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b8409d630 0x7f7b84072600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:30.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.387+0000 7f7b82000640 1 -- 172.21.15.123:0/3168984701 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b841499f0 msgr2=0x7f7b8413ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:30.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.387+0000 7f7b82000640 1 --2- 172.21.15.123:0/3168984701 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b841499f0 0x7f7b8413ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:30.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.387+0000 7f7b82000640 1 -- 172.21.15.123:0/3168984701 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b840703d0 con 0x7f7b84142b30 2024-04-17T05:27:30.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.387+0000 7f7b83400640 1 --2- 172.21.15.123:0/3168984701 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b841499f0 0x7f7b8413ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:30.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.387+0000 7f7b82a00640 1 --2- 172.21.15.123:0/3168984701 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b8409d630 0x7f7b84072600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:30.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.388+0000 7f7b82000640 1 --2- 172.21.15.123:0/3168984701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b84142b30 0x7f7b840712e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7b70000c00 tx=0x7f7b700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:30.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.388+0000 7f7b7aa00640 1 -- 172.21.15.123:0/3168984701 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b70040070 con 0x7f7b84142b30 2024-04-17T05:27:30.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.388+0000 7f7b7aa00640 1 -- 172.21.15.123:0/3168984701 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b70039c10 con 0x7f7b84142b30 2024-04-17T05:27:30.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.388+0000 7f7b7aa00640 1 -- 172.21.15.123:0/3168984701 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b70035040 con 0x7f7b84142b30 2024-04-17T05:27:30.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.388+0000 7f7b89c00640 1 -- 172.21.15.123:0/3168984701 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b84072c60 con 0x7f7b84142b30 2024-04-17T05:27:30.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.388+0000 7f7b89c00640 1 -- 172.21.15.123:0/3168984701 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b84143cb0 con 0x7f7b84142b30 2024-04-17T05:27:30.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.389+0000 7f7b89c00640 1 -- 172.21.15.123:0/3168984701 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b840b90a0 con 0x7f7b84142b30 2024-04-17T05:27:30.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.390+0000 7f7b7aa00640 1 -- 172.21.15.123:0/3168984701 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7b7004b060 con 0x7f7b84142b30 2024-04-17T05:27:30.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.391+0000 7f7b7aa00640 1 --2- 172.21.15.123:0/3168984701 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f7b6406c8f0 0x7f7b6406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:30.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.391+0000 7f7b7aa00640 1 -- 172.21.15.123:0/3168984701 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f7b700ad940 con 0x7f7b84142b30 2024-04-17T05:27:30.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.392+0000 7f7b82a00640 1 --2- 172.21.15.123:0/3168984701 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f7b6406c8f0 0x7f7b6406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:30.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.393+0000 7f7b82a00640 1 --2- 172.21.15.123:0/3168984701 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f7b6406c8f0 0x7f7b6406edb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7b74003eb0 tx=0x7f7b74009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:30.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.396+0000 7f7b7aa00640 1 -- 172.21.15.123:0/3168984701 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f7b840b90a0 con 0x7f7b84142b30 2024-04-17T05:27:30.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.597+0000 7f7b89c00640 1 -- 172.21.15.123:0/3168984701 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7b84068a40 con 0x7f7b84142b30 2024-04-17T05:27:30.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.599+0000 7f7b7aa00640 1 -- 172.21.15.123:0/3168984701 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18526 (secure 0 0 0) 0x7f7b70031610 con 0x7f7b84142b30 2024-04-17T05:27:30.599 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:27:30.599 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":26,"fsid":"0787c5c0-e77a-4102-a899-30db48b19c68","created":"2024-04-17T05:26:33.031507+0000","modified":"2024-04-17T05:26:57.743352+0000","last_up_change":"2024-04-17T05:26:44.988433+0000","last_in_change":"2024-04-17T05:26:36.682131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T05:26:46.329778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T05:26:50.600195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T05:26:51.626498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T05:26:55.264044+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15c87cdb-9415-45a6-a2a6-ea6bec9daece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6801","nonce":840753170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6803","nonce":840753170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6807","nonce":840753170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6805","nonce":840753170}]},"public_addr":"172.21.15.123:6801/840753170","cluster_addr":"172.21.15.123:6803/840753170","heartbeat_back_addr":"172.21.15.123:6807/840753170","heartbeat_front_addr":"172.21.15.123:6805/840753170","state":["exists","up"]},{"osd":1,"uuid":"281751b5-486d-4845-b4aa-b308bf7cec62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6822","nonce":2231878927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6827","nonce":2231878927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6831","nonce":2231878927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6829","nonce":2231878927}]},"public_addr":"172.21.15.123:6822/2231878927","cluster_addr":"172.21.15.123:6827/2231878927","heartbeat_back_addr":"172.21.15.123:6831/2231878927","heartbeat_front_addr":"172.21.15.123:6829/2231878927","state":["exists","up"]},{"osd":2,"uuid":"b42257d3-bd20-4db5-aa37-1bf5c512d0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6817","nonce":754360844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6820","nonce":754360844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6825","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6826","nonce":754360844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6823","nonce":754360844}]},"public_addr":"172.21.15.123:6817/754360844","cluster_addr":"172.21.15.123:6820/754360844","heartbeat_back_addr":"172.21.15.123:6826/754360844","heartbeat_front_addr":"172.21.15.123:6823/754360844","state":["exists","up"]},{"osd":3,"uuid":"0f26b891-bbe6-478e-8dee-78e69bb48cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6809","nonce":2898088574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6811","nonce":2898088574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6815","nonce":2898088574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6813","nonce":2898088574}]},"public_addr":"172.21.15.123:6809/2898088574","cluster_addr":"172.21.15.123:6811/2898088574","heartbeat_back_addr":"172.21.15.123:6815/2898088574","heartbeat_front_addr":"172.21.15.123:6813/2898088574","state":["exists","up"]},{"osd":4,"uuid":"43e59318-2740-4625-9d64-eec1fd43c322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6801","nonce":606484349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6804","nonce":606484349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6812","nonce":606484349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6808","nonce":606484349}]},"public_addr":"172.21.15.164:6801/606484349","cluster_addr":"172.21.15.164:6804/606484349","heartbeat_back_addr":"172.21.15.164:6812/606484349","heartbeat_front_addr":"172.21.15.164:6808/606484349","state":["exists","up"]},{"osd":5,"uuid":"aaa3acf4-4adc-4337-aba3-363851d35310","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6805","nonce":1376989593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6809","nonce":1376989593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6815","nonce":1376989593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6813","nonce":1376989593}]},"public_addr":"172.21.15.164:6805/1376989593","cluster_addr":"172.21.15.164:6809/1376989593","heartbeat_back_addr":"172.21.15.164:6815/1376989593","heartbeat_front_addr":"172.21.15.164:6813/1376989593","state":["exists","up"]},{"osd":6,"uuid":"6f765b27-7377-4d81-9192-23a965651145","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6817","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6821","nonce":1594306924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6823","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6826","nonce":1594306924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6831","nonce":1594306924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6829","nonce":1594306924}]},"public_addr":"172.21.15.164:6821/1594306924","cluster_addr":"172.21.15.164:6826/1594306924","heartbeat_back_addr":"172.21.15.164:6831/1594306924","heartbeat_front_addr":"172.21.15.164:6829/1594306924","state":["exists","up"]},{"osd":7,"uuid":"5547394b-ec2f-4311-846d-369af4b1acf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6818","nonce":295402697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6819","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6820","nonce":295402697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6825","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6827","nonce":295402697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6824","nonce":295402697}]},"public_addr":"172.21.15.164:6818/295402697","cluster_addr":"172.21.15.164:6820/295402697","heartbeat_back_addr":"172.21.15.164:6827/295402697","heartbeat_front_addr":"172.21.15.164:6824/295402697","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.034807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.022201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.751897+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.850533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.083608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.047524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.314753+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.413586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T05:27:30.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.602+0000 7f7b89c00640 1 -- 172.21.15.123:0/3168984701 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f7b6406c8f0 msgr2=0x7f7b6406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:30.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.602+0000 7f7b89c00640 1 --2- 172.21.15.123:0/3168984701 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f7b6406c8f0 0x7f7b6406edb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7b74003eb0 tx=0x7f7b74009040 comp rx=0 tx=0).stop 2024-04-17T05:27:30.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.602+0000 7f7b89c00640 1 -- 172.21.15.123:0/3168984701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b84142b30 msgr2=0x7f7b840712e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:30.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.602+0000 7f7b89c00640 1 --2- 172.21.15.123:0/3168984701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b84142b30 0x7f7b840712e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7b70000c00 tx=0x7f7b700046c0 comp rx=0 tx=0).stop 2024-04-17T05:27:30.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.602+0000 7f7b89c00640 1 -- 172.21.15.123:0/3168984701 shutdown_connections 2024-04-17T05:27:30.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.602+0000 7f7b89c00640 1 --2- 172.21.15.123:0/3168984701 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b841499f0 0x7f7b8413ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:30.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.602+0000 7f7b89c00640 1 --2- 172.21.15.123:0/3168984701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b84142b30 0x7f7b840712e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:30.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.602+0000 7f7b89c00640 1 --2- 172.21.15.123:0/3168984701 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f7b6406c8f0 0x7f7b6406edb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:30.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.602+0000 7f7b89c00640 1 --2- 172.21.15.123:0/3168984701 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7b8409d630 0x7f7b84072600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:30.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.602+0000 7f7b89c00640 1 -- 172.21.15.123:0/3168984701 >> 172.21.15.123:0/3168984701 conn(0x7f7b840b93b0 msgr2=0x7f7b84145de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:30.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.602+0000 7f7b89c00640 1 -- 172.21.15.123:0/3168984701 shutdown_connections 2024-04-17T05:27:30.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.602+0000 7f7b89c00640 1 -- 172.21.15.123:0/3168984701 wait complete. 2024-04-17T05:27:30.620 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T05:26:46.329778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T05:26:50.600195+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T05:26:51.626498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T05:26:55.264044+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T05:27:30.620 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T05:27:30.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.831+0000 7f090d400640 1 Processor -- start 2024-04-17T05:27:30.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.831+0000 7f090d400640 1 -- start start 2024-04-17T05:27:30.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.832+0000 7f090d400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09080b3dd0 0x7f09080b5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:30.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.832+0000 7f090d400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09081400b0 con 0x7f09080b66c0 2024-04-17T05:27:30.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.832+0000 7f090d400640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09080b6aa0 con 0x7f09080732e0 2024-04-17T05:27:30.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.832+0000 7f090d400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f09080b4ca0 con 0x7f09080b3dd0 2024-04-17T05:27:30.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.833+0000 7f0907e00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f09080b66c0 0x7f090813f9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47866/0 (socket says 172.21.15.123:47866) 2024-04-17T05:27:30.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.833+0000 7f0907e00640 1 -- 172.21.15.123:0/2533692006 learned_addr learned my addr 172.21.15.123:0/2533692006 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:27:30.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.833+0000 7f0907400640 1 --2- 172.21.15.123:0/2533692006 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09080b3dd0 0x7f09080b5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:30.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.833+0000 7f0906a00640 1 -- 172.21.15.123:0/2533692006 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2337846980 0 0) 0x7f08f8001110 con 0x7f09080b66c0 2024-04-17T05:27:30.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.833+0000 7f0906a00640 1 -- 172.21.15.123:0/2533692006 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08ec003520 con 0x7f09080b66c0 2024-04-17T05:27:30.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.833+0000 7f0906a00640 1 -- 172.21.15.123:0/2533692006 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3614394247 0 0) 0x7f08ec003520 con 0x7f09080b66c0 2024-04-17T05:27:30.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.833+0000 7f0906a00640 1 -- 172.21.15.123:0/2533692006 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09080b3dd0 msgr2=0x7f09080b5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:30.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.833+0000 7f0906a00640 1 --2- 172.21.15.123:0/2533692006 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09080b3dd0 0x7f09080b5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:30.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.833+0000 7f0906a00640 1 -- 172.21.15.123:0/2533692006 >> v1:172.21.15.164:6789/0 conn(0x7f09080732e0 legacy=0x7f09081502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:30.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.833+0000 7f0906a00640 1 -- 172.21.15.123:0/2533692006 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09080b5af0 con 0x7f09080b66c0 2024-04-17T05:27:30.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.834+0000 7f0906a00640 1 -- 172.21.15.123:0/2533692006 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1042962670 0 0) 0x7f08f8001840 con 0x7f09080b66c0 2024-04-17T05:27:30.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.834+0000 7f0906a00640 1 -- 172.21.15.123:0/2533692006 >> v1:172.21.15.123:6789/0 conn(0x7f09080b66c0 legacy=0x7f090813f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:30.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.834+0000 7f0906a00640 1 --2- 172.21.15.123:0/2533692006 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f08ec0039e0 0x7f08ec003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:30.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.834+0000 7f0906a00640 1 --2- 172.21.15.123:0/2533692006 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09080b3dd0 0x7f08ec004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:30.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.834+0000 7f0906a00640 1 --2- 172.21.15.123:0/2533692006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08ec004d40 0x7f08ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:30.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.834+0000 7f0906a00640 1 -- 172.21.15.123:0/2533692006 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f09080b4ca0 con 0x7f08ec004d40 2024-04-17T05:27:30.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.834+0000 7f0906a00640 1 -- 172.21.15.123:0/2533692006 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f08ec00baf0 con 0x7f08ec0039e0 2024-04-17T05:27:30.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.834+0000 7f0906a00640 1 -- 172.21.15.123:0/2533692006 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f08ec00bcf0 con 0x7f09080b3dd0 2024-04-17T05:27:30.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.834+0000 7f090ca00640 1 --2- 172.21.15.123:0/2533692006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08ec004d40 0x7f08ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:30.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.834+0000 7f0907e00640 1 --2- 172.21.15.123:0/2533692006 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f08ec0039e0 0x7f08ec003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:30.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.834+0000 7f0907400640 1 --2- 172.21.15.123:0/2533692006 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09080b3dd0 0x7f08ec004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:30.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.834+0000 7f090ca00640 1 -- 172.21.15.123:0/2533692006 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09080b3dd0 msgr2=0x7f08ec004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:30.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.834+0000 7f090ca00640 1 --2- 172.21.15.123:0/2533692006 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09080b3dd0 0x7f08ec004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:30.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.834+0000 7f090ca00640 1 -- 172.21.15.123:0/2533692006 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f08ec0039e0 msgr2=0x7f08ec003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:30.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.834+0000 7f090ca00640 1 --2- 172.21.15.123:0/2533692006 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f08ec0039e0 0x7f08ec003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:30.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.834+0000 7f090ca00640 1 -- 172.21.15.123:0/2533692006 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08ec003520 con 0x7f08ec004d40 2024-04-17T05:27:30.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.836+0000 7f090ca00640 1 --2- 172.21.15.123:0/2533692006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08ec004d40 0x7f08ec0051c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0900001e50 tx=0x7f08ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d06336fd038187 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:30.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.836+0000 7f0906a00640 1 -- 172.21.15.123:0/2533692006 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0900001a70 con 0x7f08ec004d40 2024-04-17T05:27:30.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.836+0000 7f0906a00640 1 -- 172.21.15.123:0/2533692006 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0900003b70 con 0x7f08ec004d40 2024-04-17T05:27:30.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.836+0000 7f0906a00640 1 -- 172.21.15.123:0/2533692006 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09000050d0 con 0x7f08ec004d40 2024-04-17T05:27:30.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.836+0000 7f090d400640 1 -- 172.21.15.123:0/2533692006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08ec004d40 msgr2=0x7f08ec0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:30.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.836+0000 7f090d400640 1 --2- 172.21.15.123:0/2533692006 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08ec004d40 0x7f08ec0051c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0900001e50 tx=0x7f08ec005830 comp rx=0 tx=0).stop 2024-04-17T05:27:30.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.836+0000 7f090ca00640 1 -- 172.21.15.123:0/2533692006 reap_dead start 2024-04-17T05:27:30.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.836+0000 7f090d400640 1 -- 172.21.15.123:0/2533692006 shutdown_connections 2024-04-17T05:27:30.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.836+0000 7f090d400640 1 -- 172.21.15.123:0/2533692006 >> 172.21.15.123:0/2533692006 conn(0x7f09080b9a30 msgr2=0x7f09080b5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:30.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.836+0000 7f090d400640 1 -- 172.21.15.123:0/2533692006 shutdown_connections 2024-04-17T05:27:30.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.837+0000 7f090d400640 1 -- 172.21.15.123:0/2533692006 wait complete. 2024-04-17T05:27:30.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.838+0000 7f090d400640 1 Processor -- start 2024-04-17T05:27:30.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.838+0000 7f090d400640 1 -- start start 2024-04-17T05:27:30.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.839+0000 7f090d400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f090813ed00 0x7f09081e1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:30.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.839+0000 7f090d400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09081e1860 0x7f09081392f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:30.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.839+0000 7f090d400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0908139830 0x7f09081cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:30.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.839+0000 7f090d400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f09080b5490 con 0x7f090813ed00 2024-04-17T05:27:30.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.839+0000 7f090d400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f09080b4930 con 0x7f09081e1860 2024-04-17T05:27:30.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.839+0000 7f090d400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f09080b5610 con 0x7f0908139830 2024-04-17T05:27:30.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.839+0000 7f0907e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f090813ed00 0x7f09081e1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:30.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.839+0000 7f0907e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f090813ed00 0x7f09081e1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42662/0 (socket says 172.21.15.123:42662) 2024-04-17T05:27:30.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.839+0000 7f0907e00640 1 -- 172.21.15.123:0/54544837 learned_addr learned my addr 172.21.15.123:0/54544837 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:30.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.840+0000 7f0907400640 1 --2- 172.21.15.123:0/54544837 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09081e1860 0x7f09081392f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:30.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.840+0000 7f0907e00640 1 -- 172.21.15.123:0/54544837 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0908139830 msgr2=0x7f09081cfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:30.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.840+0000 7f0907e00640 1 --2- 172.21.15.123:0/54544837 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0908139830 0x7f09081cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:30.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.840+0000 7f0907e00640 1 -- 172.21.15.123:0/54544837 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09081e1860 msgr2=0x7f09081392f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:30.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.840+0000 7f0907e00640 1 --2- 172.21.15.123:0/54544837 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09081e1860 0x7f09081392f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:30.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.840+0000 7f0907e00640 1 -- 172.21.15.123:0/54544837 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09081e1cc0 con 0x7f090813ed00 2024-04-17T05:27:30.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.840+0000 7f0907e00640 1 --2- 172.21.15.123:0/54544837 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f090813ed00 0x7f09081e1320 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f08f80073b0 tx=0x7f08f8007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:30.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.840+0000 7f08ffe00640 1 -- 172.21.15.123:0/54544837 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f8007e60 con 0x7f090813ed00 2024-04-17T05:27:30.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.840+0000 7f08ffe00640 1 -- 172.21.15.123:0/54544837 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08f8018070 con 0x7f090813ed00 2024-04-17T05:27:30.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.840+0000 7f090d400640 1 -- 172.21.15.123:0/54544837 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f090813f0e0 con 0x7f090813ed00 2024-04-17T05:27:30.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.840+0000 7f08ffe00640 1 -- 172.21.15.123:0/54544837 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f800eae0 con 0x7f090813ed00 2024-04-17T05:27:30.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.840+0000 7f090d400640 1 -- 172.21.15.123:0/54544837 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09080b2240 con 0x7f090813ed00 2024-04-17T05:27:30.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.841+0000 7f090d400640 1 -- 172.21.15.123:0/54544837 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0908075b30 con 0x7f090813ed00 2024-04-17T05:27:30.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.842+0000 7f08ffe00640 1 -- 172.21.15.123:0/54544837 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f08f800ec80 con 0x7f090813ed00 2024-04-17T05:27:30.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.843+0000 7f08ffe00640 1 --2- 172.21.15.123:0/54544837 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f08e806c8f0 0x7f08e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:30.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.843+0000 7f08ffe00640 1 -- 172.21.15.123:0/54544837 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f08f808be30 con 0x7f090813ed00 2024-04-17T05:27:30.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.844+0000 7f0907400640 1 --2- 172.21.15.123:0/54544837 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f08e806c8f0 0x7f08e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:30.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.845+0000 7f0907400640 1 --2- 172.21.15.123:0/54544837 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f08e806c8f0 0x7f08e806edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0908143860 tx=0x7f08f4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:30.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:30.848+0000 7f08ffe00640 1 -- 172.21.15.123:0/54544837 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f09081400b0 con 0x7f090813ed00 2024-04-17T05:27:31.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.047+0000 7f090d400640 1 -- 172.21.15.123:0/54544837 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f09080b33b0 con 0x7f090813ed00 2024-04-17T05:27:31.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.048+0000 7f08ffe00640 1 -- 172.21.15.123:0/54544837 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f08f8059f10 con 0x7f090813ed00 2024-04-17T05:27:31.047 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-04-17T05:27:31.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.051+0000 7f090d400640 1 -- 172.21.15.123:0/54544837 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f08e806c8f0 msgr2=0x7f08e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:31.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.051+0000 7f090d400640 1 --2- 172.21.15.123:0/54544837 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f08e806c8f0 0x7f08e806edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0908143860 tx=0x7f08f4008040 comp rx=0 tx=0).stop 2024-04-17T05:27:31.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.051+0000 7f090d400640 1 -- 172.21.15.123:0/54544837 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f090813ed00 msgr2=0x7f09081e1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:31.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.051+0000 7f090d400640 1 --2- 172.21.15.123:0/54544837 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f090813ed00 0x7f09081e1320 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f08f80073b0 tx=0x7f08f8007870 comp rx=0 tx=0).stop 2024-04-17T05:27:31.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.051+0000 7f090d400640 1 -- 172.21.15.123:0/54544837 shutdown_connections 2024-04-17T05:27:31.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.051+0000 7f090d400640 1 --2- 172.21.15.123:0/54544837 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f08e806c8f0 0x7f08e806edb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:31.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.051+0000 7f090d400640 1 --2- 172.21.15.123:0/54544837 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0908139830 0x7f09081cfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:31.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.051+0000 7f090d400640 1 --2- 172.21.15.123:0/54544837 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09081e1860 0x7f09081392f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:31.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.051+0000 7f090d400640 1 --2- 172.21.15.123:0/54544837 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f090813ed00 0x7f09081e1320 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:31.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.051+0000 7f090d400640 1 -- 172.21.15.123:0/54544837 >> 172.21.15.123:0/54544837 conn(0x7f09080b9a30 msgr2=0x7f090806cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:31.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.051+0000 7f090d400640 1 -- 172.21.15.123:0/54544837 shutdown_connections 2024-04-17T05:27:31.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.052+0000 7f090d400640 1 -- 172.21.15.123:0/54544837 wait complete. 2024-04-17T05:27:31.070 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T05:27:31.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.284+0000 7fee81800640 1 Processor -- start 2024-04-17T05:27:31.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.284+0000 7fee81800640 1 -- start start 2024-04-17T05:27:31.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.285+0000 7fee81800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fee7c0b58f0 0x7fee7c1482f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:31.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.285+0000 7fee81800640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee7c0b65d0 con 0x7fee7c147ed0 2024-04-17T05:27:31.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.285+0000 7fee81800640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee7c0b75a0 con 0x7fee7c0b61f0 2024-04-17T05:27:31.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.285+0000 7fee81800640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fee7c0b4d50 con 0x7fee7c0b58f0 2024-04-17T05:27:31.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.286+0000 7fee80e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fee7c0b58f0 0x7fee7c1482f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:31.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.286+0000 7fee80e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fee7c0b58f0 0x7fee7c1482f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42678/0 (socket says 172.21.15.123:42678) 2024-04-17T05:27:31.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.286+0000 7fee73400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fee7c147ed0 0x7fee7c0b51e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47872/0 (socket says 172.21.15.123:47872) 2024-04-17T05:27:31.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.286+0000 7fee80e00640 1 -- 172.21.15.123:0/2628603138 learned_addr learned my addr 172.21.15.123:0/2628603138 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:31.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.286+0000 7fee80e00640 1 -- 172.21.15.123:0/2628603138 >> v1:172.21.15.164:6789/0 conn(0x7fee7c0b61f0 legacy=0x7fee7c0b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:31.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.286+0000 7fee80e00640 1 -- 172.21.15.123:0/2628603138 >> v1:172.21.15.123:6789/0 conn(0x7fee7c147ed0 legacy=0x7fee7c0b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:31.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.286+0000 7fee80e00640 1 -- 172.21.15.123:0/2628603138 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee7c0b49e0 con 0x7fee7c0b58f0 2024-04-17T05:27:31.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.287+0000 7fee80e00640 1 --2- 172.21.15.123:0/2628603138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee7c0b58f0 0x7fee7c1482f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fee74009e50 tx=0x7fee7402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7004d7a8dbfe468 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:31.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.287+0000 7fee7b400640 1 -- 172.21.15.123:0/2628603138 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7402cb20 con 0x7fee7c0b58f0 2024-04-17T05:27:31.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.287+0000 7fee7b400640 1 -- 172.21.15.123:0/2628603138 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee7402ccc0 con 0x7fee7c0b58f0 2024-04-17T05:27:31.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.287+0000 7fee7b400640 1 -- 172.21.15.123:0/2628603138 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee74034610 con 0x7fee7c0b58f0 2024-04-17T05:27:31.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.288+0000 7fee81800640 1 -- 172.21.15.123:0/2628603138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee7c0b58f0 msgr2=0x7fee7c1482f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:31.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.288+0000 7fee81800640 1 --2- 172.21.15.123:0/2628603138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee7c0b58f0 0x7fee7c1482f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fee74009e50 tx=0x7fee7402bf80 comp rx=0 tx=0).stop 2024-04-17T05:27:31.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.288+0000 7fee81800640 1 -- 172.21.15.123:0/2628603138 shutdown_connections 2024-04-17T05:27:31.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.288+0000 7fee81800640 1 --2- 172.21.15.123:0/2628603138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee7c0b58f0 0x7fee7c1482f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:31.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.288+0000 7fee81800640 1 -- 172.21.15.123:0/2628603138 >> 172.21.15.123:0/2628603138 conn(0x7fee7c06c260 msgr2=0x7fee7c0b9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:31.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.288+0000 7fee81800640 1 -- 172.21.15.123:0/2628603138 shutdown_connections 2024-04-17T05:27:31.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.288+0000 7fee81800640 1 -- 172.21.15.123:0/2628603138 wait complete. 2024-04-17T05:27:31.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.290+0000 7fee81800640 1 Processor -- start 2024-04-17T05:27:31.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.290+0000 7fee81800640 1 -- start start 2024-04-17T05:27:31.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.291+0000 7fee81800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee7c0b58f0 0x7fee7c141440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:31.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.291+0000 7fee81800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee7c0b61f0 0x7fee7c13eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:31.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.291+0000 7fee81800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee7c147ed0 0x7fee7c14a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:31.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.291+0000 7fee81800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fee7c1534b0 con 0x7fee7c0b61f0 2024-04-17T05:27:31.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.291+0000 7fee81800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fee7c153330 con 0x7fee7c0b58f0 2024-04-17T05:27:31.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.291+0000 7fee81800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fee7c153630 con 0x7fee7c147ed0 2024-04-17T05:27:31.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.291+0000 7fee73400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee7c0b61f0 0x7fee7c13eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:31.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.291+0000 7fee73400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee7c0b61f0 0x7fee7c13eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42692/0 (socket says 172.21.15.123:42692) 2024-04-17T05:27:31.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.291+0000 7fee73400640 1 -- 172.21.15.123:0/3173408446 learned_addr learned my addr 172.21.15.123:0/3173408446 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:31.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.291+0000 7fee7be00640 1 --2- 172.21.15.123:0/3173408446 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee7c0b58f0 0x7fee7c141440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:31.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.291+0000 7fee73400640 1 -- 172.21.15.123:0/3173408446 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee7c147ed0 msgr2=0x7fee7c14a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:31.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.291+0000 7fee73400640 1 --2- 172.21.15.123:0/3173408446 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee7c147ed0 0x7fee7c14a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:31.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.291+0000 7fee73400640 1 -- 172.21.15.123:0/3173408446 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee7c0b58f0 msgr2=0x7fee7c141440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:31.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.291+0000 7fee73400640 1 --2- 172.21.15.123:0/3173408446 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee7c0b58f0 0x7fee7c141440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:31.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.291+0000 7fee73400640 1 -- 172.21.15.123:0/3173408446 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee7c13f000 con 0x7fee7c0b61f0 2024-04-17T05:27:31.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.292+0000 7fee73400640 1 --2- 172.21.15.123:0/3173408446 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee7c0b61f0 0x7fee7c13eac0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fee6400c400 tx=0x7fee6400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:31.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.292+0000 7fee78c00640 1 -- 172.21.15.123:0/3173408446 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee640074e0 con 0x7fee7c0b61f0 2024-04-17T05:27:31.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.292+0000 7fee78c00640 1 -- 172.21.15.123:0/3173408446 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee64007680 con 0x7fee7c0b61f0 2024-04-17T05:27:31.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.292+0000 7fee78c00640 1 -- 172.21.15.123:0/3173408446 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee64004a00 con 0x7fee7c0b61f0 2024-04-17T05:27:31.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.292+0000 7fee81800640 1 -- 172.21.15.123:0/3173408446 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee7c14abc0 con 0x7fee7c0b61f0 2024-04-17T05:27:31.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.292+0000 7fee81800640 1 -- 172.21.15.123:0/3173408446 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee7c141b60 con 0x7fee7c0b61f0 2024-04-17T05:27:31.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.293+0000 7fee81800640 1 -- 172.21.15.123:0/3173408446 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee7c06cbc0 con 0x7fee7c0b61f0 2024-04-17T05:27:31.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.294+0000 7fee78c00640 1 -- 172.21.15.123:0/3173408446 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fee6401a020 con 0x7fee7c0b61f0 2024-04-17T05:27:31.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.295+0000 7fee78c00640 1 --2- 172.21.15.123:0/3173408446 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fee5806c8f0 0x7fee5806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:31.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.295+0000 7fee78c00640 1 -- 172.21.15.123:0/3173408446 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fee6408b700 con 0x7fee7c0b61f0 2024-04-17T05:27:31.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.296+0000 7fee7be00640 1 --2- 172.21.15.123:0/3173408446 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fee5806c8f0 0x7fee5806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:31.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.296+0000 7fee7be00640 1 --2- 172.21.15.123:0/3173408446 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fee5806c8f0 0x7fee5806edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fee7c13e570 tx=0x7fee6c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:31.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.300+0000 7fee78c00640 1 -- 172.21.15.123:0/3173408446 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fee640597e0 con 0x7fee7c0b61f0 2024-04-17T05:27:31.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.500+0000 7fee81800640 1 -- 172.21.15.123:0/3173408446 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fee7c075b30 con 0x7fee7c0b61f0 2024-04-17T05:27:31.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.501+0000 7fee78c00640 1 -- 172.21.15.123:0/3173408446 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7fee640590e0 con 0x7fee7c0b61f0 2024-04-17T05:27:31.500 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-04-17T05:27:31.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.503+0000 7fee81800640 1 -- 172.21.15.123:0/3173408446 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fee5806c8f0 msgr2=0x7fee5806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:31.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.503+0000 7fee81800640 1 --2- 172.21.15.123:0/3173408446 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fee5806c8f0 0x7fee5806edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fee7c13e570 tx=0x7fee6c009040 comp rx=0 tx=0).stop 2024-04-17T05:27:31.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.503+0000 7fee81800640 1 -- 172.21.15.123:0/3173408446 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee7c0b61f0 msgr2=0x7fee7c13eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:31.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.503+0000 7fee81800640 1 --2- 172.21.15.123:0/3173408446 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee7c0b61f0 0x7fee7c13eac0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fee6400c400 tx=0x7fee6400c8c0 comp rx=0 tx=0).stop 2024-04-17T05:27:31.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.503+0000 7fee81800640 1 -- 172.21.15.123:0/3173408446 shutdown_connections 2024-04-17T05:27:31.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.503+0000 7fee81800640 1 --2- 172.21.15.123:0/3173408446 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fee5806c8f0 0x7fee5806edb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:31.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.503+0000 7fee81800640 1 --2- 172.21.15.123:0/3173408446 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fee7c147ed0 0x7fee7c14a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:31.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.503+0000 7fee81800640 1 --2- 172.21.15.123:0/3173408446 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee7c0b61f0 0x7fee7c13eac0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:31.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.503+0000 7fee81800640 1 --2- 172.21.15.123:0/3173408446 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fee7c0b58f0 0x7fee7c141440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:31.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.503+0000 7fee81800640 1 -- 172.21.15.123:0/3173408446 >> 172.21.15.123:0/3173408446 conn(0x7fee7c06c260 msgr2=0x7fee7c0b7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:31.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.503+0000 7fee81800640 1 -- 172.21.15.123:0/3173408446 shutdown_connections 2024-04-17T05:27:31.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.503+0000 7fee81800640 1 -- 172.21.15.123:0/3173408446 wait complete. 2024-04-17T05:27:31.522 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T05:27:31.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.739+0000 7f0725c00640 1 Processor -- start 2024-04-17T05:27:31.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.740+0000 7f0725c00640 1 -- start start 2024-04-17T05:27:31.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.740+0000 7f0725c00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f07200b66c0 0x7f07200b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:31.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.741+0000 7f0725c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07200b5490 0x7f072013f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:31.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.741+0000 7f0725c00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07200b6aa0 con 0x7f07200732e0 2024-04-17T05:27:31.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.741+0000 7f0725c00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f07200b4ca0 con 0x7f07200b66c0 2024-04-17T05:27:31.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.741+0000 7f0725c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f07200b5af0 con 0x7f07200b5490 2024-04-17T05:27:31.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.741+0000 7f0725200640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f07200732e0 0x7f072006cdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47882/0 (socket says 172.21.15.123:47882) 2024-04-17T05:27:31.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.741+0000 7f0725200640 1 -- 172.21.15.123:0/1240227130 learned_addr learned my addr 172.21.15.123:0/1240227130 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:27:31.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.741+0000 7f071fe00640 1 --2- 172.21.15.123:0/1240227130 >> v2:172.21.15.164:3300/0 conn(0x7f07200b66c0 0x7f07200b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:31.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.741+0000 7f071f400640 1 --2- 172.21.15.123:0/1240227130 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07200b5490 0x7f072013f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:31.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.742+0000 7f071ea00640 1 -- 172.21.15.123:0/1240227130 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2756838905 0 0) 0x7f07200b6aa0 con 0x7f07200732e0 2024-04-17T05:27:31.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.742+0000 7f071ea00640 1 -- 172.21.15.123:0/1240227130 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0704003520 con 0x7f07200732e0 2024-04-17T05:27:31.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.742+0000 7f071ea00640 1 -- 172.21.15.123:0/1240227130 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1302396446 0 0) 0x7f0704003520 con 0x7f07200732e0 2024-04-17T05:27:31.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.742+0000 7f071ea00640 1 -- 172.21.15.123:0/1240227130 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07200b5490 msgr2=0x7f072013f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:31.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.742+0000 7f071ea00640 1 --2- 172.21.15.123:0/1240227130 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07200b5490 0x7f072013f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:31.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.742+0000 7f071ea00640 1 -- 172.21.15.123:0/1240227130 >> v2:172.21.15.164:3300/0 conn(0x7f07200b66c0 msgr2=0x7f07200b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:31.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.742+0000 7f071ea00640 1 --2- 172.21.15.123:0/1240227130 >> v2:172.21.15.164:3300/0 conn(0x7f07200b66c0 0x7f07200b3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:31.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.742+0000 7f071ea00640 1 -- 172.21.15.123:0/1240227130 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f072009c480 con 0x7f07200732e0 2024-04-17T05:27:31.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.742+0000 7f071ea00640 1 -- 172.21.15.123:0/1240227130 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1042962670 0 0) 0x7f0718001670 con 0x7f07200732e0 2024-04-17T05:27:31.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.742+0000 7f071ea00640 1 -- 172.21.15.123:0/1240227130 >> v1:172.21.15.123:6789/0 conn(0x7f07200732e0 legacy=0x7f072006cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:31.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.742+0000 7f071ea00640 1 --2- 172.21.15.123:0/1240227130 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f07040039b0 0x7f0704003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:31.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.742+0000 7f071ea00640 1 --2- 172.21.15.123:0/1240227130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0704004800 0x7f0704004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:31.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.742+0000 7f071ea00640 1 --2- 172.21.15.123:0/1240227130 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07200b5490 0x7f07040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:31.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.742+0000 7f071ea00640 1 -- 172.21.15.123:0/1240227130 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f07200b4ca0 con 0x7f0704004800 2024-04-17T05:27:31.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.742+0000 7f071ea00640 1 -- 172.21.15.123:0/1240227130 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f07200b5af0 con 0x7f07040039b0 2024-04-17T05:27:31.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.742+0000 7f071ea00640 1 -- 172.21.15.123:0/1240227130 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f070400b9c0 con 0x7f07200b5490 2024-04-17T05:27:31.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.742+0000 7f071f400640 1 --2- 172.21.15.123:0/1240227130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0704004800 0x7f0704004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:31.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.743+0000 7f071fe00640 1 --2- 172.21.15.123:0/1240227130 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f07040039b0 0x7f0704003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:31.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.743+0000 7f071f400640 1 -- 172.21.15.123:0/1240227130 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07200b5490 msgr2=0x7f07040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:31.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.743+0000 7f0725200640 1 --2- 172.21.15.123:0/1240227130 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07200b5490 0x7f07040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:31.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.743+0000 7f071f400640 1 --2- 172.21.15.123:0/1240227130 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07200b5490 0x7f07040051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:31.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.743+0000 7f071f400640 1 -- 172.21.15.123:0/1240227130 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f07040039b0 msgr2=0x7f0704003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:31.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.743+0000 7f071f400640 1 --2- 172.21.15.123:0/1240227130 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f07040039b0 0x7f0704003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:31.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.743+0000 7f071f400640 1 -- 172.21.15.123:0/1240227130 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0704003520 con 0x7f0704004800 2024-04-17T05:27:31.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.743+0000 7f071fe00640 1 --2- 172.21.15.123:0/1240227130 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f07040039b0 0x7f0704003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T05:27:31.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.744+0000 7f071f400640 1 --2- 172.21.15.123:0/1240227130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0704004800 0x7f0704004c80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f070c009af0 tx=0x7f0704005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81505d880119f180 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:31.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.744+0000 7f071ea00640 1 -- 172.21.15.123:0/1240227130 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070c039070 con 0x7f0704004800 2024-04-17T05:27:31.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.744+0000 7f071ea00640 1 -- 172.21.15.123:0/1240227130 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f070c02c6b0 con 0x7f0704004800 2024-04-17T05:27:31.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.744+0000 7f071ea00640 1 -- 172.21.15.123:0/1240227130 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070c009690 con 0x7f0704004800 2024-04-17T05:27:31.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.745+0000 7f0725c00640 1 -- 172.21.15.123:0/1240227130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0704004800 msgr2=0x7f0704004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:31.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.745+0000 7f0725c00640 1 --2- 172.21.15.123:0/1240227130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0704004800 0x7f0704004c80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f070c009af0 tx=0x7f0704005830 comp rx=0 tx=0).stop 2024-04-17T05:27:31.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.745+0000 7f0725200640 1 -- 172.21.15.123:0/1240227130 reap_dead start 2024-04-17T05:27:31.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.745+0000 7f0725c00640 1 -- 172.21.15.123:0/1240227130 shutdown_connections 2024-04-17T05:27:31.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.745+0000 7f0725c00640 1 -- 172.21.15.123:0/1240227130 >> 172.21.15.123:0/1240227130 conn(0x7f07200b9a30 msgr2=0x7f07200b5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:31.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.745+0000 7f0725c00640 1 -- 172.21.15.123:0/1240227130 shutdown_connections 2024-04-17T05:27:31.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.745+0000 7f0725c00640 1 -- 172.21.15.123:0/1240227130 wait complete. 2024-04-17T05:27:31.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.747+0000 7f0725c00640 1 Processor -- start 2024-04-17T05:27:31.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.747+0000 7f0725c00640 1 -- start start 2024-04-17T05:27:31.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.748+0000 7f0725c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0704004800 0x7f072013edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:31.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.748+0000 7f0725c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07200af5e0 0x7f07200b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:31.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.748+0000 7f0725c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07200b1c90 0x7f07201e0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:31.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.748+0000 7f0725c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f07200738c0 con 0x7f07200af5e0 2024-04-17T05:27:31.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.748+0000 7f0725c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f0720073740 con 0x7f0704004800 2024-04-17T05:27:31.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.748+0000 7f0725c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f0720073a40 con 0x7f07200b1c90 2024-04-17T05:27:31.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.748+0000 7f071f400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07200af5e0 0x7f07200b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:31.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.748+0000 7f071f400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07200af5e0 0x7f07200b0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42710/0 (socket says 172.21.15.123:42710) 2024-04-17T05:27:31.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.748+0000 7f071f400640 1 -- 172.21.15.123:0/3441596251 learned_addr learned my addr 172.21.15.123:0/3441596251 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:31.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.748+0000 7f0725200640 1 --2- 172.21.15.123:0/3441596251 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07200b1c90 0x7f07201e0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:31.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.748+0000 7f071fe00640 1 --2- 172.21.15.123:0/3441596251 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0704004800 0x7f072013edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:31.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.748+0000 7f071f400640 1 -- 172.21.15.123:0/3441596251 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07200b1c90 msgr2=0x7f07201e0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:31.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.748+0000 7f071f400640 1 --2- 172.21.15.123:0/3441596251 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07200b1c90 0x7f07201e0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:31.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.748+0000 7f071f400640 1 -- 172.21.15.123:0/3441596251 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0704004800 msgr2=0x7f072013edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:31.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.748+0000 7f071f400640 1 --2- 172.21.15.123:0/3441596251 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0704004800 0x7f072013edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:31.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.748+0000 7f071f400640 1 -- 172.21.15.123:0/3441596251 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07200b1520 con 0x7f07200af5e0 2024-04-17T05:27:31.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.748+0000 7f0725200640 1 --2- 172.21.15.123:0/3441596251 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07200b1c90 0x7f07201e0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:31.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.749+0000 7f071fe00640 1 --2- 172.21.15.123:0/3441596251 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0704004800 0x7f072013edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:31.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.749+0000 7f071f400640 1 --2- 172.21.15.123:0/3441596251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07200af5e0 0x7f07200b0dc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f070c037040 tx=0x7f070c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:31.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.749+0000 7f0717e00640 1 -- 172.21.15.123:0/3441596251 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070c042020 con 0x7f07200af5e0 2024-04-17T05:27:31.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.749+0000 7f0717e00640 1 -- 172.21.15.123:0/3441596251 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f070c03a040 con 0x7f07200af5e0 2024-04-17T05:27:31.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.749+0000 7f0717e00640 1 -- 172.21.15.123:0/3441596251 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070c039070 con 0x7f07200af5e0 2024-04-17T05:27:31.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.749+0000 7f0725c00640 1 -- 172.21.15.123:0/3441596251 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07200b1800 con 0x7f07200af5e0 2024-04-17T05:27:31.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.749+0000 7f0725c00640 1 -- 172.21.15.123:0/3441596251 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07200b2110 con 0x7f07200af5e0 2024-04-17T05:27:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.750+0000 7f0725c00640 1 -- 172.21.15.123:0/3441596251 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0720075b30 con 0x7f07200af5e0 2024-04-17T05:27:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.751+0000 7f0717e00640 1 -- 172.21.15.123:0/3441596251 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f070c045020 con 0x7f07200af5e0 2024-04-17T05:27:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.752+0000 7f0717e00640 1 --2- 172.21.15.123:0/3441596251 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f070006c920 0x7f070006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.752+0000 7f0717e00640 1 -- 172.21.15.123:0/3441596251 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f070c0ad290 con 0x7f07200af5e0 2024-04-17T05:27:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.753+0000 7f071fe00640 1 --2- 172.21.15.123:0/3441596251 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f070006c920 0x7f070006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:31.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.754+0000 7f071fe00640 1 --2- 172.21.15.123:0/3441596251 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f070006c920 0x7f070006ede0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f07201cfb10 tx=0x7f071000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:31.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.757+0000 7f0717e00640 1 -- 172.21.15.123:0/3441596251 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f070c04c070 con 0x7f07200af5e0 2024-04-17T05:27:31.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.960+0000 7f0725c00640 1 -- 172.21.15.123:0/3441596251 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f072013e5c0 con 0x7f07200af5e0 2024-04-17T05:27:31.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.961+0000 7f0717e00640 1 -- 172.21.15.123:0/3441596251 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f070c081070 con 0x7f07200af5e0 2024-04-17T05:27:31.960 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-04-17T05:27:31.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.964+0000 7f0725c00640 1 -- 172.21.15.123:0/3441596251 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f070006c920 msgr2=0x7f070006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:31.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.964+0000 7f0725c00640 1 --2- 172.21.15.123:0/3441596251 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f070006c920 0x7f070006ede0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f07201cfb10 tx=0x7f071000b040 comp rx=0 tx=0).stop 2024-04-17T05:27:31.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.964+0000 7f0725c00640 1 -- 172.21.15.123:0/3441596251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07200af5e0 msgr2=0x7f07200b0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:31.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.964+0000 7f0725c00640 1 --2- 172.21.15.123:0/3441596251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07200af5e0 0x7f07200b0dc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f070c037040 tx=0x7f070c004730 comp rx=0 tx=0).stop 2024-04-17T05:27:31.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.964+0000 7f0725c00640 1 -- 172.21.15.123:0/3441596251 shutdown_connections 2024-04-17T05:27:31.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.964+0000 7f0725c00640 1 --2- 172.21.15.123:0/3441596251 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f070006c920 0x7f070006ede0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:31.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.964+0000 7f0725c00640 1 --2- 172.21.15.123:0/3441596251 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f07200b1c90 0x7f07201e0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:31.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.964+0000 7f0725c00640 1 --2- 172.21.15.123:0/3441596251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07200af5e0 0x7f07200b0dc0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:31.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.964+0000 7f0725c00640 1 --2- 172.21.15.123:0/3441596251 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0704004800 0x7f072013edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:31.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.964+0000 7f0725c00640 1 -- 172.21.15.123:0/3441596251 >> 172.21.15.123:0/3441596251 conn(0x7f07200b9a30 msgr2=0x7f072013f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:31.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.964+0000 7f0725c00640 1 -- 172.21.15.123:0/3441596251 shutdown_connections 2024-04-17T05:27:31.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:31.965+0000 7f0725c00640 1 -- 172.21.15.123:0/3441596251 wait complete. 2024-04-17T05:27:31.982 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T05:27:32.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.199+0000 7fd45d000640 1 Processor -- start 2024-04-17T05:27:32.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.200+0000 7fd45d000640 1 -- start start 2024-04-17T05:27:32.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.201+0000 7fd45d000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd45809da10 0x7fd458143240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:32.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.201+0000 7fd45d000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd45809cc30 con 0x7fd4581499f0 2024-04-17T05:27:32.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.201+0000 7fd45d000640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd45809b3c0 con 0x7fd45809d630 2024-04-17T05:27:32.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.201+0000 7fd45d000640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd45809bcf0 con 0x7fd45809da10 2024-04-17T05:27:32.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.201+0000 7fd456800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd45809da10 0x7fd458143240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:32.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.201+0000 7fd44d400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd4581499f0 0x7fd458142b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47886/0 (socket says 172.21.15.123:47886) 2024-04-17T05:27:32.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.201+0000 7fd44d400640 1 -- 172.21.15.123:0/1173886430 learned_addr learned my addr 172.21.15.123:0/1173886430 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:27:32.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.202+0000 7fd456800640 1 -- 172.21.15.123:0/1173886430 >> v1:172.21.15.164:6789/0 conn(0x7fd45809d630 legacy=0x7fd4581492e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:32.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.202+0000 7fd456800640 1 -- 172.21.15.123:0/1173886430 >> v1:172.21.15.123:6789/0 conn(0x7fd4581499f0 legacy=0x7fd458142b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:32.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.202+0000 7fd455400640 1 -- 172.21.15.123:0/1173886430 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1522823519 0 0) 0x7fd45809cc30 con 0x7fd4581499f0 2024-04-17T05:27:32.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.202+0000 7fd456800640 1 -- 172.21.15.123:0/1173886430 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd45809b6a0 con 0x7fd45809da10 2024-04-17T05:27:32.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.203+0000 7fd456800640 1 --2- 172.21.15.123:0/1173886430 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd45809da10 0x7fd458143240 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd45809be70 tx=0x7fd45002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db10a07ad4f0c5c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:32.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.204+0000 7fd455400640 1 -- 172.21.15.123:0/1173886430 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd450035020 con 0x7fd45809da10 2024-04-17T05:27:32.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.204+0000 7fd455400640 1 -- 172.21.15.123:0/1173886430 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd450031830 con 0x7fd45809da10 2024-04-17T05:27:32.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.204+0000 7fd455400640 1 -- 172.21.15.123:0/1173886430 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd450031c00 con 0x7fd45809da10 2024-04-17T05:27:32.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.204+0000 7fd45d000640 1 -- 172.21.15.123:0/1173886430 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd45809da10 msgr2=0x7fd458143240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:32.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.204+0000 7fd45d000640 1 --2- 172.21.15.123:0/1173886430 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd45809da10 0x7fd458143240 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd45809be70 tx=0x7fd45002b8d0 comp rx=0 tx=0).stop 2024-04-17T05:27:32.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.205+0000 7fd45d000640 1 -- 172.21.15.123:0/1173886430 shutdown_connections 2024-04-17T05:27:32.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.205+0000 7fd45d000640 1 --2- 172.21.15.123:0/1173886430 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd45809da10 0x7fd458143240 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:32.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.205+0000 7fd45d000640 1 -- 172.21.15.123:0/1173886430 >> 172.21.15.123:0/1173886430 conn(0x7fd4580b93b0 msgr2=0x7fd4580b97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:32.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.205+0000 7fd45d000640 1 -- 172.21.15.123:0/1173886430 shutdown_connections 2024-04-17T05:27:32.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.205+0000 7fd45d000640 1 -- 172.21.15.123:0/1173886430 wait complete. 2024-04-17T05:27:32.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.206+0000 7fd45d000640 1 Processor -- start 2024-04-17T05:27:32.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.206+0000 7fd45d000640 1 -- start start 2024-04-17T05:27:32.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.207+0000 7fd45d000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd45809d630 0x7fd4580b3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:32.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.207+0000 7fd45d000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd45809da10 0x7fd4581db420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:32.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.207+0000 7fd45d000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4581499f0 0x7fd458098480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:32.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.207+0000 7fd45d000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd4580b5b10 con 0x7fd4581499f0 2024-04-17T05:27:32.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.207+0000 7fd45d000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd45809cea0 con 0x7fd45809d630 2024-04-17T05:27:32.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.207+0000 7fd45d000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fd4580b5c90 con 0x7fd45809da10 2024-04-17T05:27:32.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.208+0000 7fd456800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4581499f0 0x7fd458098480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:32.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.208+0000 7fd456800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4581499f0 0x7fd458098480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42734/0 (socket says 172.21.15.123:42734) 2024-04-17T05:27:32.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.208+0000 7fd456800640 1 -- 172.21.15.123:0/3970415467 learned_addr learned my addr 172.21.15.123:0/3970415467 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:32.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.208+0000 7fd44d400640 1 --2- 172.21.15.123:0/3970415467 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd45809da10 0x7fd4581db420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:32.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.208+0000 7fd456800640 1 -- 172.21.15.123:0/3970415467 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd45809da10 msgr2=0x7fd4581db420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:32.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.208+0000 7fd456800640 1 --2- 172.21.15.123:0/3970415467 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd45809da10 0x7fd4581db420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:32.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.208+0000 7fd456800640 1 -- 172.21.15.123:0/3970415467 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd45809d630 msgr2=0x7fd4580b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:32.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.208+0000 7fd456800640 1 --2- 172.21.15.123:0/3970415467 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd45809d630 0x7fd4580b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:32.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.208+0000 7fd456800640 1 -- 172.21.15.123:0/3970415467 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4580b2890 con 0x7fd4581499f0 2024-04-17T05:27:32.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.208+0000 7fd456800640 1 --2- 172.21.15.123:0/3970415467 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4581499f0 0x7fd458098480 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd45002bee0 tx=0x7fd4500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:32.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.209+0000 7fd44ea00640 1 -- 172.21.15.123:0/3970415467 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd450041070 con 0x7fd4581499f0 2024-04-17T05:27:32.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.209+0000 7fd44ea00640 1 -- 172.21.15.123:0/3970415467 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd45003a970 con 0x7fd4581499f0 2024-04-17T05:27:32.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.209+0000 7fd44ea00640 1 -- 172.21.15.123:0/3970415467 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd450035040 con 0x7fd4581499f0 2024-04-17T05:27:32.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.209+0000 7fd45d000640 1 -- 172.21.15.123:0/3970415467 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4580b2b70 con 0x7fd4581499f0 2024-04-17T05:27:32.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.209+0000 7fd45d000640 1 -- 172.21.15.123:0/3970415467 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4580b6900 con 0x7fd4581499f0 2024-04-17T05:27:32.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.210+0000 7fd45d000640 1 -- 172.21.15.123:0/3970415467 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd458068a40 con 0x7fd4581499f0 2024-04-17T05:27:32.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.211+0000 7fd44ea00640 1 -- 172.21.15.123:0/3970415467 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd450038020 con 0x7fd4581499f0 2024-04-17T05:27:32.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.212+0000 7fd44ea00640 1 --2- 172.21.15.123:0/3970415467 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fd43406c920 0x7fd43406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:32.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.212+0000 7fd44ea00640 1 -- 172.21.15.123:0/3970415467 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd4500ad8f0 con 0x7fd4581499f0 2024-04-17T05:27:32.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.212+0000 7fd455e00640 1 --2- 172.21.15.123:0/3970415467 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fd43406c920 0x7fd43406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:32.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.214+0000 7fd455e00640 1 --2- 172.21.15.123:0/3970415467 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fd43406c920 0x7fd43406ede0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd4480012e0 tx=0x7fd448007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:32.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.217+0000 7fd44ea00640 1 -- 172.21.15.123:0/3970415467 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fd45007b9d0 con 0x7fd4581499f0 2024-04-17T05:27:32.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.419+0000 7fd45d000640 1 -- 172.21.15.123:0/3970415467 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fd4580b48a0 con 0x7fd4581499f0 2024-04-17T05:27:32.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.420+0000 7fd44ea00640 1 -- 172.21.15.123:0/3970415467 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7fd45007b2d0 con 0x7fd4581499f0 2024-04-17T05:27:32.419 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-04-17T05:27:32.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.423+0000 7fd45d000640 1 -- 172.21.15.123:0/3970415467 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fd43406c920 msgr2=0x7fd43406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:32.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.423+0000 7fd45d000640 1 --2- 172.21.15.123:0/3970415467 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fd43406c920 0x7fd43406ede0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd4480012e0 tx=0x7fd448007d30 comp rx=0 tx=0).stop 2024-04-17T05:27:32.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.423+0000 7fd45d000640 1 -- 172.21.15.123:0/3970415467 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4581499f0 msgr2=0x7fd458098480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:32.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.423+0000 7fd45d000640 1 --2- 172.21.15.123:0/3970415467 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4581499f0 0x7fd458098480 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd45002bee0 tx=0x7fd4500046c0 comp rx=0 tx=0).stop 2024-04-17T05:27:32.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.423+0000 7fd45d000640 1 -- 172.21.15.123:0/3970415467 shutdown_connections 2024-04-17T05:27:32.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.423+0000 7fd45d000640 1 --2- 172.21.15.123:0/3970415467 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4581499f0 0x7fd458098480 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:32.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.423+0000 7fd45d000640 1 --2- 172.21.15.123:0/3970415467 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fd43406c920 0x7fd43406ede0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:32.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.423+0000 7fd45d000640 1 --2- 172.21.15.123:0/3970415467 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd45809da10 0x7fd4581db420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:32.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.423+0000 7fd45d000640 1 --2- 172.21.15.123:0/3970415467 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd45809d630 0x7fd4580b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:32.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.423+0000 7fd45d000640 1 -- 172.21.15.123:0/3970415467 >> 172.21.15.123:0/3970415467 conn(0x7fd4580b93b0 msgr2=0x7fd4580af4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:32.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.423+0000 7fd45d000640 1 -- 172.21.15.123:0/3970415467 shutdown_connections 2024-04-17T05:27:32.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.423+0000 7fd45d000640 1 -- 172.21.15.123:0/3970415467 wait complete. 2024-04-17T05:27:32.440 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T05:27:32.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.646+0000 7fe816200640 1 Processor -- start 2024-04-17T05:27:32.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.646+0000 7fe816200640 1 -- start start 2024-04-17T05:27:32.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.647+0000 7fe816200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8100b2ad0 0x7fe810148de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:32.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.647+0000 7fe816200640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe810070940 0x7fe810149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:32.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.647+0000 7fe816200640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8100b2eb0 con 0x7fe81013f1f0 2024-04-17T05:27:32.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.647+0000 7fe816200640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7fe810071cf0 con 0x7fe810070940 2024-04-17T05:27:32.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.647+0000 7fe816200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fe8100b4fa0 con 0x7fe8100b2ad0 2024-04-17T05:27:32.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.648+0000 7fe80fe00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe810070940 0x7fe810149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:32.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.648+0000 7fe814e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8100b2ad0 0x7fe810148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:32.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.648+0000 7fe814e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8100b2ad0 0x7fe810148de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.123:48560/0 (socket says 172.21.15.123:48560) 2024-04-17T05:27:32.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.648+0000 7fe814e00640 1 -- 172.21.15.123:0/1982492035 learned_addr learned my addr 172.21.15.123:0/1982492035 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:32.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.649+0000 7fe814e00640 1 -- 172.21.15.123:0/1982492035 >> v2:172.21.15.164:3300/0 conn(0x7fe810070940 msgr2=0x7fe810149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:32.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.649+0000 7fe814e00640 1 --2- 172.21.15.123:0/1982492035 >> v2:172.21.15.164:3300/0 conn(0x7fe810070940 0x7fe810149320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:32.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.649+0000 7fe814e00640 1 -- 172.21.15.123:0/1982492035 >> v1:172.21.15.164:6789/0 conn(0x7fe81013f1f0 legacy=0x7fe81013f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:32.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.649+0000 7fe814e00640 1 -- 172.21.15.123:0/1982492035 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8100b5280 con 0x7fe8100b2ad0 2024-04-17T05:27:32.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.650+0000 7fe814e00640 1 --2- 172.21.15.123:0/1982492035 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8100b2ad0 0x7fe810148de0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe804009870 tx=0x7fe80402b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6c7e84fa1ac9e28 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:32.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.650+0000 7fe80f400640 1 -- 172.21.15.123:0/1982492035 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8040317c0 con 0x7fe8100b2ad0 2024-04-17T05:27:32.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.651+0000 7fe80f400640 1 -- 172.21.15.123:0/1982492035 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe804037070 con 0x7fe8100b2ad0 2024-04-17T05:27:32.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.651+0000 7fe80f400640 1 -- 172.21.15.123:0/1982492035 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe804031b80 con 0x7fe8100b2ad0 2024-04-17T05:27:32.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.651+0000 7fe816200640 1 -- 172.21.15.123:0/1982492035 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8100b2ad0 msgr2=0x7fe810148de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:32.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.651+0000 7fe816200640 1 --2- 172.21.15.123:0/1982492035 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8100b2ad0 0x7fe810148de0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe804009870 tx=0x7fe80402b860 comp rx=0 tx=0).stop 2024-04-17T05:27:32.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.651+0000 7fe816200640 1 -- 172.21.15.123:0/1982492035 shutdown_connections 2024-04-17T05:27:32.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.651+0000 7fe816200640 1 --2- 172.21.15.123:0/1982492035 >> v2:172.21.15.164:3300/0 conn(0x7fe810070940 0x7fe810149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:32.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.651+0000 7fe816200640 1 --2- 172.21.15.123:0/1982492035 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe8100b2ad0 0x7fe810148de0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:32.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.651+0000 7fe816200640 1 -- 172.21.15.123:0/1982492035 >> 172.21.15.123:0/1982492035 conn(0x7fe8100b9150 msgr2=0x7fe8100b9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:32.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.651+0000 7fe816200640 1 -- 172.21.15.123:0/1982492035 shutdown_connections 2024-04-17T05:27:32.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.651+0000 7fe816200640 1 -- 172.21.15.123:0/1982492035 wait complete. 2024-04-17T05:27:32.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.653+0000 7fe816200640 1 Processor -- start 2024-04-17T05:27:32.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.653+0000 7fe816200640 1 -- start start 2024-04-17T05:27:32.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.653+0000 7fe816200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe810070940 0x7fe810138360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:32.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.654+0000 7fe816200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8100b2ad0 0x7fe810147740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:32.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.654+0000 7fe816200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe81013f1f0 0x7fe810147c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:32.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.654+0000 7fe816200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe810150170 con 0x7fe8100b2ad0 2024-04-17T05:27:32.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.654+0000 7fe816200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe8100b3560 con 0x7fe81013f1f0 2024-04-17T05:27:32.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.654+0000 7fe816200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fe8101502f0 con 0x7fe810070940 2024-04-17T05:27:32.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.654+0000 7fe80fe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8100b2ad0 0x7fe810147740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:32.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.654+0000 7fe80fe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8100b2ad0 0x7fe810147740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42738/0 (socket says 172.21.15.123:42738) 2024-04-17T05:27:32.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.654+0000 7fe80fe00640 1 -- 172.21.15.123:0/1215529077 learned_addr learned my addr 172.21.15.123:0/1215529077 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:32.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.654+0000 7fe814e00640 1 --2- 172.21.15.123:0/1215529077 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe810070940 0x7fe810138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:32.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.654+0000 7fe815800640 1 --2- 172.21.15.123:0/1215529077 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe81013f1f0 0x7fe810147c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:32.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.654+0000 7fe80fe00640 1 -- 172.21.15.123:0/1215529077 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe810070940 msgr2=0x7fe810138360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:32.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.654+0000 7fe80fe00640 1 --2- 172.21.15.123:0/1215529077 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe810070940 0x7fe810138360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:32.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.654+0000 7fe80fe00640 1 -- 172.21.15.123:0/1215529077 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe81013f1f0 msgr2=0x7fe810147c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:32.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.654+0000 7fe80fe00640 1 --2- 172.21.15.123:0/1215529077 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe81013f1f0 0x7fe810147c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:32.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.654+0000 7fe80fe00640 1 -- 172.21.15.123:0/1215529077 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe810138e60 con 0x7fe8100b2ad0 2024-04-17T05:27:32.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.654+0000 7fe815800640 1 --2- 172.21.15.123:0/1215529077 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe81013f1f0 0x7fe810147c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:32.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.655+0000 7fe80fe00640 1 --2- 172.21.15.123:0/1215529077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8100b2ad0 0x7fe810147740 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc00e9b0 tx=0x7fe7fc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:32.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.655+0000 7fe80cc00640 1 -- 172.21.15.123:0/1215529077 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc017070 con 0x7fe8100b2ad0 2024-04-17T05:27:32.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.655+0000 7fe80cc00640 1 -- 172.21.15.123:0/1215529077 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7fc00c9a0 con 0x7fe8100b2ad0 2024-04-17T05:27:32.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.655+0000 7fe80cc00640 1 -- 172.21.15.123:0/1215529077 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc00cd90 con 0x7fe8100b2ad0 2024-04-17T05:27:32.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.655+0000 7fe816200640 1 -- 172.21.15.123:0/1215529077 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe81013b380 con 0x7fe8100b2ad0 2024-04-17T05:27:32.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.655+0000 7fe816200640 1 -- 172.21.15.123:0/1215529077 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8101469b0 con 0x7fe8100b2ad0 2024-04-17T05:27:32.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.656+0000 7fe816200640 1 -- 172.21.15.123:0/1215529077 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe81013efc0 con 0x7fe8100b2ad0 2024-04-17T05:27:32.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.657+0000 7fe80cc00640 1 -- 172.21.15.123:0/1215529077 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe7fc01a070 con 0x7fe8100b2ad0 2024-04-17T05:27:32.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.658+0000 7fe80cc00640 1 --2- 172.21.15.123:0/1215529077 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe7f006c8f0 0x7fe7f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:32.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.658+0000 7fe80cc00640 1 -- 172.21.15.123:0/1215529077 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe7fc08bee0 con 0x7fe8100b2ad0 2024-04-17T05:27:32.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.659+0000 7fe814e00640 1 --2- 172.21.15.123:0/1215529077 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe7f006c8f0 0x7fe7f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:32.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.660+0000 7fe814e00640 1 --2- 172.21.15.123:0/1215529077 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe7f006c8f0 0x7fe7f006edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe804036000 tx=0x7fe80403d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:32.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.665+0000 7fe80cc00640 1 -- 172.21.15.123:0/1215529077 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fe81013efc0 con 0x7fe8100b2ad0 2024-04-17T05:27:32.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.907+0000 7fe816200640 1 -- 172.21.15.123:0/1215529077 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe8100759b0 con 0x7fe8100b2ad0 2024-04-17T05:27:32.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.908+0000 7fe80cc00640 1 -- 172.21.15.123:0/1215529077 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+3550 (secure 0 0 0) 0x7fe7fc05a060 con 0x7fe8100b2ad0 2024-04-17T05:27:32.907 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:27:32.907 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/515699398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":515699398},{"type":"v1","addr":"172.21.15.123:6833","nonce":515699398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T05:26:52.642446+0000","modified":"2024-04-17T05:27:18.881148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4243},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4243":{"gid":4243,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/1946746019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1946746019},{"type":"v1","addr":"172.21.15.164:6835","nonce":1946746019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4243,"qdb_cluster":[4243]},"id":1}]} 2024-04-17T05:27:32.908 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 9 2024-04-17T05:27:32.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.911+0000 7fe816200640 1 -- 172.21.15.123:0/1215529077 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe7f006c8f0 msgr2=0x7fe7f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:32.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.911+0000 7fe816200640 1 --2- 172.21.15.123:0/1215529077 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe7f006c8f0 0x7fe7f006edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe804036000 tx=0x7fe80403d040 comp rx=0 tx=0).stop 2024-04-17T05:27:32.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.911+0000 7fe816200640 1 -- 172.21.15.123:0/1215529077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8100b2ad0 msgr2=0x7fe810147740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:32.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.911+0000 7fe816200640 1 --2- 172.21.15.123:0/1215529077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8100b2ad0 0x7fe810147740 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc00e9b0 tx=0x7fe7fc00ee70 comp rx=0 tx=0).stop 2024-04-17T05:27:32.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.911+0000 7fe816200640 1 -- 172.21.15.123:0/1215529077 shutdown_connections 2024-04-17T05:27:32.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.911+0000 7fe816200640 1 --2- 172.21.15.123:0/1215529077 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe81013f1f0 0x7fe810147c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:32.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.911+0000 7fe816200640 1 --2- 172.21.15.123:0/1215529077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8100b2ad0 0x7fe810147740 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:32.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.911+0000 7fe816200640 1 --2- 172.21.15.123:0/1215529077 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe7f006c8f0 0x7fe7f006edb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:32.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.911+0000 7fe816200640 1 --2- 172.21.15.123:0/1215529077 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe810070940 0x7fe810138360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:32.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.911+0000 7fe816200640 1 -- 172.21.15.123:0/1215529077 >> 172.21.15.123:0/1215529077 conn(0x7fe8100b9150 msgr2=0x7fe810144480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:32.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.911+0000 7fe816200640 1 -- 172.21.15.123:0/1215529077 shutdown_connections 2024-04-17T05:27:32.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:32.911+0000 7fe816200640 1 -- 172.21.15.123:0/1215529077 wait complete. 2024-04-17T05:27:32.930 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T05:27:33.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.142+0000 7fe6cfa00640 1 Processor -- start 2024-04-17T05:27:33.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.142+0000 7fe6cfa00640 1 -- start start 2024-04-17T05:27:33.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.144+0000 7fe6cfa00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe6c8073770 0x7fe6c80b68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:33.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.144+0000 7fe6cfa00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe6c80b3fe0 0x7fe6c80b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:33.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.144+0000 7fe6cfa00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6c813f730 0x7fe6c813fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:33.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.144+0000 7fe6cfa00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe6c8073b50 con 0x7fe6c8073770 2024-04-17T05:27:33.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.144+0000 7fe6cfa00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7fe6c80b50e0 con 0x7fe6c80b3fe0 2024-04-17T05:27:33.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.144+0000 7fe6cfa00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fe6c80b53c0 con 0x7fe6c813f730 2024-04-17T05:27:33.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.144+0000 7fe6cd000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe6c8073770 0x7fe6c80b68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:33.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.144+0000 7fe6cd000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe6c8073770 0x7fe6c80b68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42748/0 (socket says 172.21.15.123:42748) 2024-04-17T05:27:33.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.144+0000 7fe6cd000640 1 -- 172.21.15.123:0/3044416639 learned_addr learned my addr 172.21.15.123:0/3044416639 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:33.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.144+0000 7fe6bfe00640 1 --2- 172.21.15.123:0/3044416639 >> v2:172.21.15.164:3300/0 conn(0x7fe6c80b3fe0 0x7fe6c80b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:33.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.144+0000 7fe6cda00640 1 --2- 172.21.15.123:0/3044416639 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6c813f730 0x7fe6c813fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:33.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.145+0000 7fe6cd000640 1 -- 172.21.15.123:0/3044416639 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6c813f730 msgr2=0x7fe6c813fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:33.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.145+0000 7fe6cd000640 1 --2- 172.21.15.123:0/3044416639 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6c813f730 0x7fe6c813fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:33.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.145+0000 7fe6cd000640 1 -- 172.21.15.123:0/3044416639 >> v2:172.21.15.164:3300/0 conn(0x7fe6c80b3fe0 msgr2=0x7fe6c80b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:33.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.145+0000 7fe6cd000640 1 --2- 172.21.15.123:0/3044416639 >> v2:172.21.15.164:3300/0 conn(0x7fe6c80b3fe0 0x7fe6c80b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:33.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.145+0000 7fe6cd000640 1 -- 172.21.15.123:0/3044416639 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c80b56a0 con 0x7fe6c8073770 2024-04-17T05:27:33.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.145+0000 7fe6cda00640 1 --2- 172.21.15.123:0/3044416639 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6c813f730 0x7fe6c813fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:33.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.146+0000 7fe6cd000640 1 --2- 172.21.15.123:0/3044416639 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6c8073770 0x7fe6c80b68e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe6c80b7ea0 tx=0x7fe6b802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd5d082f18181fc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:33.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.146+0000 7fe6c7e00640 1 -- 172.21.15.123:0/3044416639 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b8035020 con 0x7fe6c8073770 2024-04-17T05:27:33.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.146+0000 7fe6c7e00640 1 -- 172.21.15.123:0/3044416639 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b8031870 con 0x7fe6c8073770 2024-04-17T05:27:33.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.146+0000 7fe6c7e00640 1 -- 172.21.15.123:0/3044416639 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b8031c40 con 0x7fe6c8073770 2024-04-17T05:27:33.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.147+0000 7fe6cfa00640 1 -- 172.21.15.123:0/3044416639 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6c8073770 msgr2=0x7fe6c80b68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:33.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.147+0000 7fe6cfa00640 1 --2- 172.21.15.123:0/3044416639 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6c8073770 0x7fe6c80b68e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe6c80b7ea0 tx=0x7fe6b802b910 comp rx=0 tx=0).stop 2024-04-17T05:27:33.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.147+0000 7fe6cfa00640 1 -- 172.21.15.123:0/3044416639 shutdown_connections 2024-04-17T05:27:33.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.147+0000 7fe6cfa00640 1 --2- 172.21.15.123:0/3044416639 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6c813f730 0x7fe6c813fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:33.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.147+0000 7fe6cfa00640 1 --2- 172.21.15.123:0/3044416639 >> v2:172.21.15.164:3300/0 conn(0x7fe6c80b3fe0 0x7fe6c80b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:33.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.147+0000 7fe6cfa00640 1 --2- 172.21.15.123:0/3044416639 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6c8073770 0x7fe6c80b68e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:33.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.147+0000 7fe6cfa00640 1 -- 172.21.15.123:0/3044416639 >> 172.21.15.123:0/3044416639 conn(0x7fe6c80ba370 msgr2=0x7fe6c80ba750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:33.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.147+0000 7fe6cfa00640 1 -- 172.21.15.123:0/3044416639 shutdown_connections 2024-04-17T05:27:33.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.147+0000 7fe6cfa00640 1 -- 172.21.15.123:0/3044416639 wait complete. 2024-04-17T05:27:33.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.149+0000 7fe6cfa00640 1 Processor -- start 2024-04-17T05:27:33.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.149+0000 7fe6cfa00640 1 -- start start 2024-04-17T05:27:33.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.150+0000 7fe6cfa00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6c8073770 0x7fe6c8145d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:33.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.150+0000 7fe6cfa00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6c80b3fe0 0x7fe6c80aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:33.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.150+0000 7fe6cfa00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6c813f730 0x7fe6c80af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:33.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.150+0000 7fe6cfa00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c80b5fc0 con 0x7fe6c8073770 2024-04-17T05:27:33.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.150+0000 7fe6cfa00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c80b1870 con 0x7fe6c813f730 2024-04-17T05:27:33.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.150+0000 7fe6cfa00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fe6c80b6140 con 0x7fe6c80b3fe0 2024-04-17T05:27:33.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.150+0000 7fe6cd000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6c8073770 0x7fe6c8145d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:33.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.150+0000 7fe6cd000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6c8073770 0x7fe6c8145d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42750/0 (socket says 172.21.15.123:42750) 2024-04-17T05:27:33.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.150+0000 7fe6cd000640 1 -- 172.21.15.123:0/1828500599 learned_addr learned my addr 172.21.15.123:0/1828500599 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:33.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.150+0000 7fe6cd000640 1 -- 172.21.15.123:0/1828500599 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6c80b3fe0 msgr2=0x7fe6c80aeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:33.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.150+0000 7fe6cd000640 1 --2- 172.21.15.123:0/1828500599 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6c80b3fe0 0x7fe6c80aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:33.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.150+0000 7fe6cd000640 1 -- 172.21.15.123:0/1828500599 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6c813f730 msgr2=0x7fe6c80af3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:33.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.150+0000 7fe6cda00640 1 --2- 172.21.15.123:0/1828500599 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6c813f730 0x7fe6c80af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:33.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.150+0000 7fe6cd000640 1 --2- 172.21.15.123:0/1828500599 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6c813f730 0x7fe6c80af3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:33.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.150+0000 7fe6cd000640 1 -- 172.21.15.123:0/1828500599 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c8141220 con 0x7fe6c8073770 2024-04-17T05:27:33.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.151+0000 7fe6cd000640 1 --2- 172.21.15.123:0/1828500599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6c8073770 0x7fe6c8145d80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe6b802b950 tx=0x7fe6b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:33.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.151+0000 7fe6c5600640 1 -- 172.21.15.123:0/1828500599 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b8040070 con 0x7fe6c8073770 2024-04-17T05:27:33.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.151+0000 7fe6c5600640 1 -- 172.21.15.123:0/1828500599 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b8030d00 con 0x7fe6c8073770 2024-04-17T05:27:33.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.151+0000 7fe6c5600640 1 -- 172.21.15.123:0/1828500599 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b8035040 con 0x7fe6c8073770 2024-04-17T05:27:33.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.151+0000 7fe6cfa00640 1 -- 172.21.15.123:0/1828500599 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6c8141500 con 0x7fe6c8073770 2024-04-17T05:27:33.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.151+0000 7fe6cfa00640 1 -- 172.21.15.123:0/1828500599 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6c8146440 con 0x7fe6c8073770 2024-04-17T05:27:33.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.152+0000 7fe6cfa00640 1 -- 172.21.15.123:0/1828500599 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6c80b4a60 con 0x7fe6c8073770 2024-04-17T05:27:33.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.153+0000 7fe6c5600640 1 -- 172.21.15.123:0/1828500599 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe6b804b060 con 0x7fe6c8073770 2024-04-17T05:27:33.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.154+0000 7fe6c5600640 1 --2- 172.21.15.123:0/1828500599 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe6a406c8f0 0x7fe6a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:33.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.154+0000 7fe6c5600640 1 -- 172.21.15.123:0/1828500599 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe6b80adcb0 con 0x7fe6c8073770 2024-04-17T05:27:33.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.155+0000 7fe6bfe00640 1 --2- 172.21.15.123:0/1828500599 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe6a406c8f0 0x7fe6a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:33.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.156+0000 7fe6bfe00640 1 --2- 172.21.15.123:0/1828500599 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe6a406c8f0 0x7fe6a406edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe6c81d4c50 tx=0x7fe6b0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:33.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.159+0000 7fe6c5600640 1 -- 172.21.15.123:0/1828500599 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fe6c80b4a60 con 0x7fe6c8073770 2024-04-17T05:27:33.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.365+0000 7fe6cfa00640 1 -- 172.21.15.123:0/1828500599 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe6c8068a40 con 0x7fe6c8073770 2024-04-17T05:27:33.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.367+0000 7fe6c5600640 1 -- 172.21.15.123:0/1828500599 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18526 (secure 0 0 0) 0x7fe6b807bd90 con 0x7fe6c8073770 2024-04-17T05:27:33.366 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:27:33.367 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":26,"fsid":"0787c5c0-e77a-4102-a899-30db48b19c68","created":"2024-04-17T05:26:33.031507+0000","modified":"2024-04-17T05:26:57.743352+0000","last_up_change":"2024-04-17T05:26:44.988433+0000","last_in_change":"2024-04-17T05:26:36.682131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T05:26:46.329778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T05:26:50.600195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T05:26:51.626498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T05:26:55.264044+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15c87cdb-9415-45a6-a2a6-ea6bec9daece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6801","nonce":840753170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6803","nonce":840753170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6807","nonce":840753170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6805","nonce":840753170}]},"public_addr":"172.21.15.123:6801/840753170","cluster_addr":"172.21.15.123:6803/840753170","heartbeat_back_addr":"172.21.15.123:6807/840753170","heartbeat_front_addr":"172.21.15.123:6805/840753170","state":["exists","up"]},{"osd":1,"uuid":"281751b5-486d-4845-b4aa-b308bf7cec62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6822","nonce":2231878927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6827","nonce":2231878927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6831","nonce":2231878927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6829","nonce":2231878927}]},"public_addr":"172.21.15.123:6822/2231878927","cluster_addr":"172.21.15.123:6827/2231878927","heartbeat_back_addr":"172.21.15.123:6831/2231878927","heartbeat_front_addr":"172.21.15.123:6829/2231878927","state":["exists","up"]},{"osd":2,"uuid":"b42257d3-bd20-4db5-aa37-1bf5c512d0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6817","nonce":754360844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6820","nonce":754360844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6825","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6826","nonce":754360844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6823","nonce":754360844}]},"public_addr":"172.21.15.123:6817/754360844","cluster_addr":"172.21.15.123:6820/754360844","heartbeat_back_addr":"172.21.15.123:6826/754360844","heartbeat_front_addr":"172.21.15.123:6823/754360844","state":["exists","up"]},{"osd":3,"uuid":"0f26b891-bbe6-478e-8dee-78e69bb48cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6809","nonce":2898088574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6811","nonce":2898088574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6815","nonce":2898088574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6813","nonce":2898088574}]},"public_addr":"172.21.15.123:6809/2898088574","cluster_addr":"172.21.15.123:6811/2898088574","heartbeat_back_addr":"172.21.15.123:6815/2898088574","heartbeat_front_addr":"172.21.15.123:6813/2898088574","state":["exists","up"]},{"osd":4,"uuid":"43e59318-2740-4625-9d64-eec1fd43c322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6801","nonce":606484349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6804","nonce":606484349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6812","nonce":606484349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6808","nonce":606484349}]},"public_addr":"172.21.15.164:6801/606484349","cluster_addr":"172.21.15.164:6804/606484349","heartbeat_back_addr":"172.21.15.164:6812/606484349","heartbeat_front_addr":"172.21.15.164:6808/606484349","state":["exists","up"]},{"osd":5,"uuid":"aaa3acf4-4adc-4337-aba3-363851d35310","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6805","nonce":1376989593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6809","nonce":1376989593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6815","nonce":1376989593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6813","nonce":1376989593}]},"public_addr":"172.21.15.164:6805/1376989593","cluster_addr":"172.21.15.164:6809/1376989593","heartbeat_back_addr":"172.21.15.164:6815/1376989593","heartbeat_front_addr":"172.21.15.164:6813/1376989593","state":["exists","up"]},{"osd":6,"uuid":"6f765b27-7377-4d81-9192-23a965651145","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6817","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6821","nonce":1594306924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6823","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6826","nonce":1594306924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6831","nonce":1594306924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6829","nonce":1594306924}]},"public_addr":"172.21.15.164:6821/1594306924","cluster_addr":"172.21.15.164:6826/1594306924","heartbeat_back_addr":"172.21.15.164:6831/1594306924","heartbeat_front_addr":"172.21.15.164:6829/1594306924","state":["exists","up"]},{"osd":7,"uuid":"5547394b-ec2f-4311-846d-369af4b1acf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6818","nonce":295402697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6819","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6820","nonce":295402697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6825","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6827","nonce":295402697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6824","nonce":295402697}]},"public_addr":"172.21.15.164:6818/295402697","cluster_addr":"172.21.15.164:6820/295402697","heartbeat_back_addr":"172.21.15.164:6827/295402697","heartbeat_front_addr":"172.21.15.164:6824/295402697","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.034807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.022201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.751897+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.850533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.083608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.047524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.314753+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.413586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T05:27:33.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.369+0000 7fe6cfa00640 1 -- 172.21.15.123:0/1828500599 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe6a406c8f0 msgr2=0x7fe6a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:33.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.369+0000 7fe6cfa00640 1 --2- 172.21.15.123:0/1828500599 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe6a406c8f0 0x7fe6a406edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe6c81d4c50 tx=0x7fe6b0008040 comp rx=0 tx=0).stop 2024-04-17T05:27:33.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.369+0000 7fe6cfa00640 1 -- 172.21.15.123:0/1828500599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6c8073770 msgr2=0x7fe6c8145d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:33.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.369+0000 7fe6cfa00640 1 --2- 172.21.15.123:0/1828500599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6c8073770 0x7fe6c8145d80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe6b802b950 tx=0x7fe6b80046c0 comp rx=0 tx=0).stop 2024-04-17T05:27:33.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.369+0000 7fe6cfa00640 1 -- 172.21.15.123:0/1828500599 shutdown_connections 2024-04-17T05:27:33.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.370+0000 7fe6cfa00640 1 --2- 172.21.15.123:0/1828500599 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6c813f730 0x7fe6c80af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:33.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.370+0000 7fe6cfa00640 1 --2- 172.21.15.123:0/1828500599 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe6a406c8f0 0x7fe6a406edb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:33.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.370+0000 7fe6cfa00640 1 --2- 172.21.15.123:0/1828500599 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6c80b3fe0 0x7fe6c80aeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:33.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.370+0000 7fe6cfa00640 1 --2- 172.21.15.123:0/1828500599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6c8073770 0x7fe6c8145d80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:33.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.370+0000 7fe6cfa00640 1 -- 172.21.15.123:0/1828500599 >> 172.21.15.123:0/1828500599 conn(0x7fe6c80ba370 msgr2=0x7fe6c806c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:33.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.370+0000 7fe6cfa00640 1 -- 172.21.15.123:0/1828500599 shutdown_connections 2024-04-17T05:27:33.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.370+0000 7fe6cfa00640 1 -- 172.21.15.123:0/1828500599 wait complete. 2024-04-17T05:27:33.386 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T05:27:33.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.573+0000 7f36f2e00640 1 Processor -- start 2024-04-17T05:27:33.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.574+0000 7f36f2e00640 1 -- start start 2024-04-17T05:27:33.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.575+0000 7f36f2e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36ec0b6370 0x7f36ec148560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:33.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.575+0000 7f36f2e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f36ec0b7ed0 0x7f36ec1417f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:33.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.575+0000 7f36f2e00640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36ec0b6750 con 0x7f36ec0b5890 2024-04-17T05:27:33.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.575+0000 7f36f2e00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f36ec0b7880 con 0x7f36ec0b7ed0 2024-04-17T05:27:33.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.575+0000 7f36f2e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f36ec0b75a0 con 0x7f36ec0b6370 2024-04-17T05:27:33.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.575+0000 7f36e3400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f36ec0b7ed0 0x7f36ec1417f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:33.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.575+0000 7f36e3400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f36ec0b7ed0 0x7f36ec1417f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42758/0 (socket says 172.21.15.123:42758) 2024-04-17T05:27:33.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.575+0000 7f36e3400640 1 -- 172.21.15.123:0/694620251 learned_addr learned my addr 172.21.15.123:0/694620251 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:33.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.576+0000 7f36ebe00640 1 --2- 172.21.15.123:0/694620251 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36ec0b6370 0x7f36ec148560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:33.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.576+0000 7f36e3400640 1 -- 172.21.15.123:0/694620251 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36ec0b6370 msgr2=0x7f36ec148560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:33.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.576+0000 7f36e3400640 1 --2- 172.21.15.123:0/694620251 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36ec0b6370 0x7f36ec148560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:33.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.576+0000 7f36e3400640 1 -- 172.21.15.123:0/694620251 >> v1:172.21.15.164:6789/0 conn(0x7f36ec0b5890 legacy=0x7f36ec141d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:33.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.576+0000 7f36e3400640 1 -- 172.21.15.123:0/694620251 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36ec147d60 con 0x7f36ec0b7ed0 2024-04-17T05:27:33.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.577+0000 7f36e3400640 1 --2- 172.21.15.123:0/694620251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36ec0b7ed0 0x7f36ec1417f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f36d4009870 tx=0x7f36d402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ab4bc38b499af3 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:33.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.577+0000 7f36eb400640 1 -- 172.21.15.123:0/694620251 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d40317c0 con 0x7f36ec0b7ed0 2024-04-17T05:27:33.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.577+0000 7f36eb400640 1 -- 172.21.15.123:0/694620251 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36d4037070 con 0x7f36ec0b7ed0 2024-04-17T05:27:33.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.577+0000 7f36eb400640 1 -- 172.21.15.123:0/694620251 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d4031b80 con 0x7f36ec0b7ed0 2024-04-17T05:27:33.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.578+0000 7f36f2e00640 1 -- 172.21.15.123:0/694620251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36ec0b7ed0 msgr2=0x7f36ec1417f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:33.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.578+0000 7f36f2e00640 1 --2- 172.21.15.123:0/694620251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36ec0b7ed0 0x7f36ec1417f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f36d4009870 tx=0x7f36d402b860 comp rx=0 tx=0).stop 2024-04-17T05:27:33.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.578+0000 7f36f2e00640 1 -- 172.21.15.123:0/694620251 shutdown_connections 2024-04-17T05:27:33.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.578+0000 7f36f2e00640 1 --2- 172.21.15.123:0/694620251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36ec0b7ed0 0x7f36ec1417f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:33.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.578+0000 7f36f2e00640 1 --2- 172.21.15.123:0/694620251 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36ec0b6370 0x7f36ec148560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:33.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.578+0000 7f36f2e00640 1 -- 172.21.15.123:0/694620251 >> 172.21.15.123:0/694620251 conn(0x7f36ec0bd530 msgr2=0x7f36ec0bd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:33.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.578+0000 7f36f2e00640 1 -- 172.21.15.123:0/694620251 shutdown_connections 2024-04-17T05:27:33.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.578+0000 7f36f2e00640 1 -- 172.21.15.123:0/694620251 wait complete. 2024-04-17T05:27:33.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.580+0000 7f36f2e00640 1 Processor -- start 2024-04-17T05:27:33.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.580+0000 7f36f2e00640 1 -- start start 2024-04-17T05:27:33.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.581+0000 7f36f2e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36ec0b5890 0x7f36ec1d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:33.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.581+0000 7f36f2e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36ec0b6370 0x7f36ec1cec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:33.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.581+0000 7f36f2e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36ec0b7ed0 0x7f36ec1d3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:33.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.581+0000 7f36f2e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f36ec0b52e0 con 0x7f36ec0b5890 2024-04-17T05:27:33.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.581+0000 7f36f2e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f36ec148aa0 con 0x7f36ec0b7ed0 2024-04-17T05:27:33.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.581+0000 7f36f2e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f36ec0b5460 con 0x7f36ec0b6370 2024-04-17T05:27:33.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.581+0000 7f36ebe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36ec0b5890 0x7f36ec1d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:33.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.581+0000 7f36ebe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36ec0b5890 0x7f36ec1d04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42768/0 (socket says 172.21.15.123:42768) 2024-04-17T05:27:33.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.581+0000 7f36ebe00640 1 -- 172.21.15.123:0/4053882620 learned_addr learned my addr 172.21.15.123:0/4053882620 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:33.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.581+0000 7f36ebe00640 1 -- 172.21.15.123:0/4053882620 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36ec0b6370 msgr2=0x7f36ec1cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:33.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.581+0000 7f36ebe00640 1 --2- 172.21.15.123:0/4053882620 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36ec0b6370 0x7f36ec1cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:33.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.581+0000 7f36ebe00640 1 -- 172.21.15.123:0/4053882620 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36ec0b7ed0 msgr2=0x7f36ec1d3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:33.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.581+0000 7f36ebe00640 1 --2- 172.21.15.123:0/4053882620 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36ec0b7ed0 0x7f36ec1d3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:33.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.581+0000 7f36ebe00640 1 -- 172.21.15.123:0/4053882620 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36ec1dd140 con 0x7f36ec0b5890 2024-04-17T05:27:33.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.582+0000 7f36ebe00640 1 --2- 172.21.15.123:0/4053882620 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36ec0b5890 0x7f36ec1d04a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f36dc00d800 tx=0x7f36dc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:33.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.582+0000 7f36e8c00640 1 -- 172.21.15.123:0/4053882620 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36dc00b6c0 con 0x7f36ec0b5890 2024-04-17T05:27:33.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.582+0000 7f36e8c00640 1 -- 172.21.15.123:0/4053882620 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36dc019070 con 0x7f36ec0b5890 2024-04-17T05:27:33.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.582+0000 7f36e8c00640 1 -- 172.21.15.123:0/4053882620 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36dc00ba80 con 0x7f36ec0b5890 2024-04-17T05:27:33.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.582+0000 7f36f2e00640 1 -- 172.21.15.123:0/4053882620 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36ec1d1860 con 0x7f36ec0b5890 2024-04-17T05:27:33.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.582+0000 7f36f2e00640 1 -- 172.21.15.123:0/4053882620 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36ec1dd400 con 0x7f36ec0b5890 2024-04-17T05:27:33.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.583+0000 7f36f2e00640 1 -- 172.21.15.123:0/4053882620 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36ec068a40 con 0x7f36ec0b5890 2024-04-17T05:27:33.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.584+0000 7f36e8c00640 1 -- 172.21.15.123:0/4053882620 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f36dc00bc20 con 0x7f36ec0b5890 2024-04-17T05:27:33.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.585+0000 7f36e8c00640 1 --2- 172.21.15.123:0/4053882620 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f36c806c8f0 0x7f36c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:33.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.585+0000 7f36e8c00640 1 -- 172.21.15.123:0/4053882620 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f36dc08c350 con 0x7f36ec0b5890 2024-04-17T05:27:33.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.586+0000 7f36e3400640 1 --2- 172.21.15.123:0/4053882620 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f36c806c8f0 0x7f36c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:33.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.587+0000 7f36e3400640 1 --2- 172.21.15.123:0/4053882620 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f36c806c8f0 0x7f36c806edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f36d4036000 tx=0x7f36d4030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:33.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.589+0000 7f36e8c00640 1 -- 172.21.15.123:0/4053882620 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f36dc011340 con 0x7f36ec0b5890 2024-04-17T05:27:33.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.822+0000 7f36f2e00640 1 -- 172.21.15.123:0/4053882620 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f36ec1ddac0 con 0x7f36ec0b5890 2024-04-17T05:27:33.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.823+0000 7f36e8c00640 1 -- 172.21.15.123:0/4053882620 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+3550 (secure 0 0 0) 0x7f36dc05a430 con 0x7f36ec0b5890 2024-04-17T05:27:33.822 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:27:33.822 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/515699398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":515699398},{"type":"v1","addr":"172.21.15.123:6833","nonce":515699398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T05:26:52.642446+0000","modified":"2024-04-17T05:27:18.881148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4243},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4243":{"gid":4243,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/1946746019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1946746019},{"type":"v1","addr":"172.21.15.164:6835","nonce":1946746019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4243,"qdb_cluster":[4243]},"id":1}]} 2024-04-17T05:27:33.822 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 9 2024-04-17T05:27:33.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.825+0000 7f36f2e00640 1 -- 172.21.15.123:0/4053882620 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f36c806c8f0 msgr2=0x7f36c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:33.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.825+0000 7f36f2e00640 1 --2- 172.21.15.123:0/4053882620 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f36c806c8f0 0x7f36c806edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f36d4036000 tx=0x7f36d4030000 comp rx=0 tx=0).stop 2024-04-17T05:27:33.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.825+0000 7f36f2e00640 1 -- 172.21.15.123:0/4053882620 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36ec0b5890 msgr2=0x7f36ec1d04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:33.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.825+0000 7f36f2e00640 1 --2- 172.21.15.123:0/4053882620 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36ec0b5890 0x7f36ec1d04a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f36dc00d800 tx=0x7f36dc00dcc0 comp rx=0 tx=0).stop 2024-04-17T05:27:33.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.825+0000 7f36f2e00640 1 -- 172.21.15.123:0/4053882620 shutdown_connections 2024-04-17T05:27:33.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.825+0000 7f36f2e00640 1 --2- 172.21.15.123:0/4053882620 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f36ec0b7ed0 0x7f36ec1d3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:33.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.825+0000 7f36f2e00640 1 --2- 172.21.15.123:0/4053882620 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f36c806c8f0 0x7f36c806edb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:33.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.825+0000 7f36f2e00640 1 --2- 172.21.15.123:0/4053882620 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f36ec0b6370 0x7f36ec1cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:33.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.825+0000 7f36f2e00640 1 --2- 172.21.15.123:0/4053882620 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36ec0b5890 0x7f36ec1d04a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:33.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.825+0000 7f36f2e00640 1 -- 172.21.15.123:0/4053882620 >> 172.21.15.123:0/4053882620 conn(0x7f36ec0bd530 msgr2=0x7f36ec146fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:33.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.825+0000 7f36f2e00640 1 -- 172.21.15.123:0/4053882620 shutdown_connections 2024-04-17T05:27:33.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:33.825+0000 7f36f2e00640 1 -- 172.21.15.123:0/4053882620 wait complete. 2024-04-17T05:27:34.048 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-17T05:26:52.642446+0000', 'modified': '2024-04-17T05:27:18.881148+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'snap_rstat': True, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4243}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4243': {'gid': 4243, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.164:6835/1946746019', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6834', 'nonce': 1946746019}, {'type': 'v1', 'addr': '172.21.15.164:6835', 'nonce': 1946746019}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4243, 'qdb_cluster': [4243]} 2024-04-17T05:27:34.048 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-17T05:27:34.048 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-17T05:27:34.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.250+0000 7f1415e00640 1 Processor -- start 2024-04-17T05:27:34.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.250+0000 7f1415e00640 1 -- start start 2024-04-17T05:27:34.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.251+0000 7f1415e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f141006bbf0 0x7f1410071500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:34.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.251+0000 7f1415e00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f14101417e0 0x7f1410141c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:34.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.251+0000 7f1415e00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f141006bfd0 con 0x7f14100b58a0 2024-04-17T05:27:34.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.251+0000 7f1415e00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f1410072610 con 0x7f14101417e0 2024-04-17T05:27:34.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.251+0000 7f1415e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f1410073180 con 0x7f141006bbf0 2024-04-17T05:27:34.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.252+0000 7f140e000640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f14100b58a0 0x7f14100b5d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47898/0 (socket says 172.21.15.123:47898) 2024-04-17T05:27:34.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.252+0000 7f140e000640 1 -- 172.21.15.123:0/1229737468 learned_addr learned my addr 172.21.15.123:0/1229737468 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:27:34.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.252+0000 7f140f400640 1 --2- 172.21.15.123:0/1229737468 >> v2:172.21.15.164:3300/0 conn(0x7f14101417e0 0x7f1410141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:34.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.252+0000 7f140ea00640 1 --2- 172.21.15.123:0/1229737468 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f141006bbf0 0x7f1410071500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:34.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.252+0000 7f140d600640 1 -- 172.21.15.123:0/1229737468 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3834279449 0 0) 0x7f141006bfd0 con 0x7f14100b58a0 2024-04-17T05:27:34.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.252+0000 7f140d600640 1 -- 172.21.15.123:0/1229737468 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13f4003520 con 0x7f14100b58a0 2024-04-17T05:27:34.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.252+0000 7f140d600640 1 -- 172.21.15.123:0/1229737468 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 600577104 0 0) 0x7f13f4003520 con 0x7f14100b58a0 2024-04-17T05:27:34.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.252+0000 7f140d600640 1 -- 172.21.15.123:0/1229737468 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f141006bbf0 msgr2=0x7f1410071500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:34.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.252+0000 7f140d600640 1 --2- 172.21.15.123:0/1229737468 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f141006bbf0 0x7f1410071500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.252+0000 7f140d600640 1 -- 172.21.15.123:0/1229737468 >> v2:172.21.15.164:3300/0 conn(0x7f14101417e0 msgr2=0x7f1410141c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:34.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.252+0000 7f140d600640 1 --2- 172.21.15.123:0/1229737468 >> v2:172.21.15.164:3300/0 conn(0x7f14101417e0 0x7f1410141c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.252+0000 7f140d600640 1 -- 172.21.15.123:0/1229737468 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1410073460 con 0x7f14100b58a0 2024-04-17T05:27:34.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.252+0000 7f140d600640 1 -- 172.21.15.123:0/1229737468 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1042962670 0 0) 0x7f13fc001670 con 0x7f14100b58a0 2024-04-17T05:27:34.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.252+0000 7f140d600640 1 -- 172.21.15.123:0/1229737468 >> v1:172.21.15.123:6789/0 conn(0x7f14100b58a0 legacy=0x7f14100b5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:34.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.252+0000 7f140d600640 1 --2- 172.21.15.123:0/1229737468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13f40039b0 0x7f13f4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:34.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.253+0000 7f140d600640 1 --2- 172.21.15.123:0/1229737468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13f4004800 0x7f13f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:34.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.253+0000 7f140d600640 1 --2- 172.21.15.123:0/1229737468 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f141006bbf0 0x7f13f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:34.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.253+0000 7f140d600640 1 -- 172.21.15.123:0/1229737468 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1410072610 con 0x7f13f4004800 2024-04-17T05:27:34.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.253+0000 7f140d600640 1 -- 172.21.15.123:0/1229737468 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1410073180 con 0x7f13f40039b0 2024-04-17T05:27:34.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.253+0000 7f140d600640 1 -- 172.21.15.123:0/1229737468 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f13f400b9c0 con 0x7f141006bbf0 2024-04-17T05:27:34.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.253+0000 7f140f400640 1 --2- 172.21.15.123:0/1229737468 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f141006bbf0 0x7f13f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:34.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.253+0000 7f140e000640 1 --2- 172.21.15.123:0/1229737468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13f4004800 0x7f13f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:34.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.253+0000 7f140ea00640 1 --2- 172.21.15.123:0/1229737468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13f40039b0 0x7f13f4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:34.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.254+0000 7f140e000640 1 -- 172.21.15.123:0/1229737468 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f141006bbf0 msgr2=0x7f13f40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:34.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.254+0000 7f140e000640 1 --2- 172.21.15.123:0/1229737468 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f141006bbf0 0x7f13f40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.254+0000 7f140e000640 1 -- 172.21.15.123:0/1229737468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13f40039b0 msgr2=0x7f13f4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:34.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.254+0000 7f140e000640 1 --2- 172.21.15.123:0/1229737468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13f40039b0 0x7f13f4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.254+0000 7f140e000640 1 -- 172.21.15.123:0/1229737468 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f4003520 con 0x7f13f4004800 2024-04-17T05:27:34.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.254+0000 7f140ea00640 1 --2- 172.21.15.123:0/1229737468 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13f40039b0 0x7f13f4003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T05:27:34.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.255+0000 7f140e000640 1 --2- 172.21.15.123:0/1229737468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13f4004800 0x7f13f4004c80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00c290 tx=0x7f13f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=880aca0a5883dbfa server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:34.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.255+0000 7f140d600640 1 -- 172.21.15.123:0/1229737468 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc007d50 con 0x7f13f4004800 2024-04-17T05:27:34.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.255+0000 7f140d600640 1 -- 172.21.15.123:0/1229737468 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13fc030070 con 0x7f13f4004800 2024-04-17T05:27:34.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.255+0000 7f140d600640 1 -- 172.21.15.123:0/1229737468 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc005d30 con 0x7f13f4004800 2024-04-17T05:27:34.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.256+0000 7f1415e00640 1 -- 172.21.15.123:0/1229737468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13f4004800 msgr2=0x7f13f4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:34.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.256+0000 7f1415e00640 1 --2- 172.21.15.123:0/1229737468 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13f4004800 0x7f13f4004c80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00c290 tx=0x7f13f4005830 comp rx=0 tx=0).stop 2024-04-17T05:27:34.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.256+0000 7f140f400640 1 -- 172.21.15.123:0/1229737468 reap_dead start 2024-04-17T05:27:34.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.256+0000 7f1415e00640 1 -- 172.21.15.123:0/1229737468 shutdown_connections 2024-04-17T05:27:34.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.256+0000 7f1415e00640 1 -- 172.21.15.123:0/1229737468 >> 172.21.15.123:0/1229737468 conn(0x7f141006c210 msgr2=0x7f141006c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:34.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.256+0000 7f1415e00640 1 -- 172.21.15.123:0/1229737468 shutdown_connections 2024-04-17T05:27:34.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.256+0000 7f1415e00640 1 -- 172.21.15.123:0/1229737468 wait complete. 2024-04-17T05:27:34.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.258+0000 7f1415e00640 1 Processor -- start 2024-04-17T05:27:34.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.258+0000 7f1415e00640 1 -- start start 2024-04-17T05:27:34.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.259+0000 7f1415e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13f4004800 0x7f1410144f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:34.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.259+0000 7f1415e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14101426e0 0x7f1410142cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:34.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.259+0000 7f1415e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14100b8d20 0x7f14101e07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:34.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.259+0000 7f1415e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1410072f00 con 0x7f13f4004800 2024-04-17T05:27:34.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.259+0000 7f1415e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1410072d80 con 0x7f14100b8d20 2024-04-17T05:27:34.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.259+0000 7f1415e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f14100721a0 con 0x7f14101426e0 2024-04-17T05:27:34.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.259+0000 7f140ea00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13f4004800 0x7f1410144f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:34.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.259+0000 7f140ea00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13f4004800 0x7f1410144f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42796/0 (socket says 172.21.15.123:42796) 2024-04-17T05:27:34.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.259+0000 7f140ea00640 1 -- 172.21.15.123:0/2083690804 learned_addr learned my addr 172.21.15.123:0/2083690804 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:34.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.259+0000 7f140f400640 1 --2- 172.21.15.123:0/2083690804 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14100b8d20 0x7f14101e07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:34.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.259+0000 7f140e000640 1 --2- 172.21.15.123:0/2083690804 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14101426e0 0x7f1410142cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:34.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.259+0000 7f140ea00640 1 -- 172.21.15.123:0/2083690804 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14101426e0 msgr2=0x7f1410142cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:34.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.259+0000 7f140ea00640 1 --2- 172.21.15.123:0/2083690804 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14101426e0 0x7f1410142cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.259+0000 7f140ea00640 1 -- 172.21.15.123:0/2083690804 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14100b8d20 msgr2=0x7f14101e07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:34.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.259+0000 7f140ea00640 1 --2- 172.21.15.123:0/2083690804 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14100b8d20 0x7f14101e07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.260+0000 7f140ea00640 1 -- 172.21.15.123:0/2083690804 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1410143200 con 0x7f13f4004800 2024-04-17T05:27:34.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.260+0000 7f140ea00640 1 --2- 172.21.15.123:0/2083690804 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13f4004800 0x7f1410144f00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1400011540 tx=0x7f1400011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:34.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.260+0000 7f1407400640 1 -- 172.21.15.123:0/2083690804 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1400015870 con 0x7f13f4004800 2024-04-17T05:27:34.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.260+0000 7f1407400640 1 -- 172.21.15.123:0/2083690804 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1400015a10 con 0x7f13f4004800 2024-04-17T05:27:34.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.260+0000 7f1415e00640 1 -- 172.21.15.123:0/2083690804 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14100b0cc0 con 0x7f13f4004800 2024-04-17T05:27:34.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.260+0000 7f1407400640 1 -- 172.21.15.123:0/2083690804 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1400015dc0 con 0x7f13f4004800 2024-04-17T05:27:34.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.260+0000 7f1415e00640 1 -- 172.21.15.123:0/2083690804 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f141013dec0 con 0x7f13f4004800 2024-04-17T05:27:34.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.263+0000 7f1407400640 1 -- 172.21.15.123:0/2083690804 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f140001d400 con 0x7f13f4004800 2024-04-17T05:27:34.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.264+0000 7f1407400640 1 --2- 172.21.15.123:0/2083690804 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f13f006c920 0x7f13f006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:34.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.264+0000 7f1418a1d740 1 Processor -- start 2024-04-17T05:27:34.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.264+0000 7f1407400640 1 -- 172.21.15.123:0/2083690804 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f140008c580 con 0x7f13f4004800 2024-04-17T05:27:34.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.264+0000 7f1418a1d740 1 -- start start 2024-04-17T05:27:34.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.265+0000 7f140e000640 1 --2- 172.21.15.123:0/2083690804 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f13f006c920 0x7f13f006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:34.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.265+0000 7f1418a1d740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560808216300 0x56080823eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:34.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.265+0000 7f1418a1d740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x56080823efe0 0x56080823a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:34.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.265+0000 7f1418a1d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56080823a970 0x560808245650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:34.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.265+0000 7f1418a1d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56080817d980 con 0x56080823a970 2024-04-17T05:27:34.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.265+0000 7f1418a1d740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x560808124220 con 0x560808216300 2024-04-17T05:27:34.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.265+0000 7f1418a1d740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x560808179940 con 0x56080823efe0 2024-04-17T05:27:34.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.265+0000 7f140f400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56080823a970 0x560808245650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:34.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.265+0000 7f140f400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56080823a970 0x560808245650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42810/0 (socket says 172.21.15.123:42810) 2024-04-17T05:27:34.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.265+0000 7f140f400640 1 -- 172.21.15.123:0/3784740143 learned_addr learned my addr 172.21.15.123:0/3784740143 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:34.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.266+0000 7f140ea00640 1 --2- 172.21.15.123:0/3784740143 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560808216300 0x56080823eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:34.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.266+0000 7f140e000640 1 --2- 172.21.15.123:0/3784740143 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x56080823efe0 0x56080823a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:34.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.266+0000 7f140f400640 1 -- 172.21.15.123:0/3784740143 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x56080823efe0 msgr2=0x56080823a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:34.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.266+0000 7f140f400640 1 --2- 172.21.15.123:0/3784740143 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x56080823efe0 0x56080823a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.266+0000 7f140f400640 1 -- 172.21.15.123:0/3784740143 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560808216300 msgr2=0x56080823eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:34.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.266+0000 7f140f400640 1 --2- 172.21.15.123:0/3784740143 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560808216300 0x56080823eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.266+0000 7f140f400640 1 -- 172.21.15.123:0/3784740143 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560807e902d0 con 0x56080823a970 2024-04-17T05:27:34.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.266+0000 7f140e000640 1 --2- 172.21.15.123:0/2083690804 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f13f006c920 0x7f13f006ede0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f13fc034000 tx=0x7f13fc02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:34.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.266+0000 7f140f400640 1 --2- 172.21.15.123:0/3784740143 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56080823a970 0x560808245650 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1410141bc0 tx=0x7f1408009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d7055993e470d31 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:34.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.266+0000 7f13fb400640 1 -- 172.21.15.123:0/3784740143 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140801a070 con 0x56080823a970 2024-04-17T05:27:34.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.266+0000 7f13fb400640 1 -- 172.21.15.123:0/3784740143 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1408003ba0 con 0x56080823a970 2024-04-17T05:27:34.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.266+0000 7f13fb400640 1 -- 172.21.15.123:0/3784740143 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1408004030 con 0x56080823a970 2024-04-17T05:27:34.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.267+0000 7f1418a1d740 1 -- 172.21.15.123:0/3784740143 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56080823a970 msgr2=0x560808245650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:34.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.267+0000 7f1418a1d740 1 --2- 172.21.15.123:0/3784740143 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56080823a970 0x560808245650 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1410141bc0 tx=0x7f1408009750 comp rx=0 tx=0).stop 2024-04-17T05:27:34.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.267+0000 7f1418a1d740 1 -- 172.21.15.123:0/3784740143 shutdown_connections 2024-04-17T05:27:34.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.267+0000 7f1418a1d740 1 --2- 172.21.15.123:0/3784740143 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56080823a970 0x560808245650 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.267+0000 7f1418a1d740 1 --2- 172.21.15.123:0/3784740143 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x56080823efe0 0x56080823a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.267+0000 7f1418a1d740 1 --2- 172.21.15.123:0/3784740143 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560808216300 0x56080823eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.267+0000 7f1418a1d740 1 -- 172.21.15.123:0/3784740143 >> 172.21.15.123:0/3784740143 conn(0x5608082138d0 msgr2=0x560808215850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:34.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.267+0000 7f1418a1d740 1 -- 172.21.15.123:0/3784740143 shutdown_connections 2024-04-17T05:27:34.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.267+0000 7f1418a1d740 1 -- 172.21.15.123:0/3784740143 wait complete. 2024-04-17T05:27:34.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.268+0000 7f1418a1d740 1 -- start start 2024-04-17T05:27:34.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.268+0000 7f1418a1d740 1 Processor -- start 2024-04-17T05:27:34.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.269+0000 7f1418a1d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56080823a970 0x560808238770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:34.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.269+0000 7f1418a1d740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x56080823efe0 0x560808242360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:34.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.269+0000 7f1418a1d740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560808255c40 0x5608082428a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:34.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.269+0000 7f1418a1d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56080823f460 con 0x56080823a970 2024-04-17T05:27:34.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.269+0000 7f1418a1d740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x560808137590 con 0x560808255c40 2024-04-17T05:27:34.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.269+0000 7f1418a1d740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x560808245070 con 0x56080823efe0 2024-04-17T05:27:34.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.269+0000 7f1418a1d740 10 client.0 _ll_register_callbacks cb 0x560807e8fac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-17T05:27:34.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.269+0000 7f140ea00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56080823a970 0x560808238770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:34.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.269+0000 7f140ea00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56080823a970 0x560808238770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42814/0 (socket says 172.21.15.123:42814) 2024-04-17T05:27:34.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.270+0000 7f140ea00640 1 -- 172.21.15.123:0/329788737 learned_addr learned my addr 172.21.15.123:0/329788737 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:34.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.270+0000 7f140f400640 1 --2- 172.21.15.123:0/329788737 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560808255c40 0x5608082428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:34.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.270+0000 7f140e000640 1 --2- 172.21.15.123:0/329788737 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x56080823efe0 0x560808242360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:34.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.270+0000 7f140ea00640 1 -- 172.21.15.123:0/329788737 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x56080823efe0 msgr2=0x560808242360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:34.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.270+0000 7f140ea00640 1 --2- 172.21.15.123:0/329788737 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x56080823efe0 0x560808242360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.270+0000 7f140ea00640 1 -- 172.21.15.123:0/329788737 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560808255c40 msgr2=0x5608082428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:34.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.270+0000 7f140ea00640 1 --2- 172.21.15.123:0/329788737 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560808255c40 0x5608082428a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.270+0000 7f140ea00640 1 -- 172.21.15.123:0/329788737 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560807f5a6b0 con 0x56080823a970 2024-04-17T05:27:34.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.270+0000 7f140ea00640 1 --2- 172.21.15.123:0/329788737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56080823a970 0x560808238770 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1400056440 tx=0x7f140005a120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5b06590a8f9046a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:34.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.270+0000 7f13efe00640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-04-17T05:27:34.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.270+0000 7f13efe00640 1 -- 172.21.15.123:0/329788737 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140008a410 con 0x56080823a970 2024-04-17T05:27:34.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.270+0000 7f13efe00640 1 -- 172.21.15.123:0/329788737 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f1400062730 con 0x56080823a970 2024-04-17T05:27:34.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.270+0000 7f1418a1d740 1 -- 172.21.15.123:0/329788737 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1408003ba0 con 0x56080823a970 2024-04-17T05:27:34.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.271+0000 7f13efe00640 1 -- 172.21.15.123:0/329788737 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f1400062950 con 0x56080823a970 2024-04-17T05:27:34.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.271+0000 7f1418a1d740 10 client.4794 fetch_fsmap learned FSMap version 9 2024-04-17T05:27:34.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.271+0000 7f1418a1d740 1 -- 172.21.15.123:0/329788737 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x560808240ea0 con 0x56080823a970 2024-04-17T05:27:34.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.271+0000 7f13efe00640 1 -- 172.21.15.123:0/329788737 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1408003ba0 con 0x56080823a970 2024-04-17T05:27:34.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.271+0000 7f13efe00640 1 -- 172.21.15.123:0/329788737 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 9) ==== 2293+0+0 (secure 0 0 0) 0x7f14000793d0 con 0x56080823a970 2024-04-17T05:27:34.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.271+0000 7f1418a1d740 10 client.4794 fetch_fsmap finished waiting for FSMap version 9 2024-04-17T05:27:34.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.271+0000 7f1418a1d740 10 client.4794 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-17T05:27:34.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.271+0000 7f1418a1d740 20 client.4794 populate_metadata read hostname 'smithi123' 2024-04-17T05:27:34.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.271+0000 7f1418a1d740 1 --2- 172.21.15.123:0/329788737 >> [v2:172.21.15.164:6834/1946746019,v1:172.21.15.164:6835/1946746019] conn(0x560808262cd0 0x5608082650c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:34.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.271+0000 7f1418a1d740 4 client.4794 mds_command: new command op to 4243 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-17T05:27:34.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.271+0000 7f1418a1d740 1 -- 172.21.15.123:0/329788737 --> [v2:172.21.15.164:6834/1946746019,v1:172.21.15.164:6835/1946746019] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56080818b3a0 con 0x560808262cd0 2024-04-17T05:27:34.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.272+0000 7f140e000640 1 --2- 172.21.15.123:0/329788737 >> [v2:172.21.15.164:6834/1946746019,v1:172.21.15.164:6835/1946746019] conn(0x560808262cd0 0x5608082650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:34.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.273+0000 7f140e000640 1 --2- 172.21.15.123:0/329788737 >> [v2:172.21.15.164:6834/1946746019,v1:172.21.15.164:6835/1946746019] conn(0x560808262cd0 0x5608082650c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7758261b1afc9777 server_cookie=60a37caa980ef428 in_seq=0 out_seq=0 2024-04-17T05:27:34.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.273+0000 7f13efe00640 10 client.4794 ms_handle_connect on v2:172.21.15.164:6834/1946746019 2024-04-17T05:27:34.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.274+0000 7f13efe00640 1 -- 172.21.15.123:0/329788737 <== mds.0 v2:172.21.15.164:6834/1946746019 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56080818b3a0 con 0x560808262cd0 2024-04-17T05:27:34.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.274+0000 7f13efe00640 10 client.4794 handle_command_reply: tid=0 2024-04-17T05:27:34.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.275+0000 7f1418a1d740 1 client.4794 shutdown 2024-04-17T05:27:34.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.275+0000 7f1418a1d740 1 -- 172.21.15.123:0/329788737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56080823a970 msgr2=0x560808238770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:34.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.275+0000 7f1418a1d740 1 --2- 172.21.15.123:0/329788737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56080823a970 0x560808238770 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1400056440 tx=0x7f140005a120 comp rx=0 tx=0).stop 2024-04-17T05:27:34.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.275+0000 7f1418a1d740 1 -- 172.21.15.123:0/329788737 shutdown_connections 2024-04-17T05:27:34.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.275+0000 7f1418a1d740 1 --2- 172.21.15.123:0/329788737 >> [v2:172.21.15.164:6834/1946746019,v1:172.21.15.164:6835/1946746019] conn(0x560808262cd0 0x5608082650c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.275+0000 7f1418a1d740 1 --2- 172.21.15.123:0/329788737 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560808255c40 0x5608082428a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.275+0000 7f1418a1d740 1 --2- 172.21.15.123:0/329788737 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x56080823efe0 0x560808242360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.275+0000 7f1418a1d740 1 --2- 172.21.15.123:0/329788737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56080823a970 0x560808238770 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.275+0000 7f1418a1d740 1 -- 172.21.15.123:0/329788737 >> 172.21.15.123:0/329788737 conn(0x560808216300 msgr2=0x5608082166e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:34.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.275+0000 7f13efe00640 0 client.4794 ms_handle_reset on v2:172.21.15.164:6834/1946746019 2024-04-17T05:27:34.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.275+0000 7f1418a1d740 1 -- 172.21.15.123:0/329788737 shutdown_connections 2024-04-17T05:27:34.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.275+0000 7f1418a1d740 1 -- 172.21.15.123:0/329788737 wait complete. 2024-04-17T05:27:34.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.275+0000 7f1418a1d740 20 client.4794 trim_cache size 0 max 16384 2024-04-17T05:27:34.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.295+0000 7f1418a1d740 1 Processor -- start 2024-04-17T05:27:34.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.295+0000 7f1418a1d740 1 -- start start 2024-04-17T05:27:34.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.296+0000 7f1418a1d740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x56080823a970 0x5608082427d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:34.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.296+0000 7f1418a1d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56080823efe0 0x5608082166e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:34.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.296+0000 7f1418a1d740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560808255c40 0x56080823cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:34.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.296+0000 7f1418a1d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f14101ebd60 con 0x56080823efe0 2024-04-17T05:27:34.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.296+0000 7f1418a1d740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f14101eae90 con 0x560808255c40 2024-04-17T05:27:34.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.296+0000 7f1418a1d740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x560808238eb0 con 0x56080823a970 2024-04-17T05:27:34.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.296+0000 7f140e000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56080823efe0 0x5608082166e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:34.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.296+0000 7f140e000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56080823efe0 0x5608082166e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42822/0 (socket says 172.21.15.123:42822) 2024-04-17T05:27:34.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.296+0000 7f140e000640 1 -- 172.21.15.123:0/2788944683 learned_addr learned my addr 172.21.15.123:0/2788944683 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:34.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.297+0000 7f140f400640 1 --2- 172.21.15.123:0/2788944683 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560808255c40 0x56080823cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:34.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.297+0000 7f140ea00640 1 --2- 172.21.15.123:0/2788944683 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x56080823a970 0x5608082427d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:34.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.297+0000 7f140e000640 1 -- 172.21.15.123:0/2788944683 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x56080823a970 msgr2=0x5608082427d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:34.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.297+0000 7f140e000640 1 --2- 172.21.15.123:0/2788944683 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x56080823a970 0x5608082427d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.297+0000 7f140e000640 1 -- 172.21.15.123:0/2788944683 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560808255c40 msgr2=0x56080823cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:34.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.297+0000 7f140e000640 1 --2- 172.21.15.123:0/2788944683 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560808255c40 0x56080823cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.297+0000 7f140e000640 1 -- 172.21.15.123:0/2788944683 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560808242de0 con 0x56080823efe0 2024-04-17T05:27:34.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.297+0000 7f140e000640 1 --2- 172.21.15.123:0/2788944683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56080823efe0 0x5608082166e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00c3b0 tx=0x7f13fc009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15352165d17330e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:34.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.297+0000 7f13faa00640 1 -- 172.21.15.123:0/2788944683 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc005dc0 con 0x56080823efe0 2024-04-17T05:27:34.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.297+0000 7f13faa00640 1 -- 172.21.15.123:0/2788944683 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13fc030040 con 0x56080823efe0 2024-04-17T05:27:34.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.297+0000 7f13faa00640 1 -- 172.21.15.123:0/2788944683 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc04f540 con 0x56080823efe0 2024-04-17T05:27:34.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.298+0000 7f1418a1d740 1 -- 172.21.15.123:0/2788944683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56080823efe0 msgr2=0x5608082166e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:34.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.298+0000 7f1418a1d740 1 --2- 172.21.15.123:0/2788944683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56080823efe0 0x5608082166e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00c3b0 tx=0x7f13fc009030 comp rx=0 tx=0).stop 2024-04-17T05:27:34.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.298+0000 7f1418a1d740 1 -- 172.21.15.123:0/2788944683 shutdown_connections 2024-04-17T05:27:34.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.298+0000 7f1418a1d740 1 --2- 172.21.15.123:0/2788944683 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560808255c40 0x56080823cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.298+0000 7f1418a1d740 1 --2- 172.21.15.123:0/2788944683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56080823efe0 0x5608082166e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.298+0000 7f1418a1d740 1 --2- 172.21.15.123:0/2788944683 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x56080823a970 0x5608082427d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.298+0000 7f1418a1d740 1 -- 172.21.15.123:0/2788944683 >> 172.21.15.123:0/2788944683 conn(0x560808216300 msgr2=0x560808238580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:34.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.298+0000 7f1418a1d740 1 -- 172.21.15.123:0/2788944683 shutdown_connections 2024-04-17T05:27:34.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.298+0000 7f1418a1d740 1 -- 172.21.15.123:0/2788944683 wait complete. 2024-04-17T05:27:34.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.299+0000 7f1418a1d740 1 -- start start 2024-04-17T05:27:34.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.299+0000 7f1418a1d740 1 Processor -- start 2024-04-17T05:27:34.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.300+0000 7f1418a1d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56080823a970 0x560808245f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:34.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.300+0000 7f1418a1d740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56080823efe0 0x5608082b9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:34.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.300+0000 7f1418a1d740 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x560808255c40 0x5608082b9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:34.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.300+0000 7f1418a1d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5608082486f0 con 0x56080823a970 2024-04-17T05:27:34.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.300+0000 7f1418a1d740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x56080826af40 con 0x56080823efe0 2024-04-17T05:27:34.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.300+0000 7f1418a1d740 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x56080824fe50 con 0x560808255c40 2024-04-17T05:27:34.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.300+0000 7f1418a1d740 10 client.0 _ll_register_callbacks cb 0x7f1400056320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-17T05:27:34.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.300+0000 7f140ea00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56080823a970 0x560808245f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:34.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.300+0000 7f140ea00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56080823a970 0x560808245f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42828/0 (socket says 172.21.15.123:42828) 2024-04-17T05:27:34.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.300+0000 7f140ea00640 1 -- 172.21.15.123:0/3110114623 learned_addr learned my addr 172.21.15.123:0/3110114623 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:34.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.301+0000 7f140e000640 1 --2- 172.21.15.123:0/3110114623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56080823efe0 0x5608082b9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:34.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.301+0000 7f140f400640 1 --2- 172.21.15.123:0/3110114623 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x560808255c40 0x5608082b9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:34.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.301+0000 7f140ea00640 1 -- 172.21.15.123:0/3110114623 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x560808255c40 msgr2=0x5608082b9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:34.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.301+0000 7f140ea00640 1 --2- 172.21.15.123:0/3110114623 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x560808255c40 0x5608082b9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.301+0000 7f140ea00640 1 -- 172.21.15.123:0/3110114623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56080823efe0 msgr2=0x5608082b9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:34.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.301+0000 7f140ea00640 1 --2- 172.21.15.123:0/3110114623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56080823efe0 0x5608082b9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.301+0000 7f140ea00640 1 -- 172.21.15.123:0/3110114623 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608082bfa90 con 0x56080823a970 2024-04-17T05:27:34.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.301+0000 7f140e000640 1 --2- 172.21.15.123:0/3110114623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56080823efe0 0x5608082b9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:34.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.301+0000 7f140ea00640 1 --2- 172.21.15.123:0/3110114623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56080823a970 0x560808245f20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1400058290 tx=0x7f140008a6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e5e4da9a900e25b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:34.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.301+0000 7f13efe00640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-04-17T05:27:34.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.301+0000 7f13efe00640 1 -- 172.21.15.123:0/3110114623 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140008a410 con 0x56080823a970 2024-04-17T05:27:34.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.301+0000 7f13efe00640 1 -- 172.21.15.123:0/3110114623 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f14000793f0 con 0x56080823a970 2024-04-17T05:27:34.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.301+0000 7f1418a1d740 1 -- 172.21.15.123:0/3110114623 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13fc030040 con 0x56080823a970 2024-04-17T05:27:34.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.301+0000 7f13efe00640 1 -- 172.21.15.123:0/3110114623 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f1400059430 con 0x56080823a970 2024-04-17T05:27:34.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.301+0000 7f1418a1d740 10 client.4800 fetch_fsmap learned FSMap version 9 2024-04-17T05:27:34.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.301+0000 7f1418a1d740 1 -- 172.21.15.123:0/3110114623 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5608082bfca0 con 0x56080823a970 2024-04-17T05:27:34.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.302+0000 7f13efe00640 1 -- 172.21.15.123:0/3110114623 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13fc030040 con 0x56080823a970 2024-04-17T05:27:34.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.302+0000 7f13efe00640 1 -- 172.21.15.123:0/3110114623 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 9) ==== 2293+0+0 (secure 0 0 0) 0x7f1400055d30 con 0x56080823a970 2024-04-17T05:27:34.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.302+0000 7f1418a1d740 10 client.4800 fetch_fsmap finished waiting for FSMap version 9 2024-04-17T05:27:34.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.302+0000 7f1418a1d740 10 client.4800 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-17T05:27:34.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.302+0000 7f1418a1d740 20 client.4800 populate_metadata read hostname 'smithi123' 2024-04-17T05:27:34.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.302+0000 7f1418a1d740 1 --2- 172.21.15.123:0/3110114623 >> [v2:172.21.15.164:6834/1946746019,v1:172.21.15.164:6835/1946746019] conn(0x560808246860 0x560808246c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:34.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.302+0000 7f1418a1d740 4 client.4800 mds_command: new command op to 4243 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-17T05:27:34.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.302+0000 7f1418a1d740 1 -- 172.21.15.123:0/3110114623 --> [v2:172.21.15.164:6834/1946746019,v1:172.21.15.164:6835/1946746019] -- command(tid 0: {"prefix": "status"}) -- 0x560808185210 con 0x560808246860 2024-04-17T05:27:34.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.303+0000 7f140e000640 1 --2- 172.21.15.123:0/3110114623 >> [v2:172.21.15.164:6834/1946746019,v1:172.21.15.164:6835/1946746019] conn(0x560808246860 0x560808246c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:34.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.304+0000 7f13efe00640 10 client.4800 ms_handle_connect on v2:172.21.15.164:6834/1946746019 2024-04-17T05:27:34.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.304+0000 7f140e000640 1 --2- 172.21.15.123:0/3110114623 >> [v2:172.21.15.164:6834/1946746019,v1:172.21.15.164:6835/1946746019] conn(0x560808246860 0x560808246c40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cc5f585fddde015 server_cookie=4b0934606677d8f6 in_seq=0 out_seq=0 2024-04-17T05:27:34.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.304+0000 7f13efe00640 1 -- 172.21.15.123:0/3110114623 <== mds.0 v2:172.21.15.164:6834/1946746019 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x560808185210 con 0x560808246860 2024-04-17T05:27:34.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.304+0000 7f13efe00640 10 client.4800 handle_command_reply: tid=0 2024-04-17T05:27:34.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.304+0000 7f1418a1d740 1 client.4800 shutdown 2024-04-17T05:27:34.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.305+0000 7f1418a1d740 1 -- 172.21.15.123:0/3110114623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56080823a970 msgr2=0x560808245f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:34.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.305+0000 7f1418a1d740 1 --2- 172.21.15.123:0/3110114623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56080823a970 0x560808245f20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1400058290 tx=0x7f140008a6b0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.305+0000 7f1418a1d740 1 -- 172.21.15.123:0/3110114623 shutdown_connections 2024-04-17T05:27:34.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.305+0000 7f1418a1d740 1 --2- 172.21.15.123:0/3110114623 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x560808255c40 0x5608082b9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.305+0000 7f1418a1d740 1 --2- 172.21.15.123:0/3110114623 >> [v2:172.21.15.164:6834/1946746019,v1:172.21.15.164:6835/1946746019] conn(0x560808246860 0x560808246c40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.305+0000 7f1418a1d740 1 --2- 172.21.15.123:0/3110114623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56080823efe0 0x5608082b9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.305+0000 7f1418a1d740 1 --2- 172.21.15.123:0/3110114623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56080823a970 0x560808245f20 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.305+0000 7f1418a1d740 1 -- 172.21.15.123:0/3110114623 >> 172.21.15.123:0/3110114623 conn(0x560808216300 msgr2=0x56080823a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:34.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.305+0000 7f13efe00640 0 client.4800 ms_handle_reset on v2:172.21.15.164:6834/1946746019 2024-04-17T05:27:34.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.305+0000 7f1418a1d740 1 -- 172.21.15.123:0/3110114623 shutdown_connections 2024-04-17T05:27:34.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.305+0000 7f1418a1d740 1 -- 172.21.15.123:0/3110114623 wait complete. 2024-04-17T05:27:34.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.305+0000 7f1418a1d740 20 client.4800 trim_cache size 0 max 16384 2024-04-17T05:27:34.311 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-04-17T05:27:34.311 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "0787c5c0-e77a-4102-a899-30db48b19c68", 2024-04-17T05:27:34.311 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-04-17T05:27:34.311 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 4243, 2024-04-17T05:27:34.312 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-04-17T05:27:34.312 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-04-17T05:27:34.312 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-04-17T05:27:34.312 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 41.089983347999997, 2024-04-17T05:27:34.312 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 9, 2024-04-17T05:27:34.312 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 26, 2024-04-17T05:27:34.312 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 26, 2024-04-17T05:27:34.312 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 48.740637761000002 2024-04-17T05:27:34.312 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-04-17T05:27:34.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.306+0000 7f1415e00640 1 -- 172.21.15.123:0/2083690804 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f13f006c920 msgr2=0x7f13f006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:34.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.306+0000 7f1415e00640 1 --2- 172.21.15.123:0/2083690804 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f13f006c920 0x7f13f006ede0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f13fc034000 tx=0x7f13fc02e000 comp rx=0 tx=0).stop 2024-04-17T05:27:34.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.306+0000 7f1415e00640 1 -- 172.21.15.123:0/2083690804 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13f4004800 msgr2=0x7f1410144f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:34.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.306+0000 7f1415e00640 1 --2- 172.21.15.123:0/2083690804 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13f4004800 0x7f1410144f00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1400011540 tx=0x7f1400011a00 comp rx=0 tx=0).stop 2024-04-17T05:27:34.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.306+0000 7f1415e00640 1 -- 172.21.15.123:0/2083690804 shutdown_connections 2024-04-17T05:27:34.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.306+0000 7f1415e00640 1 --2- 172.21.15.123:0/2083690804 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14100b8d20 0x7f14101e07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.306+0000 7f1415e00640 1 --2- 172.21.15.123:0/2083690804 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f13f006c920 0x7f13f006ede0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.306+0000 7f1415e00640 1 --2- 172.21.15.123:0/2083690804 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14101426e0 0x7f1410142cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.306+0000 7f1415e00640 1 --2- 172.21.15.123:0/2083690804 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13f4004800 0x7f1410144f00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.306+0000 7f1415e00640 1 -- 172.21.15.123:0/2083690804 >> 172.21.15.123:0/2083690804 conn(0x7f141006c210 msgr2=0x7f14100b6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:34.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.306+0000 7f1415e00640 1 -- 172.21.15.123:0/2083690804 shutdown_connections 2024-04-17T05:27:34.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.306+0000 7f1415e00640 1 -- 172.21.15.123:0/2083690804 wait complete. 2024-04-17T05:27:34.321 INFO:teuthology.run_tasks:Running task sequential... 2024-04-17T05:27:34.330 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-17T05:27:34.330 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-17T05:27:34.331 INFO:teuthology.task.print:Enabling mgr modules 2024-04-17T05:27:34.331 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-17T05:27:34.348 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-17T05:27:34.348 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-17T05:27:34.348 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-17T05:27:34.348 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-17T05:27:34.349 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-17T05:27:34.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T05:27:34.349 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-04-17T05:27:34.396 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-17T05:27:34.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T05:27:34.398 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-17T05:27:34.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T05:27:34.528 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link delete ceph-brx 2024-04-17T05:27:34.631 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-17T05:27:34.632 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-17T05:27:34.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.811+0000 7f189f200640 1 Processor -- start 2024-04-17T05:27:34.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.811+0000 7f189f200640 1 -- start start 2024-04-17T05:27:34.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.812+0000 7f189f200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f18a00b2ad0 0x7f18a0148de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:34.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.812+0000 7f189f200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18a0070940 0x7f18a0149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:34.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.812+0000 7f189f200640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f18a013f1f0 0x7f18a013f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:34.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.812+0000 7f189f200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f18a00b2eb0 con 0x7f18a00b2ad0 2024-04-17T05:27:34.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.812+0000 7f189f200640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f18a0071cf0 con 0x7f18a013f1f0 2024-04-17T05:27:34.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.812+0000 7f189f200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f18a00b4fa0 con 0x7f18a0070940 2024-04-17T05:27:34.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.812+0000 7f189de00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f18a00b2ad0 0x7f18a0148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:34.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.813+0000 7f189de00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f18a00b2ad0 0x7f18a0148de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42830/0 (socket says 172.21.15.123:42830) 2024-04-17T05:27:34.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.813+0000 7f189de00640 1 -- 172.21.15.123:0/3893779608 learned_addr learned my addr 172.21.15.123:0/3893779608 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:34.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.813+0000 7f189e800640 1 --2- 172.21.15.123:0/3893779608 >> v2:172.21.15.164:3300/0 conn(0x7f18a013f1f0 0x7f18a013f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:34.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.813+0000 7f1895400640 1 --2- 172.21.15.123:0/3893779608 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18a0070940 0x7f18a0149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:34.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.813+0000 7f189de00640 1 -- 172.21.15.123:0/3893779608 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18a0070940 msgr2=0x7f18a0149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:34.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.813+0000 7f189de00640 1 --2- 172.21.15.123:0/3893779608 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18a0070940 0x7f18a0149320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.813+0000 7f189de00640 1 -- 172.21.15.123:0/3893779608 >> v2:172.21.15.164:3300/0 conn(0x7f18a013f1f0 msgr2=0x7f18a013f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:27:34.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.813+0000 7f189de00640 1 --2- 172.21.15.123:0/3893779608 >> v2:172.21.15.164:3300/0 conn(0x7f18a013f1f0 0x7f18a013f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.813+0000 7f189de00640 1 -- 172.21.15.123:0/3893779608 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a00b5280 con 0x7f18a00b2ad0 2024-04-17T05:27:34.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.813+0000 7f189e800640 1 --2- 172.21.15.123:0/3893779608 >> v2:172.21.15.164:3300/0 conn(0x7f18a013f1f0 0x7f18a013f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:34.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.814+0000 7f189de00640 1 --2- 172.21.15.123:0/3893779608 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18a00b2ad0 0x7f18a0148de0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f18a01457f0 tx=0x7f189002b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835cecce860f855 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:34.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.814+0000 7f189d400640 1 -- 172.21.15.123:0/3893779608 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1890038070 con 0x7f18a00b2ad0 2024-04-17T05:27:34.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.814+0000 7f189d400640 1 -- 172.21.15.123:0/3893779608 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1890031740 con 0x7f18a00b2ad0 2024-04-17T05:27:34.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.814+0000 7f189d400640 1 -- 172.21.15.123:0/3893779608 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f189002f050 con 0x7f18a00b2ad0 2024-04-17T05:27:34.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.815+0000 7f189f200640 1 -- 172.21.15.123:0/3893779608 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18a00b2ad0 msgr2=0x7f18a0148de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:34.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.815+0000 7f189f200640 1 --2- 172.21.15.123:0/3893779608 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18a00b2ad0 0x7f18a0148de0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f18a01457f0 tx=0x7f189002b7e0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.815+0000 7f189f200640 1 -- 172.21.15.123:0/3893779608 shutdown_connections 2024-04-17T05:27:34.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.815+0000 7f189f200640 1 --2- 172.21.15.123:0/3893779608 >> v2:172.21.15.164:3300/0 conn(0x7f18a013f1f0 0x7f18a013f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.815+0000 7f189f200640 1 --2- 172.21.15.123:0/3893779608 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18a0070940 0x7f18a0149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.815+0000 7f189f200640 1 --2- 172.21.15.123:0/3893779608 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18a00b2ad0 0x7f18a0148de0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.815+0000 7f189f200640 1 -- 172.21.15.123:0/3893779608 >> 172.21.15.123:0/3893779608 conn(0x7f18a00b9150 msgr2=0x7f18a00b9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:34.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.815+0000 7f189f200640 1 -- 172.21.15.123:0/3893779608 shutdown_connections 2024-04-17T05:27:34.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.815+0000 7f189f200640 1 -- 172.21.15.123:0/3893779608 wait complete. 2024-04-17T05:27:34.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.817+0000 7f189f200640 1 Processor -- start 2024-04-17T05:27:34.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.817+0000 7f189f200640 1 -- start start 2024-04-17T05:27:34.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.818+0000 7f189f200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f18a0070940 0x7f18a00aee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:34.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.818+0000 7f189f200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18a00b2ad0 0x7f18a01e05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:34.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.818+0000 7f189f200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18a013f1f0 0x7f18a01e0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:34.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.818+0000 7f189f200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f18a013fbc0 con 0x7f18a00b2ad0 2024-04-17T05:27:34.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.818+0000 7f189f200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f18a00b3560 con 0x7f18a0070940 2024-04-17T05:27:34.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.818+0000 7f189f200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f18a00b3b50 con 0x7f18a013f1f0 2024-04-17T05:27:34.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.818+0000 7f1895400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18a00b2ad0 0x7f18a01e05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:34.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.818+0000 7f1895400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18a00b2ad0 0x7f18a01e05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35624/0 (socket says 172.21.15.123:35624) 2024-04-17T05:27:34.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.818+0000 7f1895400640 1 -- 172.21.15.123:0/4294719349 learned_addr learned my addr 172.21.15.123:0/4294719349 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:27:34.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.818+0000 7f189de00640 1 --2- 172.21.15.123:0/4294719349 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f18a0070940 0x7f18a00aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:34.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.818+0000 7f189e800640 1 --2- 172.21.15.123:0/4294719349 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18a013f1f0 0x7f18a01e0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:34.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.818+0000 7f1895400640 1 -- 172.21.15.123:0/4294719349 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18a013f1f0 msgr2=0x7f18a01e0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:34.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.818+0000 7f1895400640 1 --2- 172.21.15.123:0/4294719349 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18a013f1f0 0x7f18a01e0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.818+0000 7f1895400640 1 -- 172.21.15.123:0/4294719349 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f18a0070940 msgr2=0x7f18a00aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:34.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.818+0000 7f1895400640 1 --2- 172.21.15.123:0/4294719349 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f18a0070940 0x7f18a00aee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:34.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.819+0000 7f1895400640 1 -- 172.21.15.123:0/4294719349 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a00b05d0 con 0x7f18a00b2ad0 2024-04-17T05:27:34.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.819+0000 7f189de00640 1 --2- 172.21.15.123:0/4294719349 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f18a0070940 0x7f18a00aee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:27:34.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.819+0000 7f1895400640 1 --2- 172.21.15.123:0/4294719349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18a00b2ad0 0x7f18a01e05f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f188800c7f0 tx=0x7f188800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:34.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.819+0000 7f1896a00640 1 -- 172.21.15.123:0/4294719349 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1888015070 con 0x7f18a00b2ad0 2024-04-17T05:27:34.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.819+0000 7f1896a00640 1 -- 172.21.15.123:0/4294719349 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1888004240 con 0x7f18a00b2ad0 2024-04-17T05:27:34.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.819+0000 7f189f200640 1 -- 172.21.15.123:0/4294719349 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18a00b02f0 con 0x7f18a00b2ad0 2024-04-17T05:27:34.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.819+0000 7f1896a00640 1 -- 172.21.15.123:0/4294719349 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1888007620 con 0x7f18a00b2ad0 2024-04-17T05:27:34.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.819+0000 7f189f200640 1 -- 172.21.15.123:0/4294719349 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18a00b0c00 con 0x7f18a00b2ad0 2024-04-17T05:27:34.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.820+0000 7f189f200640 1 -- 172.21.15.123:0/4294719349 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18a00759b0 con 0x7f18a00b2ad0 2024-04-17T05:27:34.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.821+0000 7f1896a00640 1 -- 172.21.15.123:0/4294719349 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f18880079d0 con 0x7f18a00b2ad0 2024-04-17T05:27:34.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.822+0000 7f1896a00640 1 --2- 172.21.15.123:0/4294719349 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f187c06c8f0 0x7f187c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:27:34.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.822+0000 7f1896a00640 1 -- 172.21.15.123:0/4294719349 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f188808c2b0 con 0x7f18a00b2ad0 2024-04-17T05:27:34.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.823+0000 7f189de00640 1 --2- 172.21.15.123:0/4294719349 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f187c06c8f0 0x7f187c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:27:34.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.824+0000 7f189de00640 1 --2- 172.21.15.123:0/4294719349 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f187c06c8f0 0x7f187c06edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1890035000 tx=0x7f1890008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:27:34.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:34.827+0000 7f1896a00640 1 -- 172.21.15.123:0/4294719349 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f18a00b05d0 con 0x7f18a00b2ad0 2024-04-17T05:27:35.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:35.068+0000 7f189f200640 1 -- 172.21.15.123:0/4294719349 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f18a00b8620 con 0x7f18a00b2ad0 2024-04-17T05:27:35.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:35.069+0000 7f1896a00640 1 -- 172.21.15.123:0/4294719349 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f188805a390 con 0x7f18a00b2ad0 2024-04-17T05:27:35.068 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-17T05:27:35.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:35.071+0000 7f189f200640 1 -- 172.21.15.123:0/4294719349 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f187c06c8f0 msgr2=0x7f187c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:35.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:35.071+0000 7f189f200640 1 --2- 172.21.15.123:0/4294719349 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f187c06c8f0 0x7f187c06edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1890035000 tx=0x7f1890008030 comp rx=0 tx=0).stop 2024-04-17T05:27:35.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:35.071+0000 7f189f200640 1 -- 172.21.15.123:0/4294719349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18a00b2ad0 msgr2=0x7f18a01e05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:27:35.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:35.071+0000 7f189f200640 1 --2- 172.21.15.123:0/4294719349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18a00b2ad0 0x7f18a01e05f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f188800c7f0 tx=0x7f188800ccb0 comp rx=0 tx=0).stop 2024-04-17T05:27:35.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:35.071+0000 7f189f200640 1 -- 172.21.15.123:0/4294719349 shutdown_connections 2024-04-17T05:27:35.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:35.071+0000 7f189f200640 1 --2- 172.21.15.123:0/4294719349 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f187c06c8f0 0x7f187c06edb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:35.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:35.071+0000 7f189f200640 1 --2- 172.21.15.123:0/4294719349 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f18a013f1f0 0x7f18a01e0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:35.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:35.071+0000 7f189f200640 1 --2- 172.21.15.123:0/4294719349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18a00b2ad0 0x7f18a01e05f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:35.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:35.071+0000 7f189f200640 1 --2- 172.21.15.123:0/4294719349 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f18a0070940 0x7f18a00aee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:27:35.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:35.071+0000 7f189f200640 1 -- 172.21.15.123:0/4294719349 >> 172.21.15.123:0/4294719349 conn(0x7f18a00b9150 msgr2=0x7f18a00b6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:27:35.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:35.072+0000 7f189f200640 1 -- 172.21.15.123:0/4294719349 shutdown_connections 2024-04-17T05:27:35.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:35.072+0000 7f189f200640 1 -- 172.21.15.123:0/4294719349 wait complete. 2024-04-17T05:27:35.088 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-17T05:27:35.088 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-17T05:27:35.089 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-04-17T05:27:35.089 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-17T05:27:35.089 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-17T05:27:35.089 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-17T05:27:35.089 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-17T05:27:35.089 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-17T05:27:35.089 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-17T05:27:35.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T05:27:35.089 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-04-17T05:27:35.139 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-17T05:27:35.139 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-17T05:27:35.139 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-04-17T05:27:35.139 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-17T05:27:35.139 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-04-17T05:27:35.139 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-17T05:27:35.139 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-17T05:27:35.139 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-04-17T05:27:35.139 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2024-04-17T05:27:35.139 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-17T05:27:35.140 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-04-17T05:27:35.140 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2024-04-17T05:27:35.140 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-17T05:27:35.140 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-04-17T05:27:35.140 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-17T05:27:35.140 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-04-17T05:27:35.140 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-17T05:27:35.140 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42542sec preferred_lft 42542sec 2024-04-17T05:27:35.140 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link 2024-04-17T05:27:35.140 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-17T05:27:35.141 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-17T05:27:35.141 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T05:27:35.141 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-04-17T05:27:35.141 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add name ceph-brx type bridge 2024-04-17T05:27:35.141 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip addr flush dev ceph-brx 2024-04-17T05:27:35.141 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set ceph-brx up 2024-04-17T05:27:35.141 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-17T05:27:35.141 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-04-17T05:27:35.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T05:27:35.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T05:27:35.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T05:27:35.418 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-17T05:27:35.492 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-04-17T05:27:35.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T05:27:35.496 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-04-17T05:27:35.545 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-04-17T05:27:35.545 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-17T05:27:35.545 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-17T05:27:35.545 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-17T05:27:35.545 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-17T05:27:35.546 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T05:27:35.546 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-04-17T05:27:35.546 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-17T05:27:35.546 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-17T05:27:35.546 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-17T05:27:35.546 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-04-17T05:27:35.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T05:27:35.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T05:27:35.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T05:27:35.787 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-04-17T05:27:35.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T05:27:35.835 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list-id 2024-04-17T05:27:35.886 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T05:27:35.887 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-04-17T05:27:35.887 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T05:27:35.887 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-17T05:27:35.887 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-04-17T05:27:35.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T05:27:36.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T05:27:36.090 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-17T05:27:36.091 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T05:27:36.091 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-04-17T05:27:36.091 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-17T05:27:36.091 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-17T05:27:36.091 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-17T05:27:36.091 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-17T05:27:36.091 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-17T05:27:36.091 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-04-17T05:27:36.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T05:27:36.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T05:27:36.394 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T05:27:36.394 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-04-17T05:27:36.394 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-04-17T05:27:36.394 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set dev brx.0 master ceph-brx 2024-04-17T05:27:36.394 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-04-17T05:27:36.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T05:27:36.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T05:27:36.624 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-17T05:27:36.624 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-17T05:27:36.624 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-17T05:27:36.669 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-17T05:27:36.669 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-17T05:27:36.669 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-17T05:27:36.764 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2024-04-17T05:27:36.856 DEBUG:teuthology.orchestra.run.smithi123:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T05:27:36.911 INFO:teuthology.orchestra.run.smithi123.stdout:/proc 2024-04-17T05:27:36.911 INFO:teuthology.orchestra.run.smithi123.stdout:/sys 2024-04-17T05:27:36.911 INFO:teuthology.orchestra.run.smithi123.stdout:/dev 2024-04-17T05:27:36.911 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/kernel/security 2024-04-17T05:27:36.911 INFO:teuthology.orchestra.run.smithi123.stdout:/dev/shm 2024-04-17T05:27:36.911 INFO:teuthology.orchestra.run.smithi123.stdout:/dev/pts 2024-04-17T05:27:36.912 INFO:teuthology.orchestra.run.smithi123.stdout:/run 2024-04-17T05:27:36.912 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/cgroup 2024-04-17T05:27:36.912 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/pstore 2024-04-17T05:27:36.912 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/bpf 2024-04-17T05:27:36.912 INFO:teuthology.orchestra.run.smithi123.stdout:/ 2024-04-17T05:27:36.912 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/selinux 2024-04-17T05:27:36.912 INFO:teuthology.orchestra.run.smithi123.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T05:27:36.912 INFO:teuthology.orchestra.run.smithi123.stdout:/dev/hugepages 2024-04-17T05:27:36.912 INFO:teuthology.orchestra.run.smithi123.stdout:/dev/mqueue 2024-04-17T05:27:36.912 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/kernel/debug 2024-04-17T05:27:36.912 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/kernel/tracing 2024-04-17T05:27:36.912 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/fuse/connections 2024-04-17T05:27:36.912 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/kernel/config 2024-04-17T05:27:36.912 INFO:teuthology.orchestra.run.smithi123.stdout:/run/credentials/systemd-sysctl.service 2024-04-17T05:27:36.912 INFO:teuthology.orchestra.run.smithi123.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-17T05:27:36.913 INFO:teuthology.orchestra.run.smithi123.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-17T05:27:36.913 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/nfs/rpc_pipefs 2024-04-17T05:27:36.913 INFO:teuthology.orchestra.run.smithi123.stdout:/run/user/1000 2024-04-17T05:27:36.913 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/ceph 2024-04-17T05:27:36.913 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/ceph/osd/ceph-0 2024-04-17T05:27:36.913 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/ceph/osd/ceph-1 2024-04-17T05:27:36.913 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/ceph/osd/ceph-2 2024-04-17T05:27:36.913 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/ceph/osd/ceph-3 2024-04-17T05:27:36.913 INFO:teuthology.orchestra.run.smithi123.stdout:/run/netns 2024-04-17T05:27:36.913 INFO:teuthology.orchestra.run.smithi123.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T05:27:36.913 INFO:teuthology.orchestra.run.smithi123.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T05:27:36.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T05:27:36.914 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2024-04-17T05:27:36.965 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-17T05:27:36.965 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-17T05:27:36.972 DEBUG:teuthology.orchestra.run.smithi123:> sudo modprobe fuse 2024-04-17T05:27:37.049 DEBUG:teuthology.orchestra.run.smithi123:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T05:27:37.091 INFO:teuthology.orchestra.run.smithi123.stdout:/proc 2024-04-17T05:27:37.091 INFO:teuthology.orchestra.run.smithi123.stdout:/sys 2024-04-17T05:27:37.092 INFO:teuthology.orchestra.run.smithi123.stdout:/dev 2024-04-17T05:27:37.092 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/kernel/security 2024-04-17T05:27:37.092 INFO:teuthology.orchestra.run.smithi123.stdout:/dev/shm 2024-04-17T05:27:37.092 INFO:teuthology.orchestra.run.smithi123.stdout:/dev/pts 2024-04-17T05:27:37.092 INFO:teuthology.orchestra.run.smithi123.stdout:/run 2024-04-17T05:27:37.092 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/cgroup 2024-04-17T05:27:37.092 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/pstore 2024-04-17T05:27:37.092 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/bpf 2024-04-17T05:27:37.092 INFO:teuthology.orchestra.run.smithi123.stdout:/ 2024-04-17T05:27:37.092 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/selinux 2024-04-17T05:27:37.092 INFO:teuthology.orchestra.run.smithi123.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T05:27:37.092 INFO:teuthology.orchestra.run.smithi123.stdout:/dev/hugepages 2024-04-17T05:27:37.092 INFO:teuthology.orchestra.run.smithi123.stdout:/dev/mqueue 2024-04-17T05:27:37.093 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/kernel/debug 2024-04-17T05:27:37.093 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/kernel/tracing 2024-04-17T05:27:37.093 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/fs/fuse/connections 2024-04-17T05:27:37.093 INFO:teuthology.orchestra.run.smithi123.stdout:/sys/kernel/config 2024-04-17T05:27:37.093 INFO:teuthology.orchestra.run.smithi123.stdout:/run/credentials/systemd-sysctl.service 2024-04-17T05:27:37.093 INFO:teuthology.orchestra.run.smithi123.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-17T05:27:37.093 INFO:teuthology.orchestra.run.smithi123.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-17T05:27:37.093 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/nfs/rpc_pipefs 2024-04-17T05:27:37.093 INFO:teuthology.orchestra.run.smithi123.stdout:/run/user/1000 2024-04-17T05:27:37.093 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/ceph 2024-04-17T05:27:37.093 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/ceph/osd/ceph-0 2024-04-17T05:27:37.093 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/ceph/osd/ceph-1 2024-04-17T05:27:37.093 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/ceph/osd/ceph-2 2024-04-17T05:27:37.094 INFO:teuthology.orchestra.run.smithi123.stdout:/var/lib/ceph/osd/ceph-3 2024-04-17T05:27:37.094 INFO:teuthology.orchestra.run.smithi123.stdout:/run/netns 2024-04-17T05:27:37.094 INFO:teuthology.orchestra.run.smithi123.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T05:27:37.094 INFO:teuthology.orchestra.run.smithi123.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T05:27:37.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T05:27:37.095 DEBUG:teuthology.orchestra.run.smithi123:> ls /sys/fs/fuse/connections 2024-04-17T05:27:37.165 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:2024-04-17T05:27:37.166+0000 7f5e079ff480 -1 init, newargv = 0x558c6c73bc30 newargc=15 2024-04-17T05:27:37.165 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:ceph-fuse[46921]: starting ceph client 2024-04-17T05:27:37.176 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:ceph-fuse[46921]: starting fuse 2024-04-17T05:27:37.183 INFO:teuthology.orchestra.run.smithi123.stdout:42 2024-04-17T05:27:37.183 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-04-17T05:27:37.183 DEBUG:teuthology.orchestra.run.smithi123:> sudo stdin-killer -- python3 -c ' 2024-04-17T05:27:37.183 DEBUG:teuthology.orchestra.run.smithi123:> import glob 2024-04-17T05:27:37.183 DEBUG:teuthology.orchestra.run.smithi123:> import re 2024-04-17T05:27:37.183 DEBUG:teuthology.orchestra.run.smithi123:> import os 2024-04-17T05:27:37.183 DEBUG:teuthology.orchestra.run.smithi123:> import subprocess 2024-04-17T05:27:37.184 DEBUG:teuthology.orchestra.run.smithi123:> 2024-04-17T05:27:37.184 DEBUG:teuthology.orchestra.run.smithi123:> def _find_admin_socket(client_name): 2024-04-17T05:27:37.184 DEBUG:teuthology.orchestra.run.smithi123:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-17T05:27:37.184 DEBUG:teuthology.orchestra.run.smithi123:> files = glob.glob(asok_path) 2024-04-17T05:27:37.184 DEBUG:teuthology.orchestra.run.smithi123:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-17T05:27:37.184 DEBUG:teuthology.orchestra.run.smithi123:> 2024-04-17T05:27:37.184 DEBUG:teuthology.orchestra.run.smithi123:> # Given a non-glob path, it better be there 2024-04-17T05:27:37.184 DEBUG:teuthology.orchestra.run.smithi123:> if "*" not in asok_path: 2024-04-17T05:27:37.184 DEBUG:teuthology.orchestra.run.smithi123:> assert(len(files) == 1) 2024-04-17T05:27:37.184 DEBUG:teuthology.orchestra.run.smithi123:> return files[0] 2024-04-17T05:27:37.184 DEBUG:teuthology.orchestra.run.smithi123:> 2024-04-17T05:27:37.184 DEBUG:teuthology.orchestra.run.smithi123:> for f in files: 2024-04-17T05:27:37.184 DEBUG:teuthology.orchestra.run.smithi123:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-17T05:27:37.184 DEBUG:teuthology.orchestra.run.smithi123:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-17T05:27:37.185 DEBUG:teuthology.orchestra.run.smithi123:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-17T05:27:37.185 DEBUG:teuthology.orchestra.run.smithi123:> contents = proc_f.read() 2024-04-17T05:27:37.185 DEBUG:teuthology.orchestra.run.smithi123:> if mountpoint in contents: 2024-04-17T05:27:37.185 DEBUG:teuthology.orchestra.run.smithi123:> return f 2024-04-17T05:27:37.185 DEBUG:teuthology.orchestra.run.smithi123:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-17T05:27:37.185 DEBUG:teuthology.orchestra.run.smithi123:> 2024-04-17T05:27:37.185 DEBUG:teuthology.orchestra.run.smithi123:> print(_find_admin_socket("client.0")) 2024-04-17T05:27:37.185 DEBUG:teuthology.orchestra.run.smithi123:> ' 2024-04-17T05:27:37.386 INFO:teuthology.orchestra.run.smithi123.stdout:/var/run/ceph/ceph-client.0.46921.asok 2024-04-17T05:27:37.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:27:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T05:27:37.402 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.46921.asok 2024-04-17T05:27:37.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T05:27:37.402 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.46921.asok status 2024-04-17T05:27:37.637 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-04-17T05:27:37.638 INFO:teuthology.orchestra.run.smithi123.stdout: "metadata": { 2024-04-17T05:27:37.638 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_sha1": "a8c84f5997950fd7d008204839253291d52e6eda", 2024-04-17T05:27:37.638 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_version": "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)", 2024-04-17T05:27:37.638 INFO:teuthology.orchestra.run.smithi123.stdout: "entity_id": "0", 2024-04-17T05:27:37.638 INFO:teuthology.orchestra.run.smithi123.stdout: "hostname": "smithi123", 2024-04-17T05:27:37.638 INFO:teuthology.orchestra.run.smithi123.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-17T05:27:37.638 INFO:teuthology.orchestra.run.smithi123.stdout: "pid": "46921", 2024-04-17T05:27:37.638 INFO:teuthology.orchestra.run.smithi123.stdout: "root": "/" 2024-04-17T05:27:37.638 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-04-17T05:27:37.638 INFO:teuthology.orchestra.run.smithi123.stdout: "dentry_count": 0, 2024-04-17T05:27:37.638 INFO:teuthology.orchestra.run.smithi123.stdout: "dentry_pinned_count": 0, 2024-04-17T05:27:37.639 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 4815, 2024-04-17T05:27:37.639 INFO:teuthology.orchestra.run.smithi123.stdout: "inst": { 2024-04-17T05:27:37.639 INFO:teuthology.orchestra.run.smithi123.stdout: "name": { 2024-04-17T05:27:37.639 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "client", 2024-04-17T05:27:37.639 INFO:teuthology.orchestra.run.smithi123.stdout: "num": 4815 2024-04-17T05:27:37.639 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-04-17T05:27:37.639 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": { 2024-04-17T05:27:37.639 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-04-17T05:27:37.639 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "192.168.0.1:0", 2024-04-17T05:27:37.639 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 1922851698 2024-04-17T05:27:37.639 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-04-17T05:27:37.639 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-04-17T05:27:37.639 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": { 2024-04-17T05:27:37.639 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-04-17T05:27:37.639 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "192.168.0.1:0", 2024-04-17T05:27:37.640 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 1922851698 2024-04-17T05:27:37.640 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-04-17T05:27:37.640 INFO:teuthology.orchestra.run.smithi123.stdout: "inst_str": "client.4815 192.168.0.1:0/1922851698", 2024-04-17T05:27:37.640 INFO:teuthology.orchestra.run.smithi123.stdout: "addr_str": "192.168.0.1:0/1922851698", 2024-04-17T05:27:37.640 INFO:teuthology.orchestra.run.smithi123.stdout: "inode_count": 1, 2024-04-17T05:27:37.640 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_epoch": 9, 2024-04-17T05:27:37.640 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_epoch": 26, 2024-04-17T05:27:37.640 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_epoch_barrier": 0, 2024-04-17T05:27:37.640 INFO:teuthology.orchestra.run.smithi123.stdout: "blocklisted": false, 2024-04-17T05:27:37.640 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs" 2024-04-17T05:27:37.640 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-04-17T05:27:37.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T05:27:37.653 DEBUG:teuthology.orchestra.run.smithi123:> stat --file-system '--printf=%T 2024-04-17T05:27:37.653 DEBUG:teuthology.orchestra.run.smithi123:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-17T05:27:37.707 INFO:teuthology.orchestra.run.smithi123.stdout:fuseblk 2024-04-17T05:27:37.707 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-17T05:27:37.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T05:27:37.708 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-17T05:27:37.786 INFO:teuthology.run_tasks:Running task workunit... 2024-04-17T05:27:37.803 INFO:tasks.workunit:Pulling workunits from ref a8c84f5997950fd7d008204839253291d52e6eda 2024-04-17T05:27:37.803 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-17T05:27:37.803 INFO:tasks.workunit:timeout=3h 2024-04-17T05:27:37.803 INFO:tasks.workunit:cleanup=True 2024-04-17T05:27:37.803 DEBUG:teuthology.orchestra.run.smithi123:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-17T05:27:37.858 INFO:teuthology.orchestra.run.smithi123.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-17T05:27:37.859 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-17T05:27:37.859 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 2ah/42d Inode: 1 Links: 2 2024-04-17T05:27:37.859 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T05:27:37.859 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-17T05:27:37.859 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-17T05:27:37.859 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-04-17 05:26:53.218244947 +0000 2024-04-17T05:27:37.859 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-04-17 05:27:05.221586518 +0000 2024-04-17T05:27:37.859 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2024-04-17T05:27:37.859 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-17T05:27:37.859 DEBUG:teuthology.orchestra.run.smithi123:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-17T05:27:37.971 DEBUG:teuthology.orchestra.run.smithi123:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout a8c84f5997950fd7d008204839253291d52e6eda 2024-04-17T05:27:38.029 INFO:tasks.workunit.client.0.smithi123.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-17T05:27:45.602 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:27:45.610 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:28:15.739 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:28:15.747 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:28:45.895 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:28:45.901 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:29:02.799 INFO:tasks.workunit.client.0.smithi123.stderr:Updating files: 62% (7712/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-17T05:29:03.743 INFO:tasks.workunit.client.0.smithi123.stderr:Note: switching to 'a8c84f5997950fd7d008204839253291d52e6eda'. 2024-04-17T05:29:03.743 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-04-17T05:29:03.743 INFO:tasks.workunit.client.0.smithi123.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-17T05:29:03.743 INFO:tasks.workunit.client.0.smithi123.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-17T05:29:03.743 INFO:tasks.workunit.client.0.smithi123.stderr:state without impacting any branches by switching back to a branch. 2024-04-17T05:29:03.743 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-04-17T05:29:03.743 INFO:tasks.workunit.client.0.smithi123.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-17T05:29:03.743 INFO:tasks.workunit.client.0.smithi123.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-17T05:29:03.743 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-04-17T05:29:03.744 INFO:tasks.workunit.client.0.smithi123.stderr: git switch -c 2024-04-17T05:29:03.744 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-04-17T05:29:03.744 INFO:tasks.workunit.client.0.smithi123.stderr:Or undo this operation with: 2024-04-17T05:29:03.744 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-04-17T05:29:03.744 INFO:tasks.workunit.client.0.smithi123.stderr: git switch - 2024-04-17T05:29:03.744 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-04-17T05:29:03.744 INFO:tasks.workunit.client.0.smithi123.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-17T05:29:03.744 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-04-17T05:29:03.744 INFO:tasks.workunit.client.0.smithi123.stderr:HEAD is now at a8c84f59979 Merge PR #51659 into wip-rishabh-testing-20240416.193735 2024-04-17T05:29:03.756 DEBUG:teuthology.orchestra.run.smithi123:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-17T05:29:03.812 INFO:tasks.workunit.client.0.smithi123.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-17T05:29:03.818 INFO:tasks.workunit.client.0.smithi123.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-17T05:29:03.818 INFO:tasks.workunit.client.0.smithi123.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-17T05:29:04.670 INFO:tasks.workunit.client.0.smithi123.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-17T05:29:04.774 INFO:tasks.workunit.client.0.smithi123.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-17T05:29:04.858 INFO:tasks.workunit.client.0.smithi123.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-17T05:29:04.864 INFO:tasks.workunit.client.0.smithi123.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-17T05:29:04.864 INFO:tasks.workunit.client.0.smithi123.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-17T05:29:04.941 INFO:tasks.workunit.client.0.smithi123.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-17T05:29:04.950 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-17T05:29:04.950 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-17T05:29:04.996 INFO:tasks.workunit:Running workunits matching fs/misc/acl.sh on client.0... 2024-04-17T05:29:04.997 INFO:tasks.workunit:Running workunit fs/misc/acl.sh... 2024-04-17T05:29:04.998 DEBUG:teuthology.orchestra.run.smithi123:workunit test fs/misc/acl.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c84f5997950fd7d008204839253291d52e6eda TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/acl.sh 2024-04-17T05:29:05.134 INFO:tasks.workunit.client.0.smithi123.stderr:+ set -e 2024-04-17T05:29:05.134 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir -p testdir 2024-04-17T05:29:05.143 INFO:tasks.workunit.client.0.smithi123.stderr:+ cd testdir 2024-04-17T05:29:05.148 INFO:tasks.workunit.client.0.smithi123.stderr:+ set +e 2024-04-17T05:29:05.148 INFO:tasks.workunit.client.0.smithi123.stderr:+ setfacl -d -m u:nobody:rw . 2024-04-17T05:29:05.157 INFO:tasks.workunit.client.0.smithi123.stderr:+ test 0 '!=' 0 2024-04-17T05:29:05.157 INFO:tasks.workunit.client.0.smithi123.stderr:+ set -e 2024-04-17T05:29:05.157 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=0 2024-04-17T05:29:05.157 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 0 -lt 100 ']' 2024-04-17T05:29:05.158 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 0 + 1 2024-04-17T05:29:05.161 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=1 2024-04-17T05:29:05.161 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:05.169 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:05.169 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:05.176 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:05.177 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:05.178 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:07.164 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:07.165 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:07.386 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:07.386 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:07.411 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:07.412 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:07.412 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 1 -lt 100 ']' 2024-04-17T05:29:07.413 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 1 + 1 2024-04-17T05:29:07.445 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=2 2024-04-17T05:29:07.445 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:07.467 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:07.467 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:07.473 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:07.475 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:07.475 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:07.966 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:07.966 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:08.089 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:08.089 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:08.111 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:08.111 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:08.111 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -lt 100 ']' 2024-04-17T05:29:08.112 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 2 + 1 2024-04-17T05:29:08.145 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=3 2024-04-17T05:29:08.145 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:08.164 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:08.164 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:08.171 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:08.172 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:08.173 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:08.632 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:08.632 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:08.781 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:08.781 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:08.806 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:08.806 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:08.806 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 3 -lt 100 ']' 2024-04-17T05:29:08.807 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 3 + 1 2024-04-17T05:29:08.837 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=4 2024-04-17T05:29:08.837 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:08.857 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:08.858 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:08.862 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:08.863 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:08.864 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:09.357 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:09.357 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:09.513 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:09.513 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:09.539 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:09.539 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:09.539 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 4 -lt 100 ']' 2024-04-17T05:29:09.540 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 4 + 1 2024-04-17T05:29:09.570 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=5 2024-04-17T05:29:09.570 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:09.589 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:09.590 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:09.596 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:09.597 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:09.597 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:10.065 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:10.066 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:10.230 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:10.230 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:10.257 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:10.257 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:10.257 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 5 -lt 100 ']' 2024-04-17T05:29:10.258 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 5 + 1 2024-04-17T05:29:10.286 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=6 2024-04-17T05:29:10.286 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:10.306 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:10.307 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:10.312 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:10.313 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:10.314 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:10.819 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:10.819 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:10.971 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:10.971 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:10.997 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:10.997 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:10.997 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 6 -lt 100 ']' 2024-04-17T05:29:10.998 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 6 + 1 2024-04-17T05:29:11.028 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=7 2024-04-17T05:29:11.028 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:11.051 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:11.051 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:11.058 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:11.059 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:11.060 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:11.536 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:11.537 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:11.696 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:11.697 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:11.723 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:11.723 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:11.724 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 7 -lt 100 ']' 2024-04-17T05:29:11.725 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 7 + 1 2024-04-17T05:29:11.761 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=8 2024-04-17T05:29:11.761 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:11.785 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:11.785 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:11.792 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:11.793 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:11.794 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:12.287 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:12.287 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:12.456 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:12.456 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:12.476 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:12.477 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:12.477 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 8 -lt 100 ']' 2024-04-17T05:29:12.478 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 8 + 1 2024-04-17T05:29:12.508 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=9 2024-04-17T05:29:12.508 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:12.532 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:12.533 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:12.539 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:12.541 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:12.541 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:13.072 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:13.072 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:13.238 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:13.238 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:13.260 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:13.260 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:13.260 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 9 -lt 100 ']' 2024-04-17T05:29:13.262 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 9 + 1 2024-04-17T05:29:13.294 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=10 2024-04-17T05:29:13.294 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:13.333 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:13.333 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:13.340 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:13.341 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:13.342 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:13.863 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:13.864 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:14.021 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:14.021 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:14.052 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:14.052 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:14.052 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 10 -lt 100 ']' 2024-04-17T05:29:14.053 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 10 + 1 2024-04-17T05:29:14.086 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=11 2024-04-17T05:29:14.086 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:14.107 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:14.107 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:14.115 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:14.116 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:14.117 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:14.621 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:14.622 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:14.795 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:14.795 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:14.818 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:14.818 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:14.819 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 11 -lt 100 ']' 2024-04-17T05:29:14.820 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 11 + 1 2024-04-17T05:29:14.861 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=12 2024-04-17T05:29:14.861 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:14.882 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:14.883 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:14.889 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:14.891 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:14.892 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:15.438 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:15.438 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:15.596 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:15.596 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:15.617 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:15.617 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:15.617 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 12 -lt 100 ']' 2024-04-17T05:29:15.619 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 12 + 1 2024-04-17T05:29:15.652 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=13 2024-04-17T05:29:15.652 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:15.674 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:15.675 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:15.682 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:15.683 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:15.684 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:16.035 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:29:16.046 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:29:16.287 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:16.288 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:16.399 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:16.399 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:16.417 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:16.418 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:16.418 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 13 -lt 100 ']' 2024-04-17T05:29:16.419 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 13 + 1 2024-04-17T05:29:16.468 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=14 2024-04-17T05:29:16.468 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:16.502 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:16.502 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:16.508 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:16.509 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:16.509 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:17.071 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:17.071 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:17.203 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:17.203 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:17.227 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:17.227 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:17.227 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 14 -lt 100 ']' 2024-04-17T05:29:17.228 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 14 + 1 2024-04-17T05:29:17.260 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=15 2024-04-17T05:29:17.260 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:17.280 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:17.281 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:17.286 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:17.287 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:17.287 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:17.794 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:17.795 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:17.954 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:17.954 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:17.976 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:17.977 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:17.977 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 15 -lt 100 ']' 2024-04-17T05:29:17.978 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 15 + 1 2024-04-17T05:29:18.010 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=16 2024-04-17T05:29:18.010 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:18.032 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:18.032 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:18.039 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:18.040 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:18.041 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:18.585 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:18.586 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:18.737 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:18.737 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:18.759 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:18.759 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:18.759 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 16 -lt 100 ']' 2024-04-17T05:29:18.760 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 16 + 1 2024-04-17T05:29:18.793 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=17 2024-04-17T05:29:18.794 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:18.814 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:18.815 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:18.822 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:18.823 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:18.823 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:19.369 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:19.370 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:19.544 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:19.544 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:19.568 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:19.568 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:19.568 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 17 -lt 100 ']' 2024-04-17T05:29:19.569 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 17 + 1 2024-04-17T05:29:19.610 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=18 2024-04-17T05:29:19.610 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:19.631 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:19.632 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:19.638 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:19.639 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:19.640 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:20.161 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:20.162 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:20.329 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:20.329 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:20.350 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:20.350 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:20.351 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 18 -lt 100 ']' 2024-04-17T05:29:20.352 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 18 + 1 2024-04-17T05:29:20.401 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=19 2024-04-17T05:29:20.402 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:20.423 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:20.424 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:20.430 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:20.431 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:20.432 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:21.013 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:21.013 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:21.187 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:21.187 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:21.208 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:21.209 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:21.209 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 19 -lt 100 ']' 2024-04-17T05:29:21.210 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 19 + 1 2024-04-17T05:29:21.243 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=20 2024-04-17T05:29:21.243 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:21.265 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:21.265 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:21.270 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:21.271 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:21.272 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:21.845 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:21.846 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:22.003 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:22.003 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:22.026 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:22.026 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:22.026 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 20 -lt 100 ']' 2024-04-17T05:29:22.027 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 20 + 1 2024-04-17T05:29:22.068 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=21 2024-04-17T05:29:22.068 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:22.090 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:22.090 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:22.095 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:22.096 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:22.096 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:22.629 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:22.629 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:22.795 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:22.795 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:22.817 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:22.817 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:22.817 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 21 -lt 100 ']' 2024-04-17T05:29:22.818 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 21 + 1 2024-04-17T05:29:22.851 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=22 2024-04-17T05:29:22.851 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:22.872 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:22.872 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:22.878 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:22.879 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:22.880 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:23.420 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:23.420 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:23.577 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:23.577 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:23.599 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:23.599 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:23.599 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 22 -lt 100 ']' 2024-04-17T05:29:23.600 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 22 + 1 2024-04-17T05:29:23.634 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=23 2024-04-17T05:29:23.634 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:23.655 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:23.656 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:23.662 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:23.664 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:23.664 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:24.237 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:24.237 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:24.403 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:24.403 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:24.425 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:24.425 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:24.425 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 23 -lt 100 ']' 2024-04-17T05:29:24.426 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 23 + 1 2024-04-17T05:29:24.459 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=24 2024-04-17T05:29:24.459 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:24.479 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:24.480 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:24.485 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:24.486 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:24.487 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:25.086 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:25.086 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:25.261 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:25.261 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:25.284 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:25.284 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:25.284 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 24 -lt 100 ']' 2024-04-17T05:29:25.285 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 24 + 1 2024-04-17T05:29:25.325 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=25 2024-04-17T05:29:25.325 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:25.346 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:25.348 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:25.354 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:25.355 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:25.356 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:25.969 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:25.970 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:26.153 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:26.153 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:26.182 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:26.182 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:26.182 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 25 -lt 100 ']' 2024-04-17T05:29:26.183 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 25 + 1 2024-04-17T05:29:26.217 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=26 2024-04-17T05:29:26.217 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:26.242 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:26.242 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:26.249 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:26.249 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:26.250 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:27.128 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:27.128 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:27.302 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:27.302 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:27.332 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:27.333 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:27.333 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 26 -lt 100 ']' 2024-04-17T05:29:27.333 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 26 + 1 2024-04-17T05:29:27.367 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=27 2024-04-17T05:29:27.367 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:27.390 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:27.390 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:27.396 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:27.396 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:27.397 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:27.935 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:27.935 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:28.093 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:28.093 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:28.116 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:28.116 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:28.116 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 27 -lt 100 ']' 2024-04-17T05:29:28.117 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 27 + 1 2024-04-17T05:29:28.158 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=28 2024-04-17T05:29:28.158 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:28.180 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:28.181 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:28.187 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:28.188 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:28.189 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:28.842 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:28.843 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:28.994 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:28.994 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:29.016 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:29.016 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:29.016 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 28 -lt 100 ']' 2024-04-17T05:29:29.017 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 28 + 1 2024-04-17T05:29:29.050 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=29 2024-04-17T05:29:29.050 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:29.072 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:29.072 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:29.078 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:29.079 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:29.079 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:29.668 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:29.669 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:29.817 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:29.818 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:29.841 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:29.841 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:29.841 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 29 -lt 100 ']' 2024-04-17T05:29:29.842 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 29 + 1 2024-04-17T05:29:29.875 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=30 2024-04-17T05:29:29.875 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:29.896 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:29.897 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:29.904 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:29.905 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:29.907 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:30.450 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:30.451 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:30.617 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:30.617 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:30.648 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:30.648 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:30.648 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 30 -lt 100 ']' 2024-04-17T05:29:30.649 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 30 + 1 2024-04-17T05:29:30.683 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=31 2024-04-17T05:29:30.683 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:30.704 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:30.705 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:30.712 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:30.713 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:30.714 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:32.235 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:32.236 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:32.468 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:32.468 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:32.507 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:32.507 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:32.507 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 31 -lt 100 ']' 2024-04-17T05:29:32.508 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 31 + 1 2024-04-17T05:29:32.542 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=32 2024-04-17T05:29:32.542 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:32.574 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:32.574 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:32.581 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:32.582 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:32.583 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:33.293 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:33.293 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:33.510 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:33.510 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:33.533 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:33.533 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:33.533 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 32 -lt 100 ']' 2024-04-17T05:29:33.534 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 32 + 1 2024-04-17T05:29:33.582 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=33 2024-04-17T05:29:33.582 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:34.126 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:34.126 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:34.133 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:34.134 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:34.135 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:34.709 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:34.710 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:34.893 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:34.893 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:34.924 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:34.924 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:34.924 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 33 -lt 100 ']' 2024-04-17T05:29:34.926 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 33 + 1 2024-04-17T05:29:34.957 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=34 2024-04-17T05:29:34.957 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:34.979 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:34.980 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:34.986 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:34.986 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:34.987 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:35.516 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:35.518 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:35.693 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:35.693 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:35.714 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:35.714 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:35.714 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 34 -lt 100 ']' 2024-04-17T05:29:35.715 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 34 + 1 2024-04-17T05:29:35.749 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=35 2024-04-17T05:29:35.749 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:35.771 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:35.771 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:35.778 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:35.779 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:35.780 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:36.266 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:36.267 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:36.459 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:36.459 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:36.481 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:36.481 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:36.481 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 35 -lt 100 ']' 2024-04-17T05:29:36.483 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 35 + 1 2024-04-17T05:29:36.515 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=36 2024-04-17T05:29:36.515 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:36.537 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:36.538 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:36.545 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:36.547 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:36.548 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:37.006 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:37.007 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:37.167 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:37.167 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:37.198 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:37.198 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:37.198 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 36 -lt 100 ']' 2024-04-17T05:29:37.200 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 36 + 1 2024-04-17T05:29:37.232 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=37 2024-04-17T05:29:37.232 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:37.254 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:37.254 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:37.260 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:37.261 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:37.262 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:37.733 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:37.734 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:37.901 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:37.901 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:37.923 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:37.923 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:37.923 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 37 -lt 100 ']' 2024-04-17T05:29:37.924 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 37 + 1 2024-04-17T05:29:37.965 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=38 2024-04-17T05:29:37.965 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:37.987 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:37.987 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:37.993 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:37.994 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:37.995 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:38.493 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:38.493 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:38.659 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:38.659 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:38.689 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:38.689 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:38.689 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 38 -lt 100 ']' 2024-04-17T05:29:38.690 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 38 + 1 2024-04-17T05:29:38.723 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=39 2024-04-17T05:29:38.723 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:38.745 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:38.745 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:38.752 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:38.753 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:38.753 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:39.219 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:39.219 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:39.399 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:39.399 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:39.423 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:39.423 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:39.423 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 39 -lt 100 ']' 2024-04-17T05:29:39.424 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 39 + 1 2024-04-17T05:29:39.456 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=40 2024-04-17T05:29:39.456 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:39.478 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:39.479 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:39.485 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:39.486 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:39.487 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:39.933 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:39.933 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:40.124 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:40.124 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:40.147 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:40.147 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:40.147 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 40 -lt 100 ']' 2024-04-17T05:29:40.149 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 40 + 1 2024-04-17T05:29:40.181 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=41 2024-04-17T05:29:40.181 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:40.204 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:40.205 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:40.211 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:40.212 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:40.213 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:40.708 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:40.709 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:40.876 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:40.876 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:40.897 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:40.897 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:40.897 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 41 -lt 100 ']' 2024-04-17T05:29:40.898 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 41 + 1 2024-04-17T05:29:40.931 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=42 2024-04-17T05:29:40.931 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:40.954 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:40.955 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:40.961 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:40.962 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:40.964 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:41.458 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:41.459 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:41.617 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:41.617 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:41.647 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:41.648 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:41.648 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 42 -lt 100 ']' 2024-04-17T05:29:41.649 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 42 + 1 2024-04-17T05:29:41.681 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=43 2024-04-17T05:29:41.681 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:41.703 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:41.703 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:41.710 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:41.711 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:41.712 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:42.234 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:42.234 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:42.409 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:42.409 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:42.431 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:42.431 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:42.431 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 43 -lt 100 ']' 2024-04-17T05:29:42.432 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 43 + 1 2024-04-17T05:29:42.464 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=44 2024-04-17T05:29:42.464 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:42.487 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:42.487 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:42.493 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:42.495 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:42.495 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:42.974 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:42.974 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:43.142 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:43.142 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:43.180 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:43.180 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:43.180 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 44 -lt 100 ']' 2024-04-17T05:29:43.182 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 44 + 1 2024-04-17T05:29:43.214 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=45 2024-04-17T05:29:43.214 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:43.235 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:43.236 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:43.242 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:43.243 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:43.244 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:43.733 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:43.733 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:43.883 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:43.884 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:43.905 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:43.905 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:43.906 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 45 -lt 100 ']' 2024-04-17T05:29:43.906 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 45 + 1 2024-04-17T05:29:43.939 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=46 2024-04-17T05:29:43.939 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:43.961 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:43.961 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:43.968 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:43.969 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:43.970 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:44.465 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:44.466 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:44.666 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:44.667 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:44.697 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:44.697 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:44.697 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 46 -lt 100 ']' 2024-04-17T05:29:44.698 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 46 + 1 2024-04-17T05:29:44.730 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=47 2024-04-17T05:29:44.730 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:44.752 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:44.752 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:44.758 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:44.760 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:44.761 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:45.232 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:45.232 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:45.399 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:45.399 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:45.422 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:45.422 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:45.423 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 47 -lt 100 ']' 2024-04-17T05:29:45.423 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 47 + 1 2024-04-17T05:29:45.455 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=48 2024-04-17T05:29:45.455 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:45.477 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:45.478 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:45.483 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:45.485 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:45.485 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:45.948 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:45.949 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:46.133 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:46.133 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:46.166 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:46.166 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:46.166 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 48 -lt 100 ']' 2024-04-17T05:29:46.167 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 48 + 1 2024-04-17T05:29:46.197 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=49 2024-04-17T05:29:46.197 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:46.220 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:46.220 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:46.226 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:46.227 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:46.228 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:46.699 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:46.700 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:46.883 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:46.883 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:46.913 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:46.913 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:46.913 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 49 -lt 100 ']' 2024-04-17T05:29:46.914 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 49 + 1 2024-04-17T05:29:46.955 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=50 2024-04-17T05:29:46.956 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:46.977 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:46.978 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:46.983 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:46.984 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:46.985 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:47.083 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:29:47.091 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:29:47.549 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:47.550 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:47.681 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:47.682 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:47.702 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:47.702 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:47.702 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 50 -lt 100 ']' 2024-04-17T05:29:47.703 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 50 + 1 2024-04-17T05:29:47.806 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=51 2024-04-17T05:29:47.806 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:47.822 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:47.822 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:47.827 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:47.828 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:47.829 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:48.216 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:48.216 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:48.415 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:48.416 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:48.446 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:48.447 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:48.447 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 51 -lt 100 ']' 2024-04-17T05:29:48.448 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 51 + 1 2024-04-17T05:29:48.480 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=52 2024-04-17T05:29:48.480 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:48.500 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:48.501 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:48.508 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:48.509 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:48.509 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:49.015 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:49.016 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:49.191 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:49.191 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:49.222 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:49.222 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:49.222 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 52 -lt 100 ']' 2024-04-17T05:29:49.223 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 52 + 1 2024-04-17T05:29:49.264 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=53 2024-04-17T05:29:49.264 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:49.286 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:49.287 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:49.292 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:49.292 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:49.293 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:49.773 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:49.773 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:49.931 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:49.931 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:49.964 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:49.964 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:49.964 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 53 -lt 100 ']' 2024-04-17T05:29:49.965 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 53 + 1 2024-04-17T05:29:49.997 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=54 2024-04-17T05:29:49.997 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:50.026 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:50.026 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:50.032 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:50.033 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:50.034 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:50.564 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:50.565 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:50.732 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:50.732 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:50.761 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:50.761 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:50.761 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 54 -lt 100 ']' 2024-04-17T05:29:50.762 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 54 + 1 2024-04-17T05:29:50.788 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=55 2024-04-17T05:29:50.788 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:50.812 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:50.813 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:50.819 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:50.820 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:50.821 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:51.272 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:51.273 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:51.439 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:51.439 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:51.463 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:51.463 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:51.463 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 55 -lt 100 ']' 2024-04-17T05:29:51.464 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 55 + 1 2024-04-17T05:29:51.496 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=56 2024-04-17T05:29:51.496 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:51.517 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:51.518 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:51.524 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:51.525 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:51.525 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:51.964 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:51.965 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:52.148 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:52.149 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:52.170 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:52.170 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:52.170 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 56 -lt 100 ']' 2024-04-17T05:29:52.171 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 56 + 1 2024-04-17T05:29:52.205 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=57 2024-04-17T05:29:52.205 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:52.228 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:52.229 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:52.234 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:52.235 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:52.235 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:52.707 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:52.707 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:52.873 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:52.873 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:52.904 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:52.904 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:52.904 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 57 -lt 100 ']' 2024-04-17T05:29:52.905 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 57 + 1 2024-04-17T05:29:52.938 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=58 2024-04-17T05:29:52.938 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:52.959 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:52.959 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:52.966 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:52.967 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:52.968 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:53.439 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:53.439 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:53.615 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:53.615 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:53.636 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:53.636 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:53.636 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 58 -lt 100 ']' 2024-04-17T05:29:53.638 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 58 + 1 2024-04-17T05:29:53.670 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=59 2024-04-17T05:29:53.671 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:53.692 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:53.692 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:53.698 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:53.700 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:53.701 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:54.289 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:54.290 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:54.455 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:54.455 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:54.480 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:54.480 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:54.480 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 59 -lt 100 ']' 2024-04-17T05:29:54.480 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 59 + 1 2024-04-17T05:29:54.520 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=60 2024-04-17T05:29:54.521 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:54.541 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:54.542 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:54.547 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:54.548 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:54.549 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:55.073 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:55.073 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:55.248 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:55.248 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:55.287 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:55.287 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:55.287 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 60 -lt 100 ']' 2024-04-17T05:29:55.288 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 60 + 1 2024-04-17T05:29:55.329 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=61 2024-04-17T05:29:55.329 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:55.358 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:55.359 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:55.365 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:55.366 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:55.366 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:55.863 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:55.863 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:56.039 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:56.039 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:56.071 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:56.071 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:56.071 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 61 -lt 100 ']' 2024-04-17T05:29:56.072 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 61 + 1 2024-04-17T05:29:56.113 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=62 2024-04-17T05:29:56.113 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:56.134 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:56.134 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:56.140 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:56.142 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:56.143 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:56.621 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:56.621 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:56.788 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:56.788 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:56.820 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:56.820 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:56.820 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 62 -lt 100 ']' 2024-04-17T05:29:56.822 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 62 + 1 2024-04-17T05:29:56.854 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=63 2024-04-17T05:29:56.854 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:56.876 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:56.876 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:56.882 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:56.883 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:56.883 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:57.388 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:57.388 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:57.612 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:57.612 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:57.646 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:57.646 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:57.646 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 63 -lt 100 ']' 2024-04-17T05:29:57.647 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 63 + 1 2024-04-17T05:29:57.687 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=64 2024-04-17T05:29:57.687 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:57.708 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:57.708 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:57.715 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:57.716 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:57.716 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:58.230 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:58.231 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:58.398 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:58.398 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:58.428 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:58.428 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:58.428 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 64 -lt 100 ']' 2024-04-17T05:29:58.429 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 64 + 1 2024-04-17T05:29:58.462 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=65 2024-04-17T05:29:58.462 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:58.484 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:58.484 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:58.491 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:58.492 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:58.493 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:58.932 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:58.933 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:59.080 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:59.080 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:59.111 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:59.111 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:59.111 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 65 -lt 100 ']' 2024-04-17T05:29:59.112 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 65 + 1 2024-04-17T05:29:59.145 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=66 2024-04-17T05:29:59.145 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:29:59.175 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:59.175 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:59.180 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:29:59.181 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:29:59.181 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:29:59.654 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:29:59.655 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:29:59.837 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:29:59.837 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:29:59.870 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:59.870 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:29:59.870 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 66 -lt 100 ']' 2024-04-17T05:29:59.871 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 66 + 1 2024-04-17T05:30:00.011 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=67 2024-04-17T05:30:00.012 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:00.033 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:00.034 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:00.040 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:30:00.041 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:30:00.041 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:30:00.573 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:00.573 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:00.738 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:30:00.738 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:00.768 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:00.768 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:00.768 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 67 -lt 100 ']' 2024-04-17T05:30:00.769 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 67 + 1 2024-04-17T05:30:00.795 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=68 2024-04-17T05:30:00.795 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:00.815 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:00.816 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:00.822 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:30:00.823 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:30:00.824 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:30:01.315 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:01.316 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:01.512 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:30:01.512 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:01.545 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:01.545 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:01.545 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 68 -lt 100 ']' 2024-04-17T05:30:01.546 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 68 + 1 2024-04-17T05:30:01.578 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=69 2024-04-17T05:30:01.578 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:01.600 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:01.601 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:01.606 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:30:01.608 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:30:01.609 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:30:02.065 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:02.066 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:02.229 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:30:02.229 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:02.252 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:02.252 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:02.252 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 69 -lt 100 ']' 2024-04-17T05:30:02.253 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 69 + 1 2024-04-17T05:30:02.286 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=70 2024-04-17T05:30:02.286 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:02.308 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:02.308 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:02.314 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:30:02.315 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:30:02.316 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:30:02.790 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:02.790 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:02.929 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:30:02.929 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:02.960 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:02.960 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:02.960 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 70 -lt 100 ']' 2024-04-17T05:30:02.961 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 70 + 1 2024-04-17T05:30:02.994 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=71 2024-04-17T05:30:02.994 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:03.015 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:03.017 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:03.022 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:30:03.023 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:30:03.024 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:30:03.438 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:03.438 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:03.612 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:30:03.612 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:03.644 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:03.644 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:03.644 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 71 -lt 100 ']' 2024-04-17T05:30:03.645 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 71 + 1 2024-04-17T05:30:03.678 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=72 2024-04-17T05:30:03.678 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:03.700 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:03.700 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:03.706 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:30:03.707 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:30:03.708 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:30:04.164 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:04.165 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:04.320 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:30:04.320 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:04.343 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:04.343 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:04.343 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 72 -lt 100 ']' 2024-04-17T05:30:04.344 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 72 + 1 2024-04-17T05:30:04.377 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=73 2024-04-17T05:30:04.377 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:04.399 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:04.399 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:04.405 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:30:04.406 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:30:04.407 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:30:04.848 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:04.848 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:05.004 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:30:05.005 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:05.036 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:05.036 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:05.036 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 73 -lt 100 ']' 2024-04-17T05:30:05.038 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 73 + 1 2024-04-17T05:30:05.069 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=74 2024-04-17T05:30:05.069 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:05.091 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:05.092 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:05.098 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:30:05.098 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:30:05.099 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:30:05.514 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:05.515 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:05.670 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:30:05.670 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:05.701 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:05.701 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:05.701 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 74 -lt 100 ']' 2024-04-17T05:30:05.702 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 74 + 1 2024-04-17T05:30:05.736 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=75 2024-04-17T05:30:05.736 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:05.760 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:05.761 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:05.767 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:30:05.769 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:30:05.770 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:30:06.239 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:06.240 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:06.404 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:30:06.405 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:06.435 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:06.435 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:06.435 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 75 -lt 100 ']' 2024-04-17T05:30:06.437 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 75 + 1 2024-04-17T05:30:06.469 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=76 2024-04-17T05:30:06.469 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:06.490 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:06.491 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:06.496 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:30:06.498 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:30:06.498 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:30:06.971 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:06.971 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:07.146 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:30:07.146 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:07.179 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:07.179 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:07.179 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 76 -lt 100 ']' 2024-04-17T05:30:07.180 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 76 + 1 2024-04-17T05:30:07.210 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=77 2024-04-17T05:30:07.210 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:07.234 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:07.234 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:07.241 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:30:07.243 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:30:07.244 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:30:07.689 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:07.689 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:07.843 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:30:07.844 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:07.868 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:07.869 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:07.869 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 77 -lt 100 ']' 2024-04-17T05:30:07.870 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 77 + 1 2024-04-17T05:30:07.901 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=78 2024-04-17T05:30:07.902 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:07.924 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:07.925 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:07.931 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:30:07.932 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:30:07.934 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:30:08.366 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:08.366 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:08.546 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:30:08.546 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:08.575 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:08.575 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:08.576 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 78 -lt 100 ']' 2024-04-17T05:30:08.577 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 78 + 1 2024-04-17T05:30:08.610 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=79 2024-04-17T05:30:08.610 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:08.632 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:08.632 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:08.639 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:30:08.640 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:30:08.641 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:30:09.122 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:09.123 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:09.321 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:30:09.321 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:09.343 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:09.343 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:09.343 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 79 -lt 100 ']' 2024-04-17T05:30:09.345 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 79 + 1 2024-04-17T05:30:09.377 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=80 2024-04-17T05:30:09.377 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:09.398 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:09.398 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:09.404 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:30:09.405 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:30:09.406 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:30:09.856 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:09.857 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:10.070 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:30:10.071 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:10.101 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:10.101 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:10.102 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 80 -lt 100 ']' 2024-04-17T05:30:10.103 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 80 + 1 2024-04-17T05:30:10.135 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=81 2024-04-17T05:30:10.136 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:10.156 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:10.157 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:10.163 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:30:10.163 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:30:10.164 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:30:10.643 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:10.643 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:10.795 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:30:10.795 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:10.825 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:10.825 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:10.825 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 81 -lt 100 ']' 2024-04-17T05:30:10.826 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 81 + 1 2024-04-17T05:30:10.859 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=82 2024-04-17T05:30:10.860 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:10.890 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:10.890 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:10.897 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:30:10.898 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:30:10.899 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:30:11.427 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:11.428 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:11.587 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:30:11.587 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:11.618 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:11.618 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:11.618 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 82 -lt 100 ']' 2024-04-17T05:30:11.619 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 82 + 1 2024-04-17T05:30:11.653 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=83 2024-04-17T05:30:11.653 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:11.673 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:11.673 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:11.679 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:30:11.680 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:30:11.682 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:30:12.228 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:12.228 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:12.435 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:30:12.435 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:12.459 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:12.459 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:12.460 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 83 -lt 100 ']' 2024-04-17T05:30:12.461 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 83 + 1 2024-04-17T05:30:12.493 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=84 2024-04-17T05:30:12.493 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:12.515 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:12.515 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:12.522 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:30:12.523 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:30:12.524 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:30:13.011 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:13.011 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:13.195 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:30:13.195 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:13.227 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:13.227 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:13.227 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 84 -lt 100 ']' 2024-04-17T05:30:13.229 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 84 + 1 2024-04-17T05:30:13.268 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=85 2024-04-17T05:30:13.268 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:13.290 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:13.291 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:13.296 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:30:13.297 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:30:13.298 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:30:13.827 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:13.828 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:14.003 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:30:14.003 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:14.035 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:14.035 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:14.035 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 85 -lt 100 ']' 2024-04-17T05:30:14.036 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 85 + 1 2024-04-17T05:30:14.068 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=86 2024-04-17T05:30:14.068 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:14.090 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:14.090 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:14.096 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:30:14.097 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:30:14.098 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:30:14.560 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:14.561 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:14.753 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:30:14.753 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:14.784 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:14.784 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:14.784 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 86 -lt 100 ']' 2024-04-17T05:30:14.785 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 86 + 1 2024-04-17T05:30:14.817 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=87 2024-04-17T05:30:14.817 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:14.838 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:14.840 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:14.845 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:30:14.846 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:30:14.847 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:30:15.354 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:15.355 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:15.519 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:30:15.520 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:15.551 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:15.551 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:15.551 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 87 -lt 100 ']' 2024-04-17T05:30:15.552 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 87 + 1 2024-04-17T05:30:15.584 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=88 2024-04-17T05:30:15.584 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:15.605 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:15.605 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:15.611 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:30:15.612 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:30:15.612 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:30:16.051 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:16.051 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:16.235 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:30:16.235 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:16.266 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:16.266 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:16.266 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 88 -lt 100 ']' 2024-04-17T05:30:16.267 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 88 + 1 2024-04-17T05:30:16.317 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=89 2024-04-17T05:30:16.317 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:16.338 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:16.339 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:16.345 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:30:16.346 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:30:16.346 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:30:16.804 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:16.804 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:17.002 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:30:17.002 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:17.034 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:17.034 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:17.034 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 89 -lt 100 ']' 2024-04-17T05:30:17.035 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 89 + 1 2024-04-17T05:30:17.067 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=90 2024-04-17T05:30:17.067 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:17.089 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:17.089 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:17.096 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:30:17.097 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:30:17.098 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:30:17.530 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:17.530 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:17.703 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:30:17.703 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:17.736 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:17.736 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:17.736 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 90 -lt 100 ']' 2024-04-17T05:30:17.737 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 90 + 1 2024-04-17T05:30:17.767 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=91 2024-04-17T05:30:17.767 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:17.789 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:17.790 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:17.796 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:30:17.798 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:30:17.799 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:30:17.804 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:30:17.810 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:30:18.377 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:18.378 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:18.535 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:30:18.535 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:18.566 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:18.566 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:18.566 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 91 -lt 100 ']' 2024-04-17T05:30:18.567 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 91 + 1 2024-04-17T05:30:18.600 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=92 2024-04-17T05:30:18.600 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:18.621 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:18.622 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:18.628 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:30:18.630 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:30:18.630 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:30:19.088 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:19.088 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:19.261 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:30:19.261 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:19.290 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:19.290 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:19.290 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 92 -lt 100 ']' 2024-04-17T05:30:19.291 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 92 + 1 2024-04-17T05:30:19.325 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=93 2024-04-17T05:30:19.325 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:19.346 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:19.346 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:19.352 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:30:19.353 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:30:19.354 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:30:19.871 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:19.872 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:20.067 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:30:20.067 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:20.104 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:20.104 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:20.104 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 93 -lt 100 ']' 2024-04-17T05:30:20.106 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 93 + 1 2024-04-17T05:30:20.133 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=94 2024-04-17T05:30:20.133 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:20.154 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:20.154 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:20.161 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:30:20.162 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:30:20.163 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:30:20.626 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:20.626 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:20.827 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:30:20.827 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:20.860 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:20.860 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:20.860 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 94 -lt 100 ']' 2024-04-17T05:30:20.861 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 94 + 1 2024-04-17T05:30:20.900 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=95 2024-04-17T05:30:20.900 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:20.923 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:20.924 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:20.930 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:30:20.931 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:30:20.932 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:30:21.401 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:21.401 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:21.569 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:30:21.569 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:21.592 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:21.592 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:21.592 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 95 -lt 100 ']' 2024-04-17T05:30:21.593 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 95 + 1 2024-04-17T05:30:21.625 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=96 2024-04-17T05:30:21.625 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:21.646 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:21.646 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:21.653 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:30:21.654 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:30:21.655 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:30:22.159 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:22.160 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:22.333 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:30:22.334 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:22.367 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:22.367 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:22.367 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 96 -lt 100 ']' 2024-04-17T05:30:22.368 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 96 + 1 2024-04-17T05:30:22.408 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=97 2024-04-17T05:30:22.408 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:22.431 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:22.432 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:22.437 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:30:22.440 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:30:22.441 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:30:22.959 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:22.968 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:23.110 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:30:23.110 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:23.142 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:23.142 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:23.143 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 97 -lt 100 ']' 2024-04-17T05:30:23.143 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 97 + 1 2024-04-17T05:30:23.174 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=98 2024-04-17T05:30:23.174 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:23.199 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:23.199 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:23.202 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:30:23.206 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:30:23.206 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:30:23.629 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:23.629 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:23.793 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:30:23.793 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:23.823 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:23.823 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:23.823 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 98 -lt 100 ']' 2024-04-17T05:30:23.825 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 98 + 1 2024-04-17T05:30:23.857 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=99 2024-04-17T05:30:23.858 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:23.880 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:23.880 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:23.886 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:30:23.887 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:30:23.888 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:30:24.387 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:24.387 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:24.552 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:30:24.552 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:24.573 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:24.574 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:24.574 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 99 -lt 100 ']' 2024-04-17T05:30:24.575 INFO:tasks.workunit.client.0.smithi123.stderr:++ expr 99 + 1 2024-04-17T05:30:24.616 INFO:tasks.workunit.client.0.smithi123.stderr:+ c=100 2024-04-17T05:30:24.616 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:24.637 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:24.637 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:24.644 INFO:tasks.workunit.client.0.smithi123.stderr:+ c1=2 2024-04-17T05:30:24.645 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo 3 2024-04-17T05:30:24.646 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-04-17T05:30:25.109 INFO:tasks.workunit.client.0.smithi123.stderr:++ getfacl d1 2024-04-17T05:30:25.109 INFO:tasks.workunit.client.0.smithi123.stderr:++ grep -c nobody:rw 2024-04-17T05:30:25.274 INFO:tasks.workunit.client.0.smithi123.stderr:+ c2=2 2024-04-17T05:30:25.274 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:25.299 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:25.299 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 2 -ne 2 ']' 2024-04-17T05:30:25.299 INFO:tasks.workunit.client.0.smithi123.stderr:+ '[' 100 -lt 100 ']' 2024-04-17T05:30:25.309 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir d1 2024-04-17T05:30:25.335 INFO:tasks.workunit.client.0.smithi123.stderr:+ setfattr -n system.posix_acl_access -v 0x02000000 d1 2024-04-17T05:30:25.357 INFO:tasks.workunit.client.0.smithi123.stderr:+ setfattr -n system.posix_acl_default -v 0x02000000 . 2024-04-17T05:30:25.365 INFO:tasks.workunit.client.0.smithi123.stderr:+ expect_failure getfattr -n system.posix_acl_access d1 2024-04-17T05:30:25.366 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n system.posix_acl_access d1 2024-04-17T05:30:25.377 INFO:tasks.workunit.client.0.smithi123.stderr:d1: system.posix_acl_access: No such attribute 2024-04-17T05:30:25.377 INFO:tasks.workunit.client.0.smithi123.stderr:+ return 0 2024-04-17T05:30:25.377 INFO:tasks.workunit.client.0.smithi123.stderr:+ expect_failure getfattr -n system.posix_acl_default . 2024-04-17T05:30:25.377 INFO:tasks.workunit.client.0.smithi123.stderr:+ getfattr -n system.posix_acl_default . 2024-04-17T05:30:25.381 INFO:tasks.workunit.client.0.smithi123.stderr:.: system.posix_acl_default: No such attribute 2024-04-17T05:30:25.382 INFO:tasks.workunit.client.0.smithi123.stderr:+ return 0 2024-04-17T05:30:25.382 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir d1 2024-04-17T05:30:25.420 INFO:tasks.workunit.client.0.smithi123.stderr:+ cd .. 2024-04-17T05:30:25.430 INFO:tasks.workunit.client.0.smithi123.stderr:+ rmdir testdir 2024-04-17T05:30:25.448 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo OK 2024-04-17T05:30:25.449 INFO:tasks.workunit.client.0.smithi123.stdout:OK 2024-04-17T05:30:25.450 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-17T05:30:25.451 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-17T05:30:26.096 INFO:tasks.workunit:Stopping ['fs/misc/acl.sh'] on client.0... 2024-04-17T05:30:26.096 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-17T05:30:28.194 DEBUG:teuthology.parallel:result is None 2024-04-17T05:30:28.195 DEBUG:teuthology.orchestra.run.smithi123:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout a8c84f5997950fd7d008204839253291d52e6eda 2024-04-17T05:30:28.333 INFO:tasks.workunit.client.0.smithi123.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-17T05:30:48.378 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:30:48.388 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:31:18.561 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:31:18.570 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:31:48.734 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:31:48.740 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:32:08.427 INFO:tasks.workunit.client.0.smithi123.stderr:Updating files: 62% (7726/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-17T05:32:09.208 INFO:tasks.workunit.client.0.smithi123.stderr:Note: switching to 'a8c84f5997950fd7d008204839253291d52e6eda'. 2024-04-17T05:32:09.209 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-04-17T05:32:09.209 INFO:tasks.workunit.client.0.smithi123.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-17T05:32:09.209 INFO:tasks.workunit.client.0.smithi123.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-17T05:32:09.209 INFO:tasks.workunit.client.0.smithi123.stderr:state without impacting any branches by switching back to a branch. 2024-04-17T05:32:09.209 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-04-17T05:32:09.209 INFO:tasks.workunit.client.0.smithi123.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-17T05:32:09.209 INFO:tasks.workunit.client.0.smithi123.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-17T05:32:09.209 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-04-17T05:32:09.209 INFO:tasks.workunit.client.0.smithi123.stderr: git switch -c 2024-04-17T05:32:09.210 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-04-17T05:32:09.210 INFO:tasks.workunit.client.0.smithi123.stderr:Or undo this operation with: 2024-04-17T05:32:09.210 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-04-17T05:32:09.210 INFO:tasks.workunit.client.0.smithi123.stderr: git switch - 2024-04-17T05:32:09.210 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-04-17T05:32:09.210 INFO:tasks.workunit.client.0.smithi123.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-17T05:32:09.210 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-04-17T05:32:09.210 INFO:tasks.workunit.client.0.smithi123.stderr:HEAD is now at a8c84f59979 Merge PR #51659 into wip-rishabh-testing-20240416.193735 2024-04-17T05:32:09.222 DEBUG:teuthology.orchestra.run.smithi123:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-17T05:32:09.282 INFO:tasks.workunit.client.0.smithi123.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-17T05:32:09.288 INFO:tasks.workunit.client.0.smithi123.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-17T05:32:09.288 INFO:tasks.workunit.client.0.smithi123.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-17T05:32:10.338 INFO:tasks.workunit.client.0.smithi123.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-17T05:32:10.449 INFO:tasks.workunit.client.0.smithi123.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-17T05:32:10.529 INFO:tasks.workunit.client.0.smithi123.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-17T05:32:10.534 INFO:tasks.workunit.client.0.smithi123.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-17T05:32:10.534 INFO:tasks.workunit.client.0.smithi123.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-17T05:32:10.613 INFO:tasks.workunit.client.0.smithi123.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-17T05:32:10.626 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-17T05:32:10.626 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-17T05:32:10.742 INFO:tasks.workunit:Running workunits matching fs/misc/chmod.sh on client.0... 2024-04-17T05:32:10.797 INFO:tasks.workunit:Running workunit fs/misc/chmod.sh... 2024-04-17T05:32:10.797 DEBUG:teuthology.orchestra.run.smithi123:workunit test fs/misc/chmod.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c84f5997950fd7d008204839253291d52e6eda TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/chmod.sh 2024-04-17T05:32:10.923 INFO:tasks.workunit.client.0.smithi123.stderr:+ set -e 2024-04-17T05:32:10.923 INFO:tasks.workunit.client.0.smithi123.stderr:+ file=test_chmod.48892 2024-04-17T05:32:10.923 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo foo 2024-04-17T05:32:10.966 INFO:tasks.workunit.client.0.smithi123.stderr:+ test 0 '!=' 0 2024-04-17T05:32:10.966 INFO:tasks.workunit.client.0.smithi123.stderr:+ chmod 400 test_chmod.48892 2024-04-17T05:32:10.982 INFO:tasks.workunit.client.0.smithi123.stderr:+ test 0 '!=' 0 2024-04-17T05:32:10.985 INFO:tasks.workunit.client.0.smithi123.stderr:+ check_perms test_chmod.48892 -r-------- 2024-04-17T05:32:10.985 INFO:tasks.workunit.client.0.smithi123.stderr:+ file=test_chmod.48892 2024-04-17T05:32:10.986 INFO:tasks.workunit.client.0.smithi123.stderr:++ ls -la test_chmod.48892 2024-04-17T05:32:10.994 INFO:tasks.workunit.client.0.smithi123.stderr:+ r='-r--------. 1 ubuntu ubuntu 4 Apr 17 05:32 test_chmod.48892' 2024-04-17T05:32:10.994 INFO:tasks.workunit.client.0.smithi123.stderr:+ test 0 '!=' 0 2024-04-17T05:32:10.995 INFO:tasks.workunit.client.0.smithi123.stderr:+ perms=-r-------- 2024-04-17T05:32:10.996 INFO:tasks.workunit.client.0.smithi123.stderr:++ echo -r--------. 1 ubuntu ubuntu 4 Apr 17 05:32 test_chmod.48892 2024-04-17T05:32:10.997 INFO:tasks.workunit.client.0.smithi123.stderr:++ awk '{print $1}' 2024-04-17T05:32:11.031 INFO:tasks.workunit.client.0.smithi123.stderr:+ test -r-------- '!=' -r--------. 2024-04-17T05:32:11.034 INFO:tasks.workunit.client.0.smithi123.stderr:++ echo -r--------. 1 ubuntu ubuntu 4 Apr 17 05:32 test_chmod.48892 2024-04-17T05:32:11.034 INFO:tasks.workunit.client.0.smithi123.stderr:++ awk '{print $1}' 2024-04-17T05:32:11.039 INFO:tasks.workunit.client.0.smithi123.stderr:+ test -r--------. '!=' -r--------. 2024-04-17T05:32:11.039 INFO:tasks.workunit.client.0.smithi123.stderr:+ set +e 2024-04-17T05:32:11.039 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo bar 2024-04-17T05:32:11.041 INFO:tasks.workunit.client.0.smithi123.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/chmod.sh: line 40: test_chmod.48892: Permission denied 2024-04-17T05:32:11.041 INFO:tasks.workunit.client.0.smithi123.stderr:+ test 1 = 0 2024-04-17T05:32:11.042 INFO:tasks.workunit.client.0.smithi123.stderr:+ set -e 2024-04-17T05:32:11.042 INFO:tasks.workunit.client.0.smithi123.stderr:+ chmod 600 test_chmod.48892 2024-04-17T05:32:11.046 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo bar 2024-04-17T05:32:11.048 INFO:tasks.workunit.client.0.smithi123.stderr:+ test 0 '!=' 0 2024-04-17T05:32:11.048 INFO:tasks.workunit.client.0.smithi123.stderr:+ check_perms test_chmod.48892 -rw------- 2024-04-17T05:32:11.048 INFO:tasks.workunit.client.0.smithi123.stderr:+ file=test_chmod.48892 2024-04-17T05:32:11.050 INFO:tasks.workunit.client.0.smithi123.stderr:++ ls -la test_chmod.48892 2024-04-17T05:32:11.056 INFO:tasks.workunit.client.0.smithi123.stderr:+ r='-rw-------. 1 ubuntu ubuntu 8 Apr 17 05:32 test_chmod.48892' 2024-04-17T05:32:11.056 INFO:tasks.workunit.client.0.smithi123.stderr:+ test 0 '!=' 0 2024-04-17T05:32:11.056 INFO:tasks.workunit.client.0.smithi123.stderr:+ perms=-rw------- 2024-04-17T05:32:11.058 INFO:tasks.workunit.client.0.smithi123.stderr:++ echo -rw-------. 1 ubuntu ubuntu 8 Apr 17 05:32 test_chmod.48892 2024-04-17T05:32:11.059 INFO:tasks.workunit.client.0.smithi123.stderr:++ awk '{print $1}' 2024-04-17T05:32:11.065 INFO:tasks.workunit.client.0.smithi123.stderr:+ test -rw------- '!=' -rw-------. 2024-04-17T05:32:11.067 INFO:tasks.workunit.client.0.smithi123.stderr:++ echo -rw-------. 1 ubuntu ubuntu 8 Apr 17 05:32 test_chmod.48892 2024-04-17T05:32:11.068 INFO:tasks.workunit.client.0.smithi123.stderr:++ awk '{print $1}' 2024-04-17T05:32:11.073 INFO:tasks.workunit.client.0.smithi123.stderr:+ test -rw-------. '!=' -rw-------. 2024-04-17T05:32:11.073 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo foo 2024-04-17T05:32:11.074 INFO:tasks.workunit.client.0.smithi123.stderr:+ test 0 '!=' 0 2024-04-17T05:32:11.076 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-17T05:32:11.076 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-17T05:32:11.202 INFO:tasks.workunit:Stopping ['fs/misc/chmod.sh'] on client.0... 2024-04-17T05:32:11.202 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-17T05:32:12.168 DEBUG:teuthology.parallel:result is None 2024-04-17T05:32:12.169 DEBUG:teuthology.orchestra.run.smithi123:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout a8c84f5997950fd7d008204839253291d52e6eda 2024-04-17T05:32:12.225 INFO:tasks.workunit.client.0.smithi123.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-17T05:32:18.897 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:32:18.905 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:32:49.036 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:32:49.044 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:33:19.173 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:33:19.179 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:33:37.865 INFO:tasks.workunit.client.0.smithi123.stderr:Updating files: 62% (7729/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-17T05:33:38.835 INFO:tasks.workunit.client.0.smithi123.stderr:Note: switching to 'a8c84f5997950fd7d008204839253291d52e6eda'. 2024-04-17T05:33:38.835 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-04-17T05:33:38.835 INFO:tasks.workunit.client.0.smithi123.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-17T05:33:38.835 INFO:tasks.workunit.client.0.smithi123.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-17T05:33:38.835 INFO:tasks.workunit.client.0.smithi123.stderr:state without impacting any branches by switching back to a branch. 2024-04-17T05:33:38.835 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-04-17T05:33:38.835 INFO:tasks.workunit.client.0.smithi123.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-17T05:33:38.835 INFO:tasks.workunit.client.0.smithi123.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-17T05:33:38.835 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-04-17T05:33:38.835 INFO:tasks.workunit.client.0.smithi123.stderr: git switch -c 2024-04-17T05:33:38.835 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-04-17T05:33:38.835 INFO:tasks.workunit.client.0.smithi123.stderr:Or undo this operation with: 2024-04-17T05:33:38.836 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-04-17T05:33:38.836 INFO:tasks.workunit.client.0.smithi123.stderr: git switch - 2024-04-17T05:33:38.836 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-04-17T05:33:38.836 INFO:tasks.workunit.client.0.smithi123.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-17T05:33:38.836 INFO:tasks.workunit.client.0.smithi123.stderr: 2024-04-17T05:33:38.836 INFO:tasks.workunit.client.0.smithi123.stderr:HEAD is now at a8c84f59979 Merge PR #51659 into wip-rishabh-testing-20240416.193735 2024-04-17T05:33:38.849 DEBUG:teuthology.orchestra.run.smithi123:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-17T05:33:38.900 INFO:tasks.workunit.client.0.smithi123.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-17T05:33:38.905 INFO:tasks.workunit.client.0.smithi123.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-17T05:33:38.906 INFO:tasks.workunit.client.0.smithi123.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-17T05:33:38.993 INFO:tasks.workunit.client.0.smithi123.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-17T05:33:39.092 INFO:tasks.workunit.client.0.smithi123.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-17T05:33:39.175 INFO:tasks.workunit.client.0.smithi123.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-17T05:33:39.181 INFO:tasks.workunit.client.0.smithi123.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-17T05:33:39.181 INFO:tasks.workunit.client.0.smithi123.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-17T05:33:39.262 INFO:tasks.workunit.client.0.smithi123.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-17T05:33:39.272 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-17T05:33:39.272 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-17T05:33:39.319 INFO:tasks.workunit:Running workunits matching fs/misc/dac_override.sh on client.0... 2024-04-17T05:33:39.320 INFO:tasks.workunit:Running workunit fs/misc/dac_override.sh... 2024-04-17T05:33:39.320 DEBUG:teuthology.orchestra.run.smithi123:workunit test fs/misc/dac_override.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c84f5997950fd7d008204839253291d52e6eda TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/dac_override.sh 2024-04-17T05:33:39.451 INFO:tasks.workunit.client.0.smithi123.stderr:+ set -e 2024-04-17T05:33:39.451 INFO:tasks.workunit.client.0.smithi123.stderr:+ mkdir -p testdir 2024-04-17T05:33:39.460 INFO:tasks.workunit.client.0.smithi123.stderr:+ file=test_chmod.49150 2024-04-17T05:33:39.460 INFO:tasks.workunit.client.0.smithi123.stderr:+ echo foo 2024-04-17T05:33:39.466 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo chmod 600 testdir 2024-04-17T05:33:39.524 INFO:tasks.workunit.client.0.smithi123.stderr:+ expect_failure cat testdir/test_chmod.49150 2024-04-17T05:33:39.524 INFO:tasks.workunit.client.0.smithi123.stderr:+ cat testdir/test_chmod.49150 2024-04-17T05:33:39.528 INFO:tasks.workunit.client.0.smithi123.stderr:cat: testdir/test_chmod.49150: Permission denied 2024-04-17T05:33:39.529 INFO:tasks.workunit.client.0.smithi123.stderr:+ return 0 2024-04-17T05:33:39.529 INFO:tasks.workunit.client.0.smithi123.stderr:+ sudo cat testdir/test_chmod.49150 2024-04-17T05:33:39.568 INFO:tasks.workunit.client.0.smithi123.stdout:foo 2024-04-17T05:33:39.573 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-17T05:33:39.573 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-17T05:33:39.728 INFO:tasks.workunit:Stopping ['fs/misc/dac_override.sh'] on client.0... 2024-04-17T05:33:39.729 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-17T05:33:40.672 DEBUG:teuthology.parallel:result is None 2024-04-17T05:33:40.673 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-17T05:33:40.777 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-17T05:33:40.777 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-17T05:33:40.787 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-17T05:33:40.788 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-17T05:33:40.788 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T05:33:40.839 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-17T05:33:40.839 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T05:33:40.888 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T05:33:41.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.882+0000 7f24fb400640 1 Processor -- start 2024-04-17T05:33:41.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.882+0000 7f24fb400640 1 -- start start 2024-04-17T05:33:41.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.883+0000 7f24fb400640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f24f406d2d0 0x7f24f40afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:41.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.883+0000 7f24fb400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f24f40b0000 0x7f24f4095cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:41.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.883+0000 7f24fb400640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24f406e450 con 0x7f24f4096210 2024-04-17T05:33:41.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.883+0000 7f24fb400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f24f40ae520 con 0x7f24f40b0000 2024-04-17T05:33:41.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.883+0000 7f24fb400640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f24f40b5940 con 0x7f24f406d2d0 2024-04-17T05:33:41.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.884+0000 7f24f3e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f24f40b0000 0x7f24f4095cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:41.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.884+0000 7f24f3e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f24f40b0000 0x7f24f4095cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39056/0 (socket says 172.21.15.123:39056) 2024-04-17T05:33:41.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.884+0000 7f24f3e00640 1 -- 172.21.15.123:0/1685489198 learned_addr learned my addr 172.21.15.123:0/1685489198 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:41.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.884+0000 7f24f8a00640 1 --2- 172.21.15.123:0/1685489198 >> v2:172.21.15.164:3300/0 conn(0x7f24f406d2d0 0x7f24f40afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:41.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.885+0000 7f24f3400640 1 -- 172.21.15.123:0/1685489198 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1346202820 0 0) 0x7f24f406e450 con 0x7f24f4096210 2024-04-17T05:33:41.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.887+0000 7f24f3400640 1 -- 172.21.15.123:0/1685489198 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24d8003420 con 0x7f24f4096210 2024-04-17T05:33:41.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.888+0000 7f24f3e00640 1 -- 172.21.15.123:0/1685489198 >> v2:172.21.15.164:3300/0 conn(0x7f24f406d2d0 msgr2=0x7f24f40afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:41.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.888+0000 7f24f3e00640 1 --2- 172.21.15.123:0/1685489198 >> v2:172.21.15.164:3300/0 conn(0x7f24f406d2d0 0x7f24f40afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:41.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.888+0000 7f24f3e00640 1 -- 172.21.15.123:0/1685489198 >> v1:172.21.15.164:6789/0 conn(0x7f24f4096210 legacy=0x7f24f4157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:41.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.888+0000 7f24f3e00640 1 -- 172.21.15.123:0/1685489198 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24f406d6b0 con 0x7f24f40b0000 2024-04-17T05:33:41.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.889+0000 7f24f3e00640 1 --2- 172.21.15.123:0/1685489198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24f40b0000 0x7f24f4095cd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f24f4067f50 tx=0x7f24e000abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7210fbefa9d932d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:41.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.889+0000 7f24f3400640 1 -- 172.21.15.123:0/1685489198 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e0034020 con 0x7f24f40b0000 2024-04-17T05:33:41.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.889+0000 7f24f3400640 1 -- 172.21.15.123:0/1685489198 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24e0008df0 con 0x7f24f40b0000 2024-04-17T05:33:41.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.889+0000 7f24f3400640 1 -- 172.21.15.123:0/1685489198 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e000a2f0 con 0x7f24f40b0000 2024-04-17T05:33:41.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.890+0000 7f24fb400640 1 -- 172.21.15.123:0/1685489198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24f40b0000 msgr2=0x7f24f4095cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:41.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.890+0000 7f24fb400640 1 --2- 172.21.15.123:0/1685489198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24f40b0000 0x7f24f4095cd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f24f4067f50 tx=0x7f24e000abe0 comp rx=0 tx=0).stop 2024-04-17T05:33:41.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.890+0000 7f24fb400640 1 -- 172.21.15.123:0/1685489198 shutdown_connections 2024-04-17T05:33:41.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.890+0000 7f24fb400640 1 --2- 172.21.15.123:0/1685489198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24f40b0000 0x7f24f4095cd0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:41.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.890+0000 7f24fb400640 1 --2- 172.21.15.123:0/1685489198 >> v2:172.21.15.164:3300/0 conn(0x7f24f406d2d0 0x7f24f40afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:41.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.890+0000 7f24fb400640 1 -- 172.21.15.123:0/1685489198 >> 172.21.15.123:0/1685489198 conn(0x7f24f40b93b0 msgr2=0x7f24f40b97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:41.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.890+0000 7f24fb400640 1 -- 172.21.15.123:0/1685489198 shutdown_connections 2024-04-17T05:33:41.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.891+0000 7f24fb400640 1 -- 172.21.15.123:0/1685489198 wait complete. 2024-04-17T05:33:41.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.894+0000 7f24fb400640 1 Processor -- start 2024-04-17T05:33:41.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.894+0000 7f24fb400640 1 -- start start 2024-04-17T05:33:41.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.895+0000 7f24fb400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24f406d2d0 0x7f24f4153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:41.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.895+0000 7f24fb400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f24f4096210 0x7f24f41ea070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:41.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.895+0000 7f24fb400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24f40b0000 0x7f24f41e3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:41.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.896+0000 7f24fb400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f24f40b9ed0 con 0x7f24f40b0000 2024-04-17T05:33:41.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.896+0000 7f24fb400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f24f40b0460 con 0x7f24f406d2d0 2024-04-17T05:33:41.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.896+0000 7f24fb400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f24f40ba050 con 0x7f24f4096210 2024-04-17T05:33:41.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.896+0000 7f24f9400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24f40b0000 0x7f24f41e3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:41.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.896+0000 7f24f9400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24f40b0000 0x7f24f41e3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39058/0 (socket says 172.21.15.123:39058) 2024-04-17T05:33:41.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.896+0000 7f24f9400640 1 -- 172.21.15.123:0/2002665180 learned_addr learned my addr 172.21.15.123:0/2002665180 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:41.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.896+0000 7f24f8a00640 1 --2- 172.21.15.123:0/2002665180 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24f406d2d0 0x7f24f4153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:41.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.896+0000 7f24f3e00640 1 --2- 172.21.15.123:0/2002665180 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f24f4096210 0x7f24f41ea070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:41.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.897+0000 7f24f9400640 1 -- 172.21.15.123:0/2002665180 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f24f4096210 msgr2=0x7f24f41ea070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:41.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.897+0000 7f24f9400640 1 --2- 172.21.15.123:0/2002665180 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f24f4096210 0x7f24f41ea070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:41.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.897+0000 7f24f9400640 1 -- 172.21.15.123:0/2002665180 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24f406d2d0 msgr2=0x7f24f4153890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:41.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.897+0000 7f24f9400640 1 --2- 172.21.15.123:0/2002665180 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24f406d2d0 0x7f24f4153890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:41.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.897+0000 7f24f9400640 1 -- 172.21.15.123:0/2002665180 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24f4152330 con 0x7f24f40b0000 2024-04-17T05:33:41.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.897+0000 7f24f9400640 1 --2- 172.21.15.123:0/2002665180 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24f40b0000 0x7f24f41e3da0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00c7a0 tx=0x7f24ec00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:41.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.898+0000 7f24f0c00640 1 -- 172.21.15.123:0/2002665180 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec003b70 con 0x7f24f40b0000 2024-04-17T05:33:41.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.898+0000 7f24f0c00640 1 -- 172.21.15.123:0/2002665180 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24ec003d30 con 0x7f24f40b0000 2024-04-17T05:33:41.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.898+0000 7f24fb400640 1 -- 172.21.15.123:0/2002665180 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24f41525f0 con 0x7f24f40b0000 2024-04-17T05:33:41.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.898+0000 7f24f0c00640 1 -- 172.21.15.123:0/2002665180 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec00aa90 con 0x7f24f40b0000 2024-04-17T05:33:41.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.899+0000 7f24fb400640 1 -- 172.21.15.123:0/2002665180 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24f4158c00 con 0x7f24f40b0000 2024-04-17T05:33:41.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.901+0000 7f24f0c00640 1 -- 172.21.15.123:0/2002665180 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f24ec00ac30 con 0x7f24f40b0000 2024-04-17T05:33:41.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.901+0000 7f24fb400640 1 -- 172.21.15.123:0/2002665180 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24f4068a40 con 0x7f24f40b0000 2024-04-17T05:33:41.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.902+0000 7f24f0c00640 1 --2- 172.21.15.123:0/2002665180 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f24d406c8f0 0x7f24d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:41.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.902+0000 7f24f0c00640 1 -- 172.21.15.123:0/2002665180 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f24ec08bca0 con 0x7f24f40b0000 2024-04-17T05:33:41.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.903+0000 7f24f8a00640 1 --2- 172.21.15.123:0/2002665180 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f24d406c8f0 0x7f24d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:41.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.905+0000 7f24f8a00640 1 --2- 172.21.15.123:0/2002665180 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f24d406c8f0 0x7f24d406edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f24f4158f90 tx=0x7f24e4009360 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:41.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:41.910+0000 7f24f0c00640 1 -- 172.21.15.123:0/2002665180 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f24ec0596f0 con 0x7f24f40b0000 2024-04-17T05:33:42.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.115+0000 7f24fb400640 1 -- 172.21.15.123:0/2002665180 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f24f409e960 con 0x7f24f40b0000 2024-04-17T05:33:42.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.116+0000 7f24f0c00640 1 -- 172.21.15.123:0/2002665180 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18960 (secure 0 0 0) 0x7f24ec05d9f0 con 0x7f24f40b0000 2024-04-17T05:33:42.115 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:33:42.115 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":28,"fsid":"0787c5c0-e77a-4102-a899-30db48b19c68","created":"2024-04-17T05:26:33.031507+0000","modified":"2024-04-17T05:27:39.558127+0000","last_up_change":"2024-04-17T05:26:44.988433+0000","last_in_change":"2024-04-17T05:26:36.682131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T05:26:46.329778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T05:26:50.600195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T05:26:51.626498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T05:26:55.264044+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15c87cdb-9415-45a6-a2a6-ea6bec9daece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6801","nonce":840753170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6803","nonce":840753170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6807","nonce":840753170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6805","nonce":840753170}]},"public_addr":"172.21.15.123:6801/840753170","cluster_addr":"172.21.15.123:6803/840753170","heartbeat_back_addr":"172.21.15.123:6807/840753170","heartbeat_front_addr":"172.21.15.123:6805/840753170","state":["exists","up"]},{"osd":1,"uuid":"281751b5-486d-4845-b4aa-b308bf7cec62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6822","nonce":2231878927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6827","nonce":2231878927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6831","nonce":2231878927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6829","nonce":2231878927}]},"public_addr":"172.21.15.123:6822/2231878927","cluster_addr":"172.21.15.123:6827/2231878927","heartbeat_back_addr":"172.21.15.123:6831/2231878927","heartbeat_front_addr":"172.21.15.123:6829/2231878927","state":["exists","up"]},{"osd":2,"uuid":"b42257d3-bd20-4db5-aa37-1bf5c512d0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6817","nonce":754360844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6820","nonce":754360844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6825","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6826","nonce":754360844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6823","nonce":754360844}]},"public_addr":"172.21.15.123:6817/754360844","cluster_addr":"172.21.15.123:6820/754360844","heartbeat_back_addr":"172.21.15.123:6826/754360844","heartbeat_front_addr":"172.21.15.123:6823/754360844","state":["exists","up"]},{"osd":3,"uuid":"0f26b891-bbe6-478e-8dee-78e69bb48cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6809","nonce":2898088574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6811","nonce":2898088574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6815","nonce":2898088574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6813","nonce":2898088574}]},"public_addr":"172.21.15.123:6809/2898088574","cluster_addr":"172.21.15.123:6811/2898088574","heartbeat_back_addr":"172.21.15.123:6815/2898088574","heartbeat_front_addr":"172.21.15.123:6813/2898088574","state":["exists","up"]},{"osd":4,"uuid":"43e59318-2740-4625-9d64-eec1fd43c322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6801","nonce":606484349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6804","nonce":606484349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6812","nonce":606484349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6808","nonce":606484349}]},"public_addr":"172.21.15.164:6801/606484349","cluster_addr":"172.21.15.164:6804/606484349","heartbeat_back_addr":"172.21.15.164:6812/606484349","heartbeat_front_addr":"172.21.15.164:6808/606484349","state":["exists","up"]},{"osd":5,"uuid":"aaa3acf4-4adc-4337-aba3-363851d35310","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6805","nonce":1376989593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6809","nonce":1376989593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6815","nonce":1376989593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6813","nonce":1376989593}]},"public_addr":"172.21.15.164:6805/1376989593","cluster_addr":"172.21.15.164:6809/1376989593","heartbeat_back_addr":"172.21.15.164:6815/1376989593","heartbeat_front_addr":"172.21.15.164:6813/1376989593","state":["exists","up"]},{"osd":6,"uuid":"6f765b27-7377-4d81-9192-23a965651145","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6817","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6821","nonce":1594306924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6823","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6826","nonce":1594306924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6831","nonce":1594306924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6829","nonce":1594306924}]},"public_addr":"172.21.15.164:6821/1594306924","cluster_addr":"172.21.15.164:6826/1594306924","heartbeat_back_addr":"172.21.15.164:6831/1594306924","heartbeat_front_addr":"172.21.15.164:6829/1594306924","state":["exists","up"]},{"osd":7,"uuid":"5547394b-ec2f-4311-846d-369af4b1acf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6818","nonce":295402697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6819","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6820","nonce":295402697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6825","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6827","nonce":295402697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6824","nonce":295402697}]},"public_addr":"172.21.15.164:6818/295402697","cluster_addr":"172.21.15.164:6820/295402697","heartbeat_back_addr":"172.21.15.164:6827/295402697","heartbeat_front_addr":"172.21.15.164:6824/295402697","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.034807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.022201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.751897+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.850533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.083608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.047524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.314753+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.413586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T05:33:42.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.119+0000 7f24fb400640 1 -- 172.21.15.123:0/2002665180 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f24d406c8f0 msgr2=0x7f24d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:42.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.119+0000 7f24fb400640 1 --2- 172.21.15.123:0/2002665180 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f24d406c8f0 0x7f24d406edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f24f4158f90 tx=0x7f24e4009360 comp rx=0 tx=0).stop 2024-04-17T05:33:42.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.119+0000 7f24fb400640 1 -- 172.21.15.123:0/2002665180 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24f40b0000 msgr2=0x7f24f41e3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:42.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.119+0000 7f24fb400640 1 --2- 172.21.15.123:0/2002665180 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24f40b0000 0x7f24f41e3da0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00c7a0 tx=0x7f24ec00cc60 comp rx=0 tx=0).stop 2024-04-17T05:33:42.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.119+0000 7f24fb400640 1 -- 172.21.15.123:0/2002665180 shutdown_connections 2024-04-17T05:33:42.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.119+0000 7f24fb400640 1 --2- 172.21.15.123:0/2002665180 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24f40b0000 0x7f24f41e3da0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:42.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.119+0000 7f24fb400640 1 --2- 172.21.15.123:0/2002665180 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f24d406c8f0 0x7f24d406edb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:42.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.119+0000 7f24fb400640 1 --2- 172.21.15.123:0/2002665180 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f24f4096210 0x7f24f41ea070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:42.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.119+0000 7f24fb400640 1 --2- 172.21.15.123:0/2002665180 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24f406d2d0 0x7f24f4153890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:42.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.119+0000 7f24fb400640 1 -- 172.21.15.123:0/2002665180 >> 172.21.15.123:0/2002665180 conn(0x7f24f40b93b0 msgr2=0x7f24f4092370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:42.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.119+0000 7f24fb400640 1 -- 172.21.15.123:0/2002665180 shutdown_connections 2024-04-17T05:33:42.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.119+0000 7f24fb400640 1 -- 172.21.15.123:0/2002665180 wait complete. 2024-04-17T05:33:42.153 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T05:26:46.329778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T05:26:50.600195+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T05:26:51.626498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T05:26:55.264044+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T05:33:42.154 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T05:33:42.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.367+0000 7f3497200640 1 Processor -- start 2024-04-17T05:33:42.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.367+0000 7f3497200640 1 -- start start 2024-04-17T05:33:42.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.368+0000 7f3497200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34980b66c0 0x7f34980b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:42.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.368+0000 7f3497200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f34980b5490 0x7f349813f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:42.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.368+0000 7f3497200640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f34980732e0 0x7f3498073740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:42.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.368+0000 7f3497200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f34980b4ca0 con 0x7f34980b5490 2024-04-17T05:33:42.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.368+0000 7f3497200640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f34980b6aa0 con 0x7f34980732e0 2024-04-17T05:33:42.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.368+0000 7f3497200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f34980b5af0 con 0x7f34980b66c0 2024-04-17T05:33:42.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.369+0000 7f3495400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f34980b5490 0x7f349813f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:42.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.369+0000 7f3495400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f34980b5490 0x7f349813f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39070/0 (socket says 172.21.15.123:39070) 2024-04-17T05:33:42.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.369+0000 7f3495400640 1 -- 172.21.15.123:0/199682568 learned_addr learned my addr 172.21.15.123:0/199682568 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:42.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.369+0000 7f3496800640 1 --2- 172.21.15.123:0/199682568 >> v2:172.21.15.164:3300/0 conn(0x7f34980732e0 0x7f3498073740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:42.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.369+0000 7f3495e00640 1 --2- 172.21.15.123:0/199682568 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34980b66c0 0x7f34980b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:42.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.369+0000 7f3495400640 1 -- 172.21.15.123:0/199682568 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34980b66c0 msgr2=0x7f34980b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:42.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.369+0000 7f3495400640 1 --2- 172.21.15.123:0/199682568 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34980b66c0 0x7f34980b3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:42.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.370+0000 7f3495400640 1 -- 172.21.15.123:0/199682568 >> v2:172.21.15.164:3300/0 conn(0x7f34980732e0 msgr2=0x7f3498073740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:42.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.370+0000 7f3495400640 1 --2- 172.21.15.123:0/199682568 >> v2:172.21.15.164:3300/0 conn(0x7f34980732e0 0x7f3498073740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:42.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.370+0000 7f3495400640 1 -- 172.21.15.123:0/199682568 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f349809c480 con 0x7f34980b5490 2024-04-17T05:33:42.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.371+0000 7f3495400640 1 --2- 172.21.15.123:0/199682568 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34980b5490 0x7f349813f9a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3498143550 tx=0x7f348002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86cee4add6d53879 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:42.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.371+0000 7f3494a00640 1 -- 172.21.15.123:0/199682568 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348002e070 con 0x7f34980b5490 2024-04-17T05:33:42.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.371+0000 7f3494a00640 1 -- 172.21.15.123:0/199682568 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3480037070 con 0x7f34980b5490 2024-04-17T05:33:42.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.371+0000 7f3494a00640 1 -- 172.21.15.123:0/199682568 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3480031a00 con 0x7f34980b5490 2024-04-17T05:33:42.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.372+0000 7f3497200640 1 -- 172.21.15.123:0/199682568 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34980b5490 msgr2=0x7f349813f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:42.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.372+0000 7f3497200640 1 --2- 172.21.15.123:0/199682568 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34980b5490 0x7f349813f9a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3498143550 tx=0x7f348002b880 comp rx=0 tx=0).stop 2024-04-17T05:33:42.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.372+0000 7f3497200640 1 -- 172.21.15.123:0/199682568 shutdown_connections 2024-04-17T05:33:42.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.372+0000 7f3497200640 1 --2- 172.21.15.123:0/199682568 >> v2:172.21.15.164:3300/0 conn(0x7f34980732e0 0x7f3498073740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:42.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.372+0000 7f3497200640 1 --2- 172.21.15.123:0/199682568 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34980b5490 0x7f349813f9a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:42.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.372+0000 7f3497200640 1 --2- 172.21.15.123:0/199682568 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34980b66c0 0x7f34980b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:42.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.372+0000 7f3497200640 1 -- 172.21.15.123:0/199682568 >> 172.21.15.123:0/199682568 conn(0x7f34980b9a30 msgr2=0x7f34980b5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:42.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.372+0000 7f3497200640 1 -- 172.21.15.123:0/199682568 shutdown_connections 2024-04-17T05:33:42.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.372+0000 7f3497200640 1 -- 172.21.15.123:0/199682568 wait complete. 2024-04-17T05:33:42.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.374+0000 7f3497200640 1 Processor -- start 2024-04-17T05:33:42.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.374+0000 7f3497200640 1 -- start start 2024-04-17T05:33:42.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.375+0000 7f3497200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34980732e0 0x7f34981de060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:42.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.375+0000 7f3497200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34980b5490 0x7f349813e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:42.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.375+0000 7f3497200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34980b66c0 0x7f3498071080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:42.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.375+0000 7f3497200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3498140060 con 0x7f34980732e0 2024-04-17T05:33:42.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.375+0000 7f3497200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f349813fee0 con 0x7f34980b66c0 2024-04-17T05:33:42.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.375+0000 7f3497200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f349806cdd0 con 0x7f34980b5490 2024-04-17T05:33:42.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.375+0000 7f3495e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34980732e0 0x7f34981de060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:42.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.375+0000 7f3495e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34980732e0 0x7f34981de060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39078/0 (socket says 172.21.15.123:39078) 2024-04-17T05:33:42.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.375+0000 7f3495e00640 1 -- 172.21.15.123:0/101346518 learned_addr learned my addr 172.21.15.123:0/101346518 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:42.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.375+0000 7f3495400640 1 --2- 172.21.15.123:0/101346518 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34980b5490 0x7f349813e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:42.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.375+0000 7f3496800640 1 --2- 172.21.15.123:0/101346518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34980b66c0 0x7f3498071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:42.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.376+0000 7f3495e00640 1 -- 172.21.15.123:0/101346518 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34980b5490 msgr2=0x7f349813e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:42.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.376+0000 7f3495e00640 1 --2- 172.21.15.123:0/101346518 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34980b5490 0x7f349813e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:42.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.376+0000 7f3495e00640 1 -- 172.21.15.123:0/101346518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34980b66c0 msgr2=0x7f3498071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:42.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.376+0000 7f3495e00640 1 --2- 172.21.15.123:0/101346518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34980b66c0 0x7f3498071080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:42.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.376+0000 7f3495e00640 1 -- 172.21.15.123:0/101346518 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3498070c60 con 0x7f34980732e0 2024-04-17T05:33:42.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.376+0000 7f3495400640 1 --2- 172.21.15.123:0/101346518 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34980b5490 0x7f349813e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:33:42.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.376+0000 7f3496800640 1 --2- 172.21.15.123:0/101346518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34980b66c0 0x7f3498071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:33:42.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.376+0000 7f3495e00640 1 --2- 172.21.15.123:0/101346518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34980732e0 0x7f34981de060 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f348800e8a0 tx=0x7f348800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:42.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.376+0000 7f348e000640 1 -- 172.21.15.123:0/101346518 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3488017070 con 0x7f34980732e0 2024-04-17T05:33:42.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.376+0000 7f348e000640 1 -- 172.21.15.123:0/101346518 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f348800c940 con 0x7f34980732e0 2024-04-17T05:33:42.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.376+0000 7f348e000640 1 -- 172.21.15.123:0/101346518 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348800cd30 con 0x7f34980732e0 2024-04-17T05:33:42.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.376+0000 7f3497200640 1 -- 172.21.15.123:0/101346518 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34981dd580 con 0x7f34980732e0 2024-04-17T05:33:42.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.376+0000 7f3497200640 1 -- 172.21.15.123:0/101346518 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34980b01b0 con 0x7f34980732e0 2024-04-17T05:33:42.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.378+0000 7f3497200640 1 -- 172.21.15.123:0/101346518 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3498075b30 con 0x7f34980732e0 2024-04-17T05:33:42.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.379+0000 7f348e000640 1 -- 172.21.15.123:0/101346518 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f348801a070 con 0x7f34980732e0 2024-04-17T05:33:42.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.380+0000 7f348e000640 1 --2- 172.21.15.123:0/101346518 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f347406c8f0 0x7f347406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:42.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.380+0000 7f348e000640 1 -- 172.21.15.123:0/101346518 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f348808be50 con 0x7f34980732e0 2024-04-17T05:33:42.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.381+0000 7f3495400640 1 --2- 172.21.15.123:0/101346518 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f347406c8f0 0x7f347406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:42.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.382+0000 7f3495400640 1 --2- 172.21.15.123:0/101346518 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f347406c8f0 0x7f347406edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3480036000 tx=0x7f3480008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:42.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.384+0000 7f348e000640 1 -- 172.21.15.123:0/101346518 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f3488059e50 con 0x7f34980732e0 2024-04-17T05:33:42.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.585+0000 7f3497200640 1 -- 172.21.15.123:0/101346518 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3498144810 con 0x7f34980732e0 2024-04-17T05:33:42.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.586+0000 7f348e000640 1 -- 172.21.15.123:0/101346518 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7f3488059750 con 0x7f34980732e0 2024-04-17T05:33:42.584 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-04-17T05:33:42.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.589+0000 7f3497200640 1 -- 172.21.15.123:0/101346518 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f347406c8f0 msgr2=0x7f347406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:42.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.589+0000 7f3497200640 1 --2- 172.21.15.123:0/101346518 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f347406c8f0 0x7f347406edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3480036000 tx=0x7f3480008030 comp rx=0 tx=0).stop 2024-04-17T05:33:42.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.589+0000 7f3497200640 1 -- 172.21.15.123:0/101346518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34980732e0 msgr2=0x7f34981de060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:42.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.589+0000 7f3497200640 1 --2- 172.21.15.123:0/101346518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34980732e0 0x7f34981de060 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f348800e8a0 tx=0x7f348800eca0 comp rx=0 tx=0).stop 2024-04-17T05:33:42.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.589+0000 7f3497200640 1 -- 172.21.15.123:0/101346518 shutdown_connections 2024-04-17T05:33:42.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.589+0000 7f3497200640 1 --2- 172.21.15.123:0/101346518 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f34980b66c0 0x7f3498071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:42.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.589+0000 7f3497200640 1 --2- 172.21.15.123:0/101346518 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f347406c8f0 0x7f347406edb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:42.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.589+0000 7f3497200640 1 --2- 172.21.15.123:0/101346518 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f34980b5490 0x7f349813e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:42.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.589+0000 7f3497200640 1 --2- 172.21.15.123:0/101346518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34980732e0 0x7f34981de060 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:42.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.589+0000 7f3497200640 1 -- 172.21.15.123:0/101346518 >> 172.21.15.123:0/101346518 conn(0x7f34980b9a30 msgr2=0x7f3498143890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:42.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.589+0000 7f3497200640 1 -- 172.21.15.123:0/101346518 shutdown_connections 2024-04-17T05:33:42.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.589+0000 7f3497200640 1 -- 172.21.15.123:0/101346518 wait complete. 2024-04-17T05:33:42.604 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T05:33:42.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.819+0000 7f2c50a00640 1 Processor -- start 2024-04-17T05:33:42.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.819+0000 7f2c50a00640 1 -- start start 2024-04-17T05:33:42.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.820+0000 7f2c50a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2c4c0b4bd0 0x7f2c4c0b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:42.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.820+0000 7f2c50a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c4c0b4fb0 con 0x7f2c4c0730d0 2024-04-17T05:33:42.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.820+0000 7f2c50a00640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c4c06cf00 con 0x7f2c4c149840 2024-04-17T05:33:42.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.820+0000 7f2c50a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f2c4c0ba130 con 0x7f2c4c0b4bd0 2024-04-17T05:33:42.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.821+0000 7f2c43e00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f2c4c0730d0 0x7f2c4c06da20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42098/0 (socket says 172.21.15.123:42098) 2024-04-17T05:33:42.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.821+0000 7f2c43e00640 1 -- 172.21.15.123:0/1969044623 learned_addr learned my addr 172.21.15.123:0/1969044623 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:33:42.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.821+0000 7f2c4a800640 1 --2- 172.21.15.123:0/1969044623 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2c4c0b4bd0 0x7f2c4c0b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:42.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.821+0000 7f2c49e00640 1 -- 172.21.15.123:0/1969044623 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1809662422 0 0) 0x7f2c4c0b4fb0 con 0x7f2c4c0730d0 2024-04-17T05:33:42.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.821+0000 7f2c49e00640 1 -- 172.21.15.123:0/1969044623 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c30003520 con 0x7f2c4c0730d0 2024-04-17T05:33:42.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.822+0000 7f2c49e00640 1 -- 172.21.15.123:0/1969044623 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3038219857 0 0) 0x7f2c30003520 con 0x7f2c4c0730d0 2024-04-17T05:33:42.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.822+0000 7f2c49e00640 1 -- 172.21.15.123:0/1969044623 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2c4c0b4bd0 msgr2=0x7f2c4c0b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:42.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.822+0000 7f2c49e00640 1 --2- 172.21.15.123:0/1969044623 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2c4c0b4bd0 0x7f2c4c0b3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:42.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.822+0000 7f2c49e00640 1 -- 172.21.15.123:0/1969044623 >> v1:172.21.15.164:6789/0 conn(0x7f2c4c149840 legacy=0x7f2c4c150440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:42.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.822+0000 7f2c49e00640 1 -- 172.21.15.123:0/1969044623 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c4c06d1e0 con 0x7f2c4c0730d0 2024-04-17T05:33:42.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.822+0000 7f2c49e00640 1 -- 172.21.15.123:0/1969044623 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1042962670 0 0) 0x7f2c34001670 con 0x7f2c4c0730d0 2024-04-17T05:33:42.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.822+0000 7f2c49e00640 1 -- 172.21.15.123:0/1969044623 >> v1:172.21.15.123:6789/0 conn(0x7f2c4c0730d0 legacy=0x7f2c4c06da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:42.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.822+0000 7f2c49e00640 1 --2- 172.21.15.123:0/1969044623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c300039e0 0x7f2c30003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:42.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.822+0000 7f2c49e00640 1 --2- 172.21.15.123:0/1969044623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c30004800 0x7f2c30004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:42.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.822+0000 7f2c49e00640 1 --2- 172.21.15.123:0/1969044623 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2c4c0b4bd0 0x7f2c30005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:42.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.822+0000 7f2c49e00640 1 -- 172.21.15.123:0/1969044623 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3000bb50 con 0x7f2c300039e0 2024-04-17T05:33:42.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.822+0000 7f2c49e00640 1 -- 172.21.15.123:0/1969044623 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3000bd00 con 0x7f2c30004800 2024-04-17T05:33:42.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.822+0000 7f2c49e00640 1 -- 172.21.15.123:0/1969044623 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f2c3000bf00 con 0x7f2c4c0b4bd0 2024-04-17T05:33:42.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.822+0000 7f2c4a800640 1 --2- 172.21.15.123:0/1969044623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c300039e0 0x7f2c30003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:42.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.822+0000 7f2c4a800640 1 -- 172.21.15.123:0/1969044623 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2c4c0b4bd0 msgr2=0x7f2c30005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:42.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.822+0000 7f2c4a800640 1 --2- 172.21.15.123:0/1969044623 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2c4c0b4bd0 0x7f2c30005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:42.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.822+0000 7f2c4a800640 1 -- 172.21.15.123:0/1969044623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c30004800 msgr2=0x7f2c30004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:42.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.822+0000 7f2c43e00640 1 --2- 172.21.15.123:0/1969044623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c30004800 0x7f2c30004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:42.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.823+0000 7f2c4a800640 1 --2- 172.21.15.123:0/1969044623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c30004800 0x7f2c30004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:42.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.823+0000 7f2c4a800640 1 -- 172.21.15.123:0/1969044623 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c30003520 con 0x7f2c300039e0 2024-04-17T05:33:42.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.824+0000 7f2c4a800640 1 --2- 172.21.15.123:0/1969044623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c300039e0 0x7f2c30003e00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c009ac0 tx=0x7f2c30005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c6cd27bc74231f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:42.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.824+0000 7f2c49e00640 1 -- 172.21.15.123:0/1969044623 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c039070 con 0x7f2c300039e0 2024-04-17T05:33:42.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.824+0000 7f2c49e00640 1 -- 172.21.15.123:0/1969044623 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c3c02c710 con 0x7f2c300039e0 2024-04-17T05:33:42.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.824+0000 7f2c49e00640 1 -- 172.21.15.123:0/1969044623 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c009690 con 0x7f2c300039e0 2024-04-17T05:33:42.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.824+0000 7f2c50a00640 1 -- 172.21.15.123:0/1969044623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c300039e0 msgr2=0x7f2c30003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:42.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.824+0000 7f2c50a00640 1 --2- 172.21.15.123:0/1969044623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c300039e0 0x7f2c30003e00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c009ac0 tx=0x7f2c30005830 comp rx=0 tx=0).stop 2024-04-17T05:33:42.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.824+0000 7f2c4b200640 1 -- 172.21.15.123:0/1969044623 reap_dead start 2024-04-17T05:33:42.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.825+0000 7f2c50a00640 1 -- 172.21.15.123:0/1969044623 shutdown_connections 2024-04-17T05:33:42.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.825+0000 7f2c50a00640 1 -- 172.21.15.123:0/1969044623 >> 172.21.15.123:0/1969044623 conn(0x7f2c4c06c430 msgr2=0x7f2c4c0b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:42.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.825+0000 7f2c50a00640 1 -- 172.21.15.123:0/1969044623 shutdown_connections 2024-04-17T05:33:42.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.825+0000 7f2c50a00640 1 -- 172.21.15.123:0/1969044623 wait complete. 2024-04-17T05:33:42.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.826+0000 7f2c50a00640 1 Processor -- start 2024-04-17T05:33:42.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.826+0000 7f2c50a00640 1 -- start start 2024-04-17T05:33:42.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.827+0000 7f2c50a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c300039e0 0x7f2c4c1d2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:42.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.827+0000 7f2c50a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c4c1465f0 0x7f2c4c147750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:42.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.827+0000 7f2c50a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2c4c147c90 0x7f2c4c0aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:42.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.827+0000 7f2c50a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4c06d550 con 0x7f2c4c1465f0 2024-04-17T05:33:42.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.827+0000 7f2c50a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4c140360 con 0x7f2c300039e0 2024-04-17T05:33:42.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.827+0000 7f2c50a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f2c4c149110 con 0x7f2c4c147c90 2024-04-17T05:33:42.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.827+0000 7f2c43e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c4c1465f0 0x7f2c4c147750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:42.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.827+0000 7f2c43e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c4c1465f0 0x7f2c4c147750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39084/0 (socket says 172.21.15.123:39084) 2024-04-17T05:33:42.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.827+0000 7f2c43e00640 1 -- 172.21.15.123:0/3245914604 learned_addr learned my addr 172.21.15.123:0/3245914604 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:42.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.828+0000 7f2c4a800640 1 --2- 172.21.15.123:0/3245914604 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c300039e0 0x7f2c4c1d2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:42.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.828+0000 7f2c4b200640 1 --2- 172.21.15.123:0/3245914604 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2c4c147c90 0x7f2c4c0aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:42.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.828+0000 7f2c43e00640 1 -- 172.21.15.123:0/3245914604 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2c4c147c90 msgr2=0x7f2c4c0aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:42.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.828+0000 7f2c43e00640 1 --2- 172.21.15.123:0/3245914604 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2c4c147c90 0x7f2c4c0aeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:42.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.828+0000 7f2c43e00640 1 -- 172.21.15.123:0/3245914604 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c300039e0 msgr2=0x7f2c4c1d2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:42.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.828+0000 7f2c43e00640 1 --2- 172.21.15.123:0/3245914604 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c300039e0 0x7f2c4c1d2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:42.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.828+0000 7f2c43e00640 1 -- 172.21.15.123:0/3245914604 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c4c144600 con 0x7f2c4c1465f0 2024-04-17T05:33:42.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.828+0000 7f2c4a800640 1 --2- 172.21.15.123:0/3245914604 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c300039e0 0x7f2c4c1d2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T05:33:42.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.828+0000 7f2c43e00640 1 --2- 172.21.15.123:0/3245914604 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c4c1465f0 0x7f2c4c147750 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2c3400d800 tx=0x7f2c3400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:42.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.828+0000 7f2c42a00640 1 -- 172.21.15.123:0/3245914604 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c34019070 con 0x7f2c4c1465f0 2024-04-17T05:33:42.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.828+0000 7f2c42a00640 1 -- 172.21.15.123:0/3245914604 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c340074e0 con 0x7f2c4c1465f0 2024-04-17T05:33:42.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.828+0000 7f2c50a00640 1 -- 172.21.15.123:0/3245914604 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c4c144170 con 0x7f2c4c1465f0 2024-04-17T05:33:42.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.828+0000 7f2c42a00640 1 -- 172.21.15.123:0/3245914604 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c340049e0 con 0x7f2c4c1465f0 2024-04-17T05:33:42.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.829+0000 7f2c50a00640 1 -- 172.21.15.123:0/3245914604 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c4c147230 con 0x7f2c4c1465f0 2024-04-17T05:33:42.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.830+0000 7f2c50a00640 1 -- 172.21.15.123:0/3245914604 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c4c0b5290 con 0x7f2c4c1465f0 2024-04-17T05:33:42.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.830+0000 7f2c42a00640 1 -- 172.21.15.123:0/3245914604 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2c3401c070 con 0x7f2c4c1465f0 2024-04-17T05:33:42.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.831+0000 7f2c42a00640 1 --2- 172.21.15.123:0/3245914604 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f2c2806c8f0 0x7f2c2806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:42.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.831+0000 7f2c42a00640 1 -- 172.21.15.123:0/3245914604 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f2c3408bb40 con 0x7f2c4c1465f0 2024-04-17T05:33:42.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.832+0000 7f2c4a800640 1 --2- 172.21.15.123:0/3245914604 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f2c2806c8f0 0x7f2c2806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:42.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.833+0000 7f2c4a800640 1 --2- 172.21.15.123:0/3245914604 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f2c2806c8f0 0x7f2c2806edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c036000 tx=0x7f2c3c030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:42.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:42.836+0000 7f2c42a00640 1 -- 172.21.15.123:0/3245914604 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f2c4c0b5290 con 0x7f2c4c1465f0 2024-04-17T05:33:43.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.040+0000 7f2c50a00640 1 -- 172.21.15.123:0/3245914604 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2c4c143840 con 0x7f2c4c1465f0 2024-04-17T05:33:43.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.041+0000 7f2c42a00640 1 -- 172.21.15.123:0/3245914604 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) ==== 104+0+11 (secure 0 0 0) 0x7f2c34059ab0 con 0x7f2c4c1465f0 2024-04-17T05:33:43.039 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-04-17T05:33:43.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.043+0000 7f2c50a00640 1 -- 172.21.15.123:0/3245914604 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f2c2806c8f0 msgr2=0x7f2c2806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:43.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.043+0000 7f2c50a00640 1 --2- 172.21.15.123:0/3245914604 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f2c2806c8f0 0x7f2c2806edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c036000 tx=0x7f2c3c030000 comp rx=0 tx=0).stop 2024-04-17T05:33:43.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.043+0000 7f2c50a00640 1 -- 172.21.15.123:0/3245914604 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c4c1465f0 msgr2=0x7f2c4c147750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:43.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.043+0000 7f2c50a00640 1 --2- 172.21.15.123:0/3245914604 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c4c1465f0 0x7f2c4c147750 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2c3400d800 tx=0x7f2c3400dcc0 comp rx=0 tx=0).stop 2024-04-17T05:33:43.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.043+0000 7f2c50a00640 1 -- 172.21.15.123:0/3245914604 shutdown_connections 2024-04-17T05:33:43.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.043+0000 7f2c50a00640 1 --2- 172.21.15.123:0/3245914604 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f2c2806c8f0 0x7f2c2806edb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:43.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.043+0000 7f2c50a00640 1 --2- 172.21.15.123:0/3245914604 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2c4c147c90 0x7f2c4c0aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:43.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.043+0000 7f2c50a00640 1 --2- 172.21.15.123:0/3245914604 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c4c1465f0 0x7f2c4c147750 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:43.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.043+0000 7f2c50a00640 1 --2- 172.21.15.123:0/3245914604 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c300039e0 0x7f2c4c1d2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:43.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.043+0000 7f2c50a00640 1 -- 172.21.15.123:0/3245914604 >> 172.21.15.123:0/3245914604 conn(0x7f2c4c06c430 msgr2=0x7f2c4c09cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:43.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.043+0000 7f2c50a00640 1 -- 172.21.15.123:0/3245914604 shutdown_connections 2024-04-17T05:33:43.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.044+0000 7f2c50a00640 1 -- 172.21.15.123:0/3245914604 wait complete. 2024-04-17T05:33:43.062 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T05:33:43.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.278+0000 7f8656200640 1 Processor -- start 2024-04-17T05:33:43.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.278+0000 7f8656200640 1 -- start start 2024-04-17T05:33:43.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.279+0000 7f8656200640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f86500b9b20 0x7f865006d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:43.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.279+0000 7f8656200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f865006dd10 0x7f8650149420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:43.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.279+0000 7f8656200640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86500b83f0 con 0x7f865006d610 2024-04-17T05:33:43.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.279+0000 7f8656200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f8650149060 con 0x7f865006dd10 2024-04-17T05:33:43.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.280+0000 7f8656200640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f86500b7600 con 0x7f86500b9b20 2024-04-17T05:33:43.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.280+0000 7f864ea00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f865006dd10 0x7f8650149420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:43.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.280+0000 7f864ea00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f865006dd10 0x7f8650149420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39090/0 (socket says 172.21.15.123:39090) 2024-04-17T05:33:43.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.280+0000 7f864ea00640 1 -- 172.21.15.123:0/3610194143 learned_addr learned my addr 172.21.15.123:0/3610194143 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:43.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.280+0000 7f864f400640 1 --2- 172.21.15.123:0/3610194143 >> v2:172.21.15.164:3300/0 conn(0x7f86500b9b20 0x7f865006d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:43.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.280+0000 7f864ea00640 1 -- 172.21.15.123:0/3610194143 >> v2:172.21.15.164:3300/0 conn(0x7f86500b9b20 msgr2=0x7f865006d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:43.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.280+0000 7f864ea00640 1 --2- 172.21.15.123:0/3610194143 >> v2:172.21.15.164:3300/0 conn(0x7f86500b9b20 0x7f865006d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:43.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.280+0000 7f864ea00640 1 -- 172.21.15.123:0/3610194143 >> v1:172.21.15.164:6789/0 conn(0x7f865006d610 legacy=0x7f8650149960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:43.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.281+0000 7f864ea00640 1 -- 172.21.15.123:0/3610194143 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86500b9f00 con 0x7f865006dd10 2024-04-17T05:33:43.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.282+0000 7f864ea00640 1 --2- 172.21.15.123:0/3610194143 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f865006dd10 0x7f8650149420 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f86500b7000 tx=0x7f863c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f84f57d8640c38 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:43.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.282+0000 7f864e000640 1 -- 172.21.15.123:0/3610194143 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863c035020 con 0x7f865006dd10 2024-04-17T05:33:43.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.282+0000 7f864e000640 1 -- 172.21.15.123:0/3610194143 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f863c031870 con 0x7f865006dd10 2024-04-17T05:33:43.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.282+0000 7f864e000640 1 -- 172.21.15.123:0/3610194143 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863c031c40 con 0x7f865006dd10 2024-04-17T05:33:43.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.283+0000 7f8656200640 1 -- 172.21.15.123:0/3610194143 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f865006dd10 msgr2=0x7f8650149420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:43.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.283+0000 7f8656200640 1 --2- 172.21.15.123:0/3610194143 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f865006dd10 0x7f8650149420 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f86500b7000 tx=0x7f863c02b910 comp rx=0 tx=0).stop 2024-04-17T05:33:43.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.283+0000 7f8656200640 1 -- 172.21.15.123:0/3610194143 shutdown_connections 2024-04-17T05:33:43.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.283+0000 7f8656200640 1 --2- 172.21.15.123:0/3610194143 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f865006dd10 0x7f8650149420 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:43.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.283+0000 7f8656200640 1 --2- 172.21.15.123:0/3610194143 >> v2:172.21.15.164:3300/0 conn(0x7f86500b9b20 0x7f865006d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:43.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.283+0000 7f8656200640 1 -- 172.21.15.123:0/3610194143 >> 172.21.15.123:0/3610194143 conn(0x7f865006bda0 msgr2=0x7f865006c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:43.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.283+0000 7f8656200640 1 -- 172.21.15.123:0/3610194143 shutdown_connections 2024-04-17T05:33:43.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.283+0000 7f8656200640 1 -- 172.21.15.123:0/3610194143 wait complete. 2024-04-17T05:33:43.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.285+0000 7f8656200640 1 Processor -- start 2024-04-17T05:33:43.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.285+0000 7f8656200640 1 -- start start 2024-04-17T05:33:43.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.285+0000 7f8656200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f865006d610 0x7f8650145850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:43.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.286+0000 7f8656200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f865006dd10 0x7f8650072210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:43.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.286+0000 7f8656200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86500b9b20 0x7f86501dea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:43.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.286+0000 7f8656200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f86500b8dd0 con 0x7f86500b9b20 2024-04-17T05:33:43.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.286+0000 7f8656200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f86500b8660 con 0x7f865006dd10 2024-04-17T05:33:43.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.286+0000 7f8656200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f86500b90b0 con 0x7f865006d610 2024-04-17T05:33:43.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.286+0000 7f864fe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86500b9b20 0x7f86501dea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:43.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.286+0000 7f864fe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86500b9b20 0x7f86501dea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39092/0 (socket says 172.21.15.123:39092) 2024-04-17T05:33:43.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.286+0000 7f864fe00640 1 -- 172.21.15.123:0/2880464687 learned_addr learned my addr 172.21.15.123:0/2880464687 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:43.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.286+0000 7f864f400640 1 --2- 172.21.15.123:0/2880464687 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f865006d610 0x7f8650145850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:43.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.286+0000 7f864ea00640 1 --2- 172.21.15.123:0/2880464687 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f865006dd10 0x7f8650072210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:43.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.286+0000 7f864fe00640 1 -- 172.21.15.123:0/2880464687 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f865006d610 msgr2=0x7f8650145850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:43.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.286+0000 7f864fe00640 1 --2- 172.21.15.123:0/2880464687 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f865006d610 0x7f8650145850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:43.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.287+0000 7f864fe00640 1 -- 172.21.15.123:0/2880464687 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f865006dd10 msgr2=0x7f8650072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:43.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.287+0000 7f864fe00640 1 --2- 172.21.15.123:0/2880464687 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f865006dd10 0x7f8650072210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:43.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.287+0000 7f864fe00640 1 -- 172.21.15.123:0/2880464687 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8650072750 con 0x7f86500b9b20 2024-04-17T05:33:43.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.287+0000 7f864fe00640 1 --2- 172.21.15.123:0/2880464687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86500b9b20 0x7f86501dea20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f864800c780 tx=0x7f864800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:43.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.287+0000 7f8647400640 1 -- 172.21.15.123:0/2880464687 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8648004b10 con 0x7f86500b9b20 2024-04-17T05:33:43.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.287+0000 7f8647400640 1 -- 172.21.15.123:0/2880464687 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8648004cb0 con 0x7f86500b9b20 2024-04-17T05:33:43.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.287+0000 7f8656200640 1 -- 172.21.15.123:0/2880464687 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f865009dfb0 con 0x7f86500b9b20 2024-04-17T05:33:43.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.287+0000 7f8647400640 1 -- 172.21.15.123:0/2880464687 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f864800aa90 con 0x7f86500b9b20 2024-04-17T05:33:43.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.287+0000 7f8656200640 1 -- 172.21.15.123:0/2880464687 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8650072cb0 con 0x7f86500b9b20 2024-04-17T05:33:43.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.288+0000 7f8656200640 1 -- 172.21.15.123:0/2880464687 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8650075bd0 con 0x7f86500b9b20 2024-04-17T05:33:43.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.289+0000 7f8647400640 1 -- 172.21.15.123:0/2880464687 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f864800ac30 con 0x7f86500b9b20 2024-04-17T05:33:43.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.290+0000 7f8647400640 1 --2- 172.21.15.123:0/2880464687 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f863006c920 0x7f863006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:43.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.290+0000 7f8647400640 1 -- 172.21.15.123:0/2880464687 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f864808c110 con 0x7f86500b9b20 2024-04-17T05:33:43.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.291+0000 7f864f400640 1 --2- 172.21.15.123:0/2880464687 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f863006c920 0x7f863006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:43.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.292+0000 7f864f400640 1 --2- 172.21.15.123:0/2880464687 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f863006c920 0x7f863006ede0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8640006fd0 tx=0x7f8640008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:43.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.295+0000 7f8647400640 1 -- 172.21.15.123:0/2880464687 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f8648020070 con 0x7f86500b9b20 2024-04-17T05:33:43.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.497+0000 7f8656200640 1 -- 172.21.15.123:0/2880464687 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8650149a80 con 0x7f86500b9b20 2024-04-17T05:33:43.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.497+0000 7f8647400640 1 -- 172.21.15.123:0/2880464687 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) ==== 100+0+11 (secure 0 0 0) 0x7f8650072750 con 0x7f86500b9b20 2024-04-17T05:33:43.495 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-04-17T05:33:43.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.500+0000 7f8656200640 1 -- 172.21.15.123:0/2880464687 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f863006c920 msgr2=0x7f863006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:43.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.500+0000 7f8656200640 1 --2- 172.21.15.123:0/2880464687 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f863006c920 0x7f863006ede0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8640006fd0 tx=0x7f8640008040 comp rx=0 tx=0).stop 2024-04-17T05:33:43.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.500+0000 7f8656200640 1 -- 172.21.15.123:0/2880464687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86500b9b20 msgr2=0x7f86501dea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:43.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.500+0000 7f8656200640 1 --2- 172.21.15.123:0/2880464687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86500b9b20 0x7f86501dea20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f864800c780 tx=0x7f864800cc40 comp rx=0 tx=0).stop 2024-04-17T05:33:43.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.500+0000 7f8656200640 1 -- 172.21.15.123:0/2880464687 shutdown_connections 2024-04-17T05:33:43.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.500+0000 7f8656200640 1 --2- 172.21.15.123:0/2880464687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86500b9b20 0x7f86501dea20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:43.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.500+0000 7f8656200640 1 --2- 172.21.15.123:0/2880464687 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f865006dd10 0x7f8650072210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:43.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.500+0000 7f8656200640 1 --2- 172.21.15.123:0/2880464687 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f863006c920 0x7f863006ede0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:43.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.500+0000 7f8656200640 1 --2- 172.21.15.123:0/2880464687 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f865006d610 0x7f8650145850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:43.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.500+0000 7f8656200640 1 -- 172.21.15.123:0/2880464687 >> 172.21.15.123:0/2880464687 conn(0x7f865006bda0 msgr2=0x7f86501cee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:43.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.500+0000 7f8656200640 1 -- 172.21.15.123:0/2880464687 shutdown_connections 2024-04-17T05:33:43.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.500+0000 7f8656200640 1 -- 172.21.15.123:0/2880464687 wait complete. 2024-04-17T05:33:43.518 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T05:33:43.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.726+0000 7f73da200640 1 Processor -- start 2024-04-17T05:33:43.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.726+0000 7f73da200640 1 -- start start 2024-04-17T05:33:43.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.728+0000 7f73da200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73d40b58f0 0x7f73d41482f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:43.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.728+0000 7f73da200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73d40b65d0 con 0x7f73d40b61f0 2024-04-17T05:33:43.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.728+0000 7f73da200640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73d40b75a0 con 0x7f73d4147ed0 2024-04-17T05:33:43.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.728+0000 7f73da200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f73d40b4d50 con 0x7f73d40b58f0 2024-04-17T05:33:43.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.728+0000 7f73d8e00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f73d40b61f0 0x7f73d40b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42110/0 (socket says 172.21.15.123:42110) 2024-04-17T05:33:43.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.728+0000 7f73d8e00640 1 -- 172.21.15.123:0/4248160132 learned_addr learned my addr 172.21.15.123:0/4248160132 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:33:43.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.729+0000 7f73d3400640 1 -- 172.21.15.123:0/4248160132 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2557772018 0 0) 0x7f73d40b65d0 con 0x7f73d40b61f0 2024-04-17T05:33:43.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.729+0000 7f73d3400640 1 -- 172.21.15.123:0/4248160132 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73b4003520 con 0x7f73d40b61f0 2024-04-17T05:33:43.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.729+0000 7f73d9800640 1 --2- 172.21.15.123:0/4248160132 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73d40b58f0 0x7f73d41482f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:43.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.729+0000 7f73d3400640 1 -- 172.21.15.123:0/4248160132 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1577033118 0 0) 0x7f73b4003520 con 0x7f73d40b61f0 2024-04-17T05:33:43.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.729+0000 7f73d3400640 1 -- 172.21.15.123:0/4248160132 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73d40b58f0 msgr2=0x7f73d41482f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:43.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.729+0000 7f73d3400640 1 --2- 172.21.15.123:0/4248160132 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73d40b58f0 0x7f73d41482f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:43.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.729+0000 7f73d3400640 1 -- 172.21.15.123:0/4248160132 >> v1:172.21.15.164:6789/0 conn(0x7f73d4147ed0 legacy=0x7f73d40b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:43.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.729+0000 7f73d3400640 1 -- 172.21.15.123:0/4248160132 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73d40b49e0 con 0x7f73d40b61f0 2024-04-17T05:33:43.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.729+0000 7f73d3400640 1 -- 172.21.15.123:0/4248160132 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1042962670 0 0) 0x7f73c4001670 con 0x7f73d40b61f0 2024-04-17T05:33:43.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.729+0000 7f73d3400640 1 -- 172.21.15.123:0/4248160132 >> v1:172.21.15.123:6789/0 conn(0x7f73d40b61f0 legacy=0x7f73d40b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:43.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.729+0000 7f73d3400640 1 --2- 172.21.15.123:0/4248160132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73b40039e0 0x7f73b4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:43.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.729+0000 7f73d3400640 1 --2- 172.21.15.123:0/4248160132 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73d40b58f0 0x7f73b4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:43.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.729+0000 7f73d3400640 1 --2- 172.21.15.123:0/4248160132 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73b4004d40 0x7f73b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:43.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.729+0000 7f73d3400640 1 -- 172.21.15.123:0/4248160132 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f73d40b4d50 con 0x7f73b40039e0 2024-04-17T05:33:43.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.729+0000 7f73d3400640 1 -- 172.21.15.123:0/4248160132 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f73b400bba0 con 0x7f73b4004d40 2024-04-17T05:33:43.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.729+0000 7f73d3400640 1 -- 172.21.15.123:0/4248160132 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f73b400bda0 con 0x7f73d40b58f0 2024-04-17T05:33:43.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.730+0000 7f73d8e00640 1 --2- 172.21.15.123:0/4248160132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73b40039e0 0x7f73b4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:43.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.730+0000 7f73d8e00640 1 -- 172.21.15.123:0/4248160132 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73d40b58f0 msgr2=0x7f73b4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:43.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.730+0000 7f73d3e00640 1 --2- 172.21.15.123:0/4248160132 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73d40b58f0 0x7f73b4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:43.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.730+0000 7f73d9800640 1 --2- 172.21.15.123:0/4248160132 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73b4004d40 0x7f73b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:43.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.730+0000 7f73d8e00640 1 --2- 172.21.15.123:0/4248160132 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73d40b58f0 0x7f73b4004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:43.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.730+0000 7f73d8e00640 1 -- 172.21.15.123:0/4248160132 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73b4004d40 msgr2=0x7f73b40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:43.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.730+0000 7f73d8e00640 1 --2- 172.21.15.123:0/4248160132 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73b4004d40 0x7f73b40051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:43.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.730+0000 7f73d8e00640 1 -- 172.21.15.123:0/4248160132 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73b4003520 con 0x7f73b40039e0 2024-04-17T05:33:43.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.731+0000 7f73d8e00640 1 --2- 172.21.15.123:0/4248160132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73b40039e0 0x7f73b4003e00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f73c400c0e0 tx=0x7f73b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=221952a7509dff8c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:43.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.731+0000 7f73d3400640 1 -- 172.21.15.123:0/4248160132 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c4007c20 con 0x7f73b40039e0 2024-04-17T05:33:43.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.731+0000 7f73d3400640 1 -- 172.21.15.123:0/4248160132 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73c4030070 con 0x7f73b40039e0 2024-04-17T05:33:43.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.731+0000 7f73d3400640 1 -- 172.21.15.123:0/4248160132 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c4005d30 con 0x7f73b40039e0 2024-04-17T05:33:43.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.732+0000 7f73da200640 1 -- 172.21.15.123:0/4248160132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73b40039e0 msgr2=0x7f73b4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:43.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.732+0000 7f73da200640 1 --2- 172.21.15.123:0/4248160132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73b40039e0 0x7f73b4003e00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f73c400c0e0 tx=0x7f73b4005830 comp rx=0 tx=0).stop 2024-04-17T05:33:43.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.732+0000 7f73d9800640 1 -- 172.21.15.123:0/4248160132 reap_dead start 2024-04-17T05:33:43.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.732+0000 7f73da200640 1 -- 172.21.15.123:0/4248160132 shutdown_connections 2024-04-17T05:33:43.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.732+0000 7f73da200640 1 -- 172.21.15.123:0/4248160132 >> 172.21.15.123:0/4248160132 conn(0x7f73d406c260 msgr2=0x7f73d40b9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:43.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.732+0000 7f73da200640 1 -- 172.21.15.123:0/4248160132 shutdown_connections 2024-04-17T05:33:43.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.732+0000 7f73da200640 1 -- 172.21.15.123:0/4248160132 wait complete. 2024-04-17T05:33:43.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.734+0000 7f73da200640 1 Processor -- start 2024-04-17T05:33:43.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.734+0000 7f73da200640 1 -- start start 2024-04-17T05:33:43.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.735+0000 7f73da200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73b40039e0 0x7f73d41dded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:43.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.735+0000 7f73da200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73d4137500 0x7f73d4144ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:43.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.735+0000 7f73da200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73d41450e0 0x7f73d41360d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:43.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.735+0000 7f73da200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f73d4148470 con 0x7f73d41450e0 2024-04-17T05:33:43.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.735+0000 7f73da200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f73d41482f0 con 0x7f73d4137500 2024-04-17T05:33:43.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.735+0000 7f73da200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f73d41485f0 con 0x7f73b40039e0 2024-04-17T05:33:43.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.735+0000 7f73d9800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73d41450e0 0x7f73d41360d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:43.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.736+0000 7f73d9800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73d41450e0 0x7f73d41360d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39110/0 (socket says 172.21.15.123:39110) 2024-04-17T05:33:43.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.736+0000 7f73d9800640 1 -- 172.21.15.123:0/4038956058 learned_addr learned my addr 172.21.15.123:0/4038956058 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:43.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.736+0000 7f73d3e00640 1 --2- 172.21.15.123:0/4038956058 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73d4137500 0x7f73d4144ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:43.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.736+0000 7f73d8e00640 1 --2- 172.21.15.123:0/4038956058 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73b40039e0 0x7f73d41dded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:43.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.736+0000 7f73d9800640 1 -- 172.21.15.123:0/4038956058 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73b40039e0 msgr2=0x7f73d41dded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:43.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.736+0000 7f73d9800640 1 --2- 172.21.15.123:0/4038956058 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73b40039e0 0x7f73d41dded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:43.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.736+0000 7f73d9800640 1 -- 172.21.15.123:0/4038956058 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73d4137500 msgr2=0x7f73d4144ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:43.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.736+0000 7f73d9800640 1 --2- 172.21.15.123:0/4038956058 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73d4137500 0x7f73d4144ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:43.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.736+0000 7f73d9800640 1 -- 172.21.15.123:0/4038956058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73d41385f0 con 0x7f73d41450e0 2024-04-17T05:33:43.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.736+0000 7f73d9800640 1 --2- 172.21.15.123:0/4038956058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73d41450e0 0x7f73d41360d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f73d40b79c0 tx=0x7f73cc00e8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:43.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.736+0000 7f73d0c00640 1 -- 172.21.15.123:0/4038956058 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73cc017020 con 0x7f73d41450e0 2024-04-17T05:33:43.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.737+0000 7f73d0c00640 1 -- 172.21.15.123:0/4038956058 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73cc013630 con 0x7f73d41450e0 2024-04-17T05:33:43.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.737+0000 7f73da200640 1 -- 172.21.15.123:0/4038956058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73d41de4b0 con 0x7f73d41450e0 2024-04-17T05:33:43.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.737+0000 7f73d0c00640 1 -- 172.21.15.123:0/4038956058 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73cc00f040 con 0x7f73d41450e0 2024-04-17T05:33:43.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.737+0000 7f73da200640 1 -- 172.21.15.123:0/4038956058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73d4141540 con 0x7f73d41450e0 2024-04-17T05:33:43.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.738+0000 7f73da200640 1 -- 172.21.15.123:0/4038956058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73d4075b30 con 0x7f73d41450e0 2024-04-17T05:33:43.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.739+0000 7f73d0c00640 1 -- 172.21.15.123:0/4038956058 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f73cc01a020 con 0x7f73d41450e0 2024-04-17T05:33:43.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.740+0000 7f73d0c00640 1 --2- 172.21.15.123:0/4038956058 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f73b006c920 0x7f73b006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:43.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.740+0000 7f73d0c00640 1 -- 172.21.15.123:0/4038956058 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f73cc08b630 con 0x7f73d41450e0 2024-04-17T05:33:43.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.740+0000 7f73d8e00640 1 --2- 172.21.15.123:0/4038956058 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f73b006c920 0x7f73b006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:43.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.741+0000 7f73d8e00640 1 --2- 172.21.15.123:0/4038956058 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f73b006c920 0x7f73b006ede0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f73c4034000 tx=0x7f73c4007000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:43.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.744+0000 7f73d0c00640 1 -- 172.21.15.123:0/4038956058 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f73cc021030 con 0x7f73d41450e0 2024-04-17T05:33:43.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.944+0000 7f73da200640 1 -- 172.21.15.123:0/4038956058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f73d41378e0 con 0x7f73d41450e0 2024-04-17T05:33:43.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.945+0000 7f73d0c00640 1 -- 172.21.15.123:0/4038956058 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) ==== 103+0+11 (secure 0 0 0) 0x7f73cc059630 con 0x7f73d41450e0 2024-04-17T05:33:43.943 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-04-17T05:33:43.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.947+0000 7f73da200640 1 -- 172.21.15.123:0/4038956058 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f73b006c920 msgr2=0x7f73b006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:43.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.947+0000 7f73da200640 1 --2- 172.21.15.123:0/4038956058 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f73b006c920 0x7f73b006ede0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f73c4034000 tx=0x7f73c4007000 comp rx=0 tx=0).stop 2024-04-17T05:33:43.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.947+0000 7f73da200640 1 -- 172.21.15.123:0/4038956058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73d41450e0 msgr2=0x7f73d41360d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:43.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.947+0000 7f73da200640 1 --2- 172.21.15.123:0/4038956058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73d41450e0 0x7f73d41360d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f73d40b79c0 tx=0x7f73cc00e8b0 comp rx=0 tx=0).stop 2024-04-17T05:33:43.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.948+0000 7f73da200640 1 -- 172.21.15.123:0/4038956058 shutdown_connections 2024-04-17T05:33:43.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.948+0000 7f73da200640 1 --2- 172.21.15.123:0/4038956058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73d41450e0 0x7f73d41360d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:43.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.948+0000 7f73da200640 1 --2- 172.21.15.123:0/4038956058 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73d4137500 0x7f73d4144ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:43.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.948+0000 7f73da200640 1 --2- 172.21.15.123:0/4038956058 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f73b006c920 0x7f73b006ede0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:43.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.948+0000 7f73da200640 1 --2- 172.21.15.123:0/4038956058 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f73b40039e0 0x7f73d41dded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:43.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.948+0000 7f73da200640 1 -- 172.21.15.123:0/4038956058 >> 172.21.15.123:0/4038956058 conn(0x7f73d406c260 msgr2=0x7f73d40bb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:43.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.948+0000 7f73da200640 1 -- 172.21.15.123:0/4038956058 shutdown_connections 2024-04-17T05:33:43.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:43.948+0000 7f73da200640 1 -- 172.21.15.123:0/4038956058 wait complete. 2024-04-17T05:33:43.966 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-17T05:33:44.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.171+0000 7f8a3ea00640 1 Processor -- start 2024-04-17T05:33:44.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.171+0000 7f8a3ea00640 1 -- start start 2024-04-17T05:33:44.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.172+0000 7f8a3ea00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8a380b4bd0 0x7f8a380b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:44.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.172+0000 7f8a3ea00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a380730d0 0x7f8a3806da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:44.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.172+0000 7f8a3ea00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f8a3806df60 0x7f8a38149840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:44.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.173+0000 7f8a3ea00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f8a380ba130 con 0x7f8a380b4bd0 2024-04-17T05:33:44.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.173+0000 7f8a3ea00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f8a38140360 con 0x7f8a3806df60 2024-04-17T05:33:44.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.173+0000 7f8a3ea00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f8a3806d550 con 0x7f8a380730d0 2024-04-17T05:33:44.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.173+0000 7f8a3d600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8a380b4bd0 0x7f8a380b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:44.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.173+0000 7f8a3d600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8a380b4bd0 0x7f8a380b3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39122/0 (socket says 172.21.15.123:39122) 2024-04-17T05:33:44.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.173+0000 7f8a3d600640 1 -- 172.21.15.123:0/653816700 learned_addr learned my addr 172.21.15.123:0/653816700 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:44.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.173+0000 7f8a3d600640 1 -- 172.21.15.123:0/653816700 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a380730d0 msgr2=0x7f8a3806da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:44.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.173+0000 7f8a3d600640 1 --2- 172.21.15.123:0/653816700 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a380730d0 0x7f8a3806da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:44.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.173+0000 7f8a3d600640 1 -- 172.21.15.123:0/653816700 >> v2:172.21.15.164:3300/0 conn(0x7f8a3806df60 msgr2=0x7f8a38149840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:44.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.173+0000 7f8a3d600640 1 --2- 172.21.15.123:0/653816700 >> v2:172.21.15.164:3300/0 conn(0x7f8a3806df60 0x7f8a38149840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:44.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.173+0000 7f8a3d600640 1 -- 172.21.15.123:0/653816700 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a380b4fb0 con 0x7f8a380b4bd0 2024-04-17T05:33:44.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.174+0000 7f8a3d600640 1 --2- 172.21.15.123:0/653816700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a380b4bd0 0x7f8a380b3bd0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8a380b04f0 tx=0x7f8a2c02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e24db1a12c74c54 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:44.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.175+0000 7f8a37e00640 1 -- 172.21.15.123:0/653816700 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c038070 con 0x7f8a380b4bd0 2024-04-17T05:33:44.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.175+0000 7f8a37e00640 1 -- 172.21.15.123:0/653816700 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a2c02f050 con 0x7f8a380b4bd0 2024-04-17T05:33:44.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.175+0000 7f8a37e00640 1 -- 172.21.15.123:0/653816700 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c031970 con 0x7f8a380b4bd0 2024-04-17T05:33:44.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.175+0000 7f8a3ea00640 1 -- 172.21.15.123:0/653816700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a380b4bd0 msgr2=0x7f8a380b3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:44.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.175+0000 7f8a3ea00640 1 --2- 172.21.15.123:0/653816700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a380b4bd0 0x7f8a380b3bd0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8a380b04f0 tx=0x7f8a2c02b7f0 comp rx=0 tx=0).stop 2024-04-17T05:33:44.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.175+0000 7f8a3ea00640 1 -- 172.21.15.123:0/653816700 shutdown_connections 2024-04-17T05:33:44.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.175+0000 7f8a3ea00640 1 --2- 172.21.15.123:0/653816700 >> v2:172.21.15.164:3300/0 conn(0x7f8a3806df60 0x7f8a38149840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:44.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.175+0000 7f8a3ea00640 1 --2- 172.21.15.123:0/653816700 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a380730d0 0x7f8a3806da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:44.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.175+0000 7f8a3ea00640 1 --2- 172.21.15.123:0/653816700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a380b4bd0 0x7f8a380b3bd0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:44.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.176+0000 7f8a3ea00640 1 -- 172.21.15.123:0/653816700 >> 172.21.15.123:0/653816700 conn(0x7f8a3806c430 msgr2=0x7f8a380b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:44.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.176+0000 7f8a3ea00640 1 -- 172.21.15.123:0/653816700 shutdown_connections 2024-04-17T05:33:44.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.176+0000 7f8a3ea00640 1 -- 172.21.15.123:0/653816700 wait complete. 2024-04-17T05:33:44.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.177+0000 7f8a3ea00640 1 Processor -- start 2024-04-17T05:33:44.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.177+0000 7f8a3ea00640 1 -- start start 2024-04-17T05:33:44.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.178+0000 7f8a3ea00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a3806df60 0x7f8a381d0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:44.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.178+0000 7f8a3ea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a380730d0 0x7f8a38070920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:44.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.178+0000 7f8a3ea00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a380b4bd0 0x7f8a381d1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:44.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.178+0000 7f8a3ea00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8a38149110 con 0x7f8a3806df60 2024-04-17T05:33:44.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.178+0000 7f8a3ea00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3806d1e0 con 0x7f8a380730d0 2024-04-17T05:33:44.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.178+0000 7f8a3ea00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f8a38149d80 con 0x7f8a380b4bd0 2024-04-17T05:33:44.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.178+0000 7f8a3d600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a3806df60 0x7f8a381d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:44.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.178+0000 7f8a3d600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a3806df60 0x7f8a381d0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39128/0 (socket says 172.21.15.123:39128) 2024-04-17T05:33:44.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.178+0000 7f8a3d600640 1 -- 172.21.15.123:0/3086200714 learned_addr learned my addr 172.21.15.123:0/3086200714 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:44.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.179+0000 7f8a3cc00640 1 --2- 172.21.15.123:0/3086200714 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a380730d0 0x7f8a38070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:44.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.179+0000 7f8a3e000640 1 --2- 172.21.15.123:0/3086200714 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a380b4bd0 0x7f8a381d1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:44.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.179+0000 7f8a3d600640 1 -- 172.21.15.123:0/3086200714 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a380b4bd0 msgr2=0x7f8a381d1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:44.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.179+0000 7f8a3d600640 1 --2- 172.21.15.123:0/3086200714 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a380b4bd0 0x7f8a381d1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:44.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.179+0000 7f8a3d600640 1 -- 172.21.15.123:0/3086200714 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a380730d0 msgr2=0x7f8a38070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:44.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.179+0000 7f8a3d600640 1 --2- 172.21.15.123:0/3086200714 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a380730d0 0x7f8a38070920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:44.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.179+0000 7f8a3d600640 1 -- 172.21.15.123:0/3086200714 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a38070140 con 0x7f8a3806df60 2024-04-17T05:33:44.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.179+0000 7f8a3d600640 1 --2- 172.21.15.123:0/3086200714 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a3806df60 0x7f8a381d0920 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c000c00 tx=0x7f8a2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:44.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.180+0000 7f8a35600640 1 -- 172.21.15.123:0/3086200714 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c043070 con 0x7f8a3806df60 2024-04-17T05:33:44.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.180+0000 7f8a35600640 1 -- 172.21.15.123:0/3086200714 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a2c03f890 con 0x7f8a3806df60 2024-04-17T05:33:44.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.180+0000 7f8a3ea00640 1 -- 172.21.15.123:0/3086200714 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a381d1090 con 0x7f8a3806df60 2024-04-17T05:33:44.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.180+0000 7f8a35600640 1 -- 172.21.15.123:0/3086200714 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c038040 con 0x7f8a3806df60 2024-04-17T05:33:44.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.180+0000 7f8a3ea00640 1 -- 172.21.15.123:0/3086200714 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a38070e60 con 0x7f8a3806df60 2024-04-17T05:33:44.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.181+0000 7f8a3ea00640 1 -- 172.21.15.123:0/3086200714 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a381d0eb0 con 0x7f8a3806df60 2024-04-17T05:33:44.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.182+0000 7f8a35600640 1 -- 172.21.15.123:0/3086200714 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8a2c046070 con 0x7f8a3806df60 2024-04-17T05:33:44.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.183+0000 7f8a35600640 1 --2- 172.21.15.123:0/3086200714 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8a1806c8f0 0x7f8a1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:44.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.183+0000 7f8a35600640 1 -- 172.21.15.123:0/3086200714 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f8a2c0adc70 con 0x7f8a3806df60 2024-04-17T05:33:44.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.183+0000 7f8a3cc00640 1 --2- 172.21.15.123:0/3086200714 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8a1806c8f0 0x7f8a1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:44.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.185+0000 7f8a3cc00640 1 --2- 172.21.15.123:0/3086200714 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8a1806c8f0 0x7f8a1806edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8a380b4930 tx=0x7f8a24008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:44.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.187+0000 7f8a35600640 1 -- 172.21.15.123:0/3086200714 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f8a381d0eb0 con 0x7f8a3806df60 2024-04-17T05:33:44.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.401+0000 7f8a3ea00640 1 -- 172.21.15.123:0/3086200714 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8a38075b30 con 0x7f8a3806df60 2024-04-17T05:33:44.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.402+0000 7f8a35600640 1 -- 172.21.15.123:0/3086200714 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7f8a2c07be30 con 0x7f8a3806df60 2024-04-17T05:33:44.400 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-04-17T05:33:44.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.405+0000 7f8a3ea00640 1 -- 172.21.15.123:0/3086200714 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8a1806c8f0 msgr2=0x7f8a1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:44.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.405+0000 7f8a3ea00640 1 --2- 172.21.15.123:0/3086200714 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8a1806c8f0 0x7f8a1806edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8a380b4930 tx=0x7f8a24008040 comp rx=0 tx=0).stop 2024-04-17T05:33:44.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.405+0000 7f8a3ea00640 1 -- 172.21.15.123:0/3086200714 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a3806df60 msgr2=0x7f8a381d0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:44.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.405+0000 7f8a3ea00640 1 --2- 172.21.15.123:0/3086200714 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a3806df60 0x7f8a381d0920 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c000c00 tx=0x7f8a2c0046c0 comp rx=0 tx=0).stop 2024-04-17T05:33:44.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.405+0000 7f8a3ea00640 1 -- 172.21.15.123:0/3086200714 shutdown_connections 2024-04-17T05:33:44.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.405+0000 7f8a3ea00640 1 --2- 172.21.15.123:0/3086200714 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8a1806c8f0 0x7f8a1806edb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:44.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.405+0000 7f8a3ea00640 1 --2- 172.21.15.123:0/3086200714 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8a380b4bd0 0x7f8a381d1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:44.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.405+0000 7f8a3ea00640 1 --2- 172.21.15.123:0/3086200714 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a380730d0 0x7f8a38070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:44.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.405+0000 7f8a3ea00640 1 --2- 172.21.15.123:0/3086200714 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a3806df60 0x7f8a381d0920 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:44.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.405+0000 7f8a3ea00640 1 -- 172.21.15.123:0/3086200714 >> 172.21.15.123:0/3086200714 conn(0x7f8a3806c430 msgr2=0x7f8a3809b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:44.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.405+0000 7f8a3ea00640 1 -- 172.21.15.123:0/3086200714 shutdown_connections 2024-04-17T05:33:44.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.405+0000 7f8a3ea00640 1 -- 172.21.15.123:0/3086200714 wait complete. 2024-04-17T05:33:44.422 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-17T05:33:44.422 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T05:33:44.474 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T05:33:44.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.687+0000 7fd620800640 1 Processor -- start 2024-04-17T05:33:44.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.687+0000 7fd620800640 1 -- start start 2024-04-17T05:33:44.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.688+0000 7fd620800640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd61806db60 0x7fd61809cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:44.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.688+0000 7fd620800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6181480e0 0x7fd61814ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:44.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.688+0000 7fd620800640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd61806df40 con 0x7fd6180afc60 2024-04-17T05:33:44.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.688+0000 7fd620800640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7fd61809d4c0 con 0x7fd61806db60 2024-04-17T05:33:44.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.688+0000 7fd620800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fd618073f80 con 0x7fd6181480e0 2024-04-17T05:33:44.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.689+0000 7fd61d400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd6180afc60 0x7fd6181479d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42122/0 (socket says 172.21.15.123:42122) 2024-04-17T05:33:44.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.689+0000 7fd61d400640 1 -- 172.21.15.123:0/1273479256 learned_addr learned my addr 172.21.15.123:0/1273479256 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:33:44.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.689+0000 7fd61e800640 1 --2- 172.21.15.123:0/1273479256 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6181480e0 0x7fd61814ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:44.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.689+0000 7fd61de00640 1 --2- 172.21.15.123:0/1273479256 >> v2:172.21.15.164:3300/0 conn(0x7fd61806db60 0x7fd61809cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:44.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.689+0000 7fd61ca00640 1 -- 172.21.15.123:0/1273479256 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2382604445 0 0) 0x7fd61806df40 con 0x7fd6180afc60 2024-04-17T05:33:44.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.689+0000 7fd61ca00640 1 -- 172.21.15.123:0/1273479256 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd600003520 con 0x7fd6180afc60 2024-04-17T05:33:44.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.689+0000 7fd61ca00640 1 -- 172.21.15.123:0/1273479256 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3675244443 0 0) 0x7fd600003520 con 0x7fd6180afc60 2024-04-17T05:33:44.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.689+0000 7fd61ca00640 1 -- 172.21.15.123:0/1273479256 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6181480e0 msgr2=0x7fd61814ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:44.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.689+0000 7fd61ca00640 1 --2- 172.21.15.123:0/1273479256 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6181480e0 0x7fd61814ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:44.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.689+0000 7fd61ca00640 1 -- 172.21.15.123:0/1273479256 >> v2:172.21.15.164:3300/0 conn(0x7fd61806db60 msgr2=0x7fd61809cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:44.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.689+0000 7fd61ca00640 1 --2- 172.21.15.123:0/1273479256 >> v2:172.21.15.164:3300/0 conn(0x7fd61806db60 0x7fd61809cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:44.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.689+0000 7fd61ca00640 1 -- 172.21.15.123:0/1273479256 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd618073930 con 0x7fd6180afc60 2024-04-17T05:33:44.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.690+0000 7fd61ca00640 1 -- 172.21.15.123:0/1273479256 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1042962670 0 0) 0x7fd608001670 con 0x7fd6180afc60 2024-04-17T05:33:44.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.690+0000 7fd61ca00640 1 -- 172.21.15.123:0/1273479256 >> v1:172.21.15.123:6789/0 conn(0x7fd6180afc60 legacy=0x7fd6181479d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:44.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.690+0000 7fd61ca00640 1 --2- 172.21.15.123:0/1273479256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6000039b0 0x7fd600003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:44.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.690+0000 7fd61ca00640 1 --2- 172.21.15.123:0/1273479256 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6181480e0 0x7fd600004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:44.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.690+0000 7fd61ca00640 1 --2- 172.21.15.123:0/1273479256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd600004d40 0x7fd6000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:44.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.690+0000 7fd61ca00640 1 -- 172.21.15.123:0/1273479256 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd61809d4c0 con 0x7fd6000039b0 2024-04-17T05:33:44.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.690+0000 7fd61ca00640 1 -- 172.21.15.123:0/1273479256 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd618073f80 con 0x7fd600004d40 2024-04-17T05:33:44.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.690+0000 7fd61ca00640 1 -- 172.21.15.123:0/1273479256 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fd60000b9c0 con 0x7fd6181480e0 2024-04-17T05:33:44.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.690+0000 7fd61de00640 1 --2- 172.21.15.123:0/1273479256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6000039b0 0x7fd600003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:44.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.690+0000 7fd61de00640 1 -- 172.21.15.123:0/1273479256 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6181480e0 msgr2=0x7fd600004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:44.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.690+0000 7fd61de00640 1 --2- 172.21.15.123:0/1273479256 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6181480e0 0x7fd600004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:44.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.690+0000 7fd61de00640 1 -- 172.21.15.123:0/1273479256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd600004d40 msgr2=0x7fd6000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:44.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.690+0000 7fd61de00640 1 --2- 172.21.15.123:0/1273479256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd600004d40 0x7fd6000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:44.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.690+0000 7fd61de00640 1 -- 172.21.15.123:0/1273479256 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd600003520 con 0x7fd6000039b0 2024-04-17T05:33:44.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.691+0000 7fd61de00640 1 --2- 172.21.15.123:0/1273479256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6000039b0 0x7fd600003dd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd60c009650 tx=0x7fd600005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf2edf6ce00ecfe server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:44.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.692+0000 7fd61ca00640 1 -- 172.21.15.123:0/1273479256 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60c03b070 con 0x7fd6000039b0 2024-04-17T05:33:44.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.692+0000 7fd61ca00640 1 -- 172.21.15.123:0/1273479256 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd60c02e920 con 0x7fd6000039b0 2024-04-17T05:33:44.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.692+0000 7fd61ca00640 1 -- 172.21.15.123:0/1273479256 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60c009690 con 0x7fd6000039b0 2024-04-17T05:33:44.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.692+0000 7fd620800640 1 -- 172.21.15.123:0/1273479256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6000039b0 msgr2=0x7fd600003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:44.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.692+0000 7fd620800640 1 --2- 172.21.15.123:0/1273479256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6000039b0 0x7fd600003dd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd60c009650 tx=0x7fd600005830 comp rx=0 tx=0).stop 2024-04-17T05:33:44.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.692+0000 7fd61e800640 1 -- 172.21.15.123:0/1273479256 reap_dead start 2024-04-17T05:33:44.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.692+0000 7fd620800640 1 -- 172.21.15.123:0/1273479256 shutdown_connections 2024-04-17T05:33:44.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.692+0000 7fd620800640 1 -- 172.21.15.123:0/1273479256 >> 172.21.15.123:0/1273479256 conn(0x7fd6180b93b0 msgr2=0x7fd6180b97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:44.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.692+0000 7fd620800640 1 -- 172.21.15.123:0/1273479256 shutdown_connections 2024-04-17T05:33:44.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.692+0000 7fd620800640 1 -- 172.21.15.123:0/1273479256 wait complete. 2024-04-17T05:33:44.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.694+0000 7fd620800640 1 Processor -- start 2024-04-17T05:33:44.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.694+0000 7fd620800640 1 -- start start 2024-04-17T05:33:44.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.695+0000 7fd620800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6000039b0 0x7fd618146d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:44.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.695+0000 7fd620800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd618070780 0x7fd618071920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:44.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.695+0000 7fd620800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6181e09c0 0x7fd6181443d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:44.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.695+0000 7fd620800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd6180734e0 con 0x7fd6181e09c0 2024-04-17T05:33:44.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.695+0000 7fd620800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd61809c620 con 0x7fd618070780 2024-04-17T05:33:44.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.695+0000 7fd620800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fd618073660 con 0x7fd6000039b0 2024-04-17T05:33:44.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.695+0000 7fd61e800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6181e09c0 0x7fd6181443d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:44.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.695+0000 7fd61e800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6181e09c0 0x7fd6181443d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39140/0 (socket says 172.21.15.123:39140) 2024-04-17T05:33:44.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.695+0000 7fd61e800640 1 -- 172.21.15.123:0/1033411650 learned_addr learned my addr 172.21.15.123:0/1033411650 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:44.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.695+0000 7fd61de00640 1 --2- 172.21.15.123:0/1033411650 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6000039b0 0x7fd618146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:44.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.695+0000 7fd61d400640 1 --2- 172.21.15.123:0/1033411650 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd618070780 0x7fd618071920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:44.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.696+0000 7fd61e800640 1 -- 172.21.15.123:0/1033411650 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6000039b0 msgr2=0x7fd618146d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:44.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.696+0000 7fd61e800640 1 --2- 172.21.15.123:0/1033411650 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6000039b0 0x7fd618146d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:44.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.696+0000 7fd61e800640 1 -- 172.21.15.123:0/1033411650 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd618070780 msgr2=0x7fd618071920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:44.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.696+0000 7fd61e800640 1 --2- 172.21.15.123:0/1033411650 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd618070780 0x7fd618071920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:44.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.696+0000 7fd61e800640 1 -- 172.21.15.123:0/1033411650 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd618071e60 con 0x7fd6181e09c0 2024-04-17T05:33:44.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.696+0000 7fd61e800640 1 --2- 172.21.15.123:0/1033411650 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6181e09c0 0x7fd6181443d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd61809e410 tx=0x7fd61400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:44.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.696+0000 7fd612000640 1 -- 172.21.15.123:0/1033411650 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd614018020 con 0x7fd6181e09c0 2024-04-17T05:33:44.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.696+0000 7fd612000640 1 -- 172.21.15.123:0/1033411650 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd61400bb10 con 0x7fd6181e09c0 2024-04-17T05:33:44.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.696+0000 7fd620800640 1 -- 172.21.15.123:0/1033411650 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6181452b0 con 0x7fd6181e09c0 2024-04-17T05:33:44.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.696+0000 7fd612000640 1 -- 172.21.15.123:0/1033411650 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd614014400 con 0x7fd6181e09c0 2024-04-17T05:33:44.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.696+0000 7fd620800640 1 -- 172.21.15.123:0/1033411650 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd618072c00 con 0x7fd6181e09c0 2024-04-17T05:33:44.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.697+0000 7fd620800640 1 -- 172.21.15.123:0/1033411650 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd618068a40 con 0x7fd6181e09c0 2024-04-17T05:33:44.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.699+0000 7fd612000640 1 -- 172.21.15.123:0/1033411650 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd614005d10 con 0x7fd6181e09c0 2024-04-17T05:33:44.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.699+0000 7fd612000640 1 --2- 172.21.15.123:0/1033411650 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fd5fc06c8f0 0x7fd5fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:44.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.699+0000 7fd612000640 1 -- 172.21.15.123:0/1033411650 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fd61408c560 con 0x7fd6181e09c0 2024-04-17T05:33:44.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.700+0000 7fd61de00640 1 --2- 172.21.15.123:0/1033411650 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fd5fc06c8f0 0x7fd5fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:44.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.701+0000 7fd61de00640 1 --2- 172.21.15.123:0/1033411650 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fd5fc06c8f0 0x7fd5fc06edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd60c038000 tx=0x7fd60c032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:44.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.704+0000 7fd612000640 1 -- 172.21.15.123:0/1033411650 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fd614022030 con 0x7fd6181e09c0 2024-04-17T05:33:44.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.905+0000 7fd620800640 1 -- 172.21.15.123:0/1033411650 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd618148600 con 0x7fd6181e09c0 2024-04-17T05:33:44.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.907+0000 7fd612000640 1 -- 172.21.15.123:0/1033411650 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18960 (secure 0 0 0) 0x7fd614059f10 con 0x7fd6181e09c0 2024-04-17T05:33:44.906 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:33:44.906 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":28,"fsid":"0787c5c0-e77a-4102-a899-30db48b19c68","created":"2024-04-17T05:26:33.031507+0000","modified":"2024-04-17T05:27:39.558127+0000","last_up_change":"2024-04-17T05:26:44.988433+0000","last_in_change":"2024-04-17T05:26:36.682131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T05:26:46.329778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T05:26:50.600195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T05:26:51.626498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T05:26:55.264044+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15c87cdb-9415-45a6-a2a6-ea6bec9daece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6801","nonce":840753170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6803","nonce":840753170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6807","nonce":840753170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6805","nonce":840753170}]},"public_addr":"172.21.15.123:6801/840753170","cluster_addr":"172.21.15.123:6803/840753170","heartbeat_back_addr":"172.21.15.123:6807/840753170","heartbeat_front_addr":"172.21.15.123:6805/840753170","state":["exists","up"]},{"osd":1,"uuid":"281751b5-486d-4845-b4aa-b308bf7cec62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6822","nonce":2231878927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6827","nonce":2231878927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6831","nonce":2231878927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6829","nonce":2231878927}]},"public_addr":"172.21.15.123:6822/2231878927","cluster_addr":"172.21.15.123:6827/2231878927","heartbeat_back_addr":"172.21.15.123:6831/2231878927","heartbeat_front_addr":"172.21.15.123:6829/2231878927","state":["exists","up"]},{"osd":2,"uuid":"b42257d3-bd20-4db5-aa37-1bf5c512d0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6817","nonce":754360844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6820","nonce":754360844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6825","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6826","nonce":754360844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6823","nonce":754360844}]},"public_addr":"172.21.15.123:6817/754360844","cluster_addr":"172.21.15.123:6820/754360844","heartbeat_back_addr":"172.21.15.123:6826/754360844","heartbeat_front_addr":"172.21.15.123:6823/754360844","state":["exists","up"]},{"osd":3,"uuid":"0f26b891-bbe6-478e-8dee-78e69bb48cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6809","nonce":2898088574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6811","nonce":2898088574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6815","nonce":2898088574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6813","nonce":2898088574}]},"public_addr":"172.21.15.123:6809/2898088574","cluster_addr":"172.21.15.123:6811/2898088574","heartbeat_back_addr":"172.21.15.123:6815/2898088574","heartbeat_front_addr":"172.21.15.123:6813/2898088574","state":["exists","up"]},{"osd":4,"uuid":"43e59318-2740-4625-9d64-eec1fd43c322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6801","nonce":606484349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6804","nonce":606484349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6812","nonce":606484349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6808","nonce":606484349}]},"public_addr":"172.21.15.164:6801/606484349","cluster_addr":"172.21.15.164:6804/606484349","heartbeat_back_addr":"172.21.15.164:6812/606484349","heartbeat_front_addr":"172.21.15.164:6808/606484349","state":["exists","up"]},{"osd":5,"uuid":"aaa3acf4-4adc-4337-aba3-363851d35310","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6805","nonce":1376989593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6809","nonce":1376989593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6815","nonce":1376989593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6813","nonce":1376989593}]},"public_addr":"172.21.15.164:6805/1376989593","cluster_addr":"172.21.15.164:6809/1376989593","heartbeat_back_addr":"172.21.15.164:6815/1376989593","heartbeat_front_addr":"172.21.15.164:6813/1376989593","state":["exists","up"]},{"osd":6,"uuid":"6f765b27-7377-4d81-9192-23a965651145","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6817","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6821","nonce":1594306924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6823","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6826","nonce":1594306924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6831","nonce":1594306924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6829","nonce":1594306924}]},"public_addr":"172.21.15.164:6821/1594306924","cluster_addr":"172.21.15.164:6826/1594306924","heartbeat_back_addr":"172.21.15.164:6831/1594306924","heartbeat_front_addr":"172.21.15.164:6829/1594306924","state":["exists","up"]},{"osd":7,"uuid":"5547394b-ec2f-4311-846d-369af4b1acf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6818","nonce":295402697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6819","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6820","nonce":295402697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6825","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6827","nonce":295402697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6824","nonce":295402697}]},"public_addr":"172.21.15.164:6818/295402697","cluster_addr":"172.21.15.164:6820/295402697","heartbeat_back_addr":"172.21.15.164:6827/295402697","heartbeat_front_addr":"172.21.15.164:6824/295402697","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.034807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.022201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.751897+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.850533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.083608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.047524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.314753+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.413586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T05:33:44.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.910+0000 7fd620800640 1 -- 172.21.15.123:0/1033411650 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fd5fc06c8f0 msgr2=0x7fd5fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:44.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.910+0000 7fd620800640 1 --2- 172.21.15.123:0/1033411650 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fd5fc06c8f0 0x7fd5fc06edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd60c038000 tx=0x7fd60c032000 comp rx=0 tx=0).stop 2024-04-17T05:33:44.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.910+0000 7fd620800640 1 -- 172.21.15.123:0/1033411650 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6181e09c0 msgr2=0x7fd6181443d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:44.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.910+0000 7fd620800640 1 --2- 172.21.15.123:0/1033411650 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6181e09c0 0x7fd6181443d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd61809e410 tx=0x7fd61400b480 comp rx=0 tx=0).stop 2024-04-17T05:33:44.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.910+0000 7fd620800640 1 -- 172.21.15.123:0/1033411650 shutdown_connections 2024-04-17T05:33:44.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.910+0000 7fd620800640 1 --2- 172.21.15.123:0/1033411650 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6181e09c0 0x7fd6181443d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:44.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.910+0000 7fd620800640 1 --2- 172.21.15.123:0/1033411650 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd618070780 0x7fd618071920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:44.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.910+0000 7fd620800640 1 --2- 172.21.15.123:0/1033411650 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fd5fc06c8f0 0x7fd5fc06edb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:44.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.910+0000 7fd620800640 1 --2- 172.21.15.123:0/1033411650 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd6000039b0 0x7fd618146d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:44.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.910+0000 7fd620800640 1 -- 172.21.15.123:0/1033411650 >> 172.21.15.123:0/1033411650 conn(0x7fd6180b93b0 msgr2=0x7fd61806d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:44.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.910+0000 7fd620800640 1 -- 172.21.15.123:0/1033411650 shutdown_connections 2024-04-17T05:33:44.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:44.910+0000 7fd620800640 1 -- 172.21.15.123:0/1033411650 wait complete. 2024-04-17T05:33:44.930 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T05:26:46.329778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T05:26:50.600195+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T05:26:51.626498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T05:26:55.264044+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T05:33:44.930 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T05:33:45.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.148+0000 7f2635400640 1 Processor -- start 2024-04-17T05:33:45.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.148+0000 7f2635400640 1 -- start start 2024-04-17T05:33:45.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.149+0000 7f2635400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2630149b30 0x7f26301513a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:45.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.149+0000 7f2635400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26300b83f0 con 0x7f26300b9b20 2024-04-17T05:33:45.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.149+0000 7f2635400640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26300b9f00 con 0x7f263006dd10 2024-04-17T05:33:45.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.149+0000 7f2635400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f2630149060 con 0x7f2630149b30 2024-04-17T05:33:45.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.150+0000 7f262e800640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f26300b9b20 0x7f263006d0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42136/0 (socket says 172.21.15.123:42136) 2024-04-17T05:33:45.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.150+0000 7f262e800640 1 -- 172.21.15.123:0/3945326795 learned_addr learned my addr 172.21.15.123:0/3945326795 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:33:45.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.150+0000 7f262f200640 1 --2- 172.21.15.123:0/3945326795 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2630149b30 0x7f26301513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:45.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.150+0000 7f262d400640 1 -- 172.21.15.123:0/3945326795 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 237382877 0 0) 0x7f26300b83f0 con 0x7f26300b9b20 2024-04-17T05:33:45.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.150+0000 7f262d400640 1 -- 172.21.15.123:0/3945326795 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2614003520 con 0x7f26300b9b20 2024-04-17T05:33:45.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.150+0000 7f262d400640 1 -- 172.21.15.123:0/3945326795 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3747560910 0 0) 0x7f2614003520 con 0x7f26300b9b20 2024-04-17T05:33:45.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.151+0000 7f262d400640 1 -- 172.21.15.123:0/3945326795 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2630149b30 msgr2=0x7f26301513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:45.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.151+0000 7f262d400640 1 --2- 172.21.15.123:0/3945326795 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2630149b30 0x7f26301513a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:45.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.151+0000 7f262d400640 1 -- 172.21.15.123:0/3945326795 >> v1:172.21.15.164:6789/0 conn(0x7f263006dd10 legacy=0x7f2630149420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:45.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.151+0000 7f262d400640 1 -- 172.21.15.123:0/3945326795 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26300b8940 con 0x7f26300b9b20 2024-04-17T05:33:45.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.151+0000 7f262d400640 1 -- 172.21.15.123:0/3945326795 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1042962670 0 0) 0x7f2620001670 con 0x7f26300b9b20 2024-04-17T05:33:45.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.151+0000 7f262d400640 1 -- 172.21.15.123:0/3945326795 >> v1:172.21.15.123:6789/0 conn(0x7f26300b9b20 legacy=0x7f263006d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:45.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.151+0000 7f262d400640 1 --2- 172.21.15.123:0/3945326795 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2630149b30 0x7f26140039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:45.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.151+0000 7f262d400640 1 --2- 172.21.15.123:0/3945326795 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2614003f20 0x7f2614004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:45.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.151+0000 7f262d400640 1 --2- 172.21.15.123:0/3945326795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2614004d40 0x7f26140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:45.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.151+0000 7f262d400640 1 -- 172.21.15.123:0/3945326795 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f261400b9f0 con 0x7f2614004d40 2024-04-17T05:33:45.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.151+0000 7f262d400640 1 -- 172.21.15.123:0/3945326795 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f261400bba0 con 0x7f2614003f20 2024-04-17T05:33:45.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.151+0000 7f262d400640 1 -- 172.21.15.123:0/3945326795 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f261400bda0 con 0x7f2630149b30 2024-04-17T05:33:45.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.151+0000 7f262f200640 1 --2- 172.21.15.123:0/3945326795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2614004d40 0x7f26140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:45.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.151+0000 7f262e800640 1 --2- 172.21.15.123:0/3945326795 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2630149b30 0x7f26140039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:45.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.151+0000 7f262de00640 1 --2- 172.21.15.123:0/3945326795 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2614003f20 0x7f2614004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:45.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.152+0000 7f262f200640 1 -- 172.21.15.123:0/3945326795 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2630149b30 msgr2=0x7f26140039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:45.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.152+0000 7f262f200640 1 --2- 172.21.15.123:0/3945326795 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2630149b30 0x7f26140039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:45.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.152+0000 7f262f200640 1 -- 172.21.15.123:0/3945326795 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2614003f20 msgr2=0x7f2614004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:45.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.152+0000 7f262f200640 1 --2- 172.21.15.123:0/3945326795 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2614003f20 0x7f2614004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:45.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.152+0000 7f262f200640 1 -- 172.21.15.123:0/3945326795 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2614003520 con 0x7f2614004d40 2024-04-17T05:33:45.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.152+0000 7f262de00640 1 --2- 172.21.15.123:0/3945326795 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2614003f20 0x7f2614004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T05:33:45.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.153+0000 7f262f200640 1 --2- 172.21.15.123:0/3945326795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2614004d40 0x7f26140051c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2628009fc0 tx=0x7f2614005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2dde8f4425d38d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:45.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.153+0000 7f262d400640 1 -- 172.21.15.123:0/3945326795 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2628039070 con 0x7f2614004d40 2024-04-17T05:33:45.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.153+0000 7f262d400640 1 -- 172.21.15.123:0/3945326795 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f262802cc20 con 0x7f2614004d40 2024-04-17T05:33:45.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.154+0000 7f262d400640 1 -- 172.21.15.123:0/3945326795 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2628009c10 con 0x7f2614004d40 2024-04-17T05:33:45.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.154+0000 7f2635400640 1 -- 172.21.15.123:0/3945326795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2614004d40 msgr2=0x7f26140051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:45.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.154+0000 7f2635400640 1 --2- 172.21.15.123:0/3945326795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2614004d40 0x7f26140051c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2628009fc0 tx=0x7f2614005830 comp rx=0 tx=0).stop 2024-04-17T05:33:45.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.154+0000 7f262f200640 1 -- 172.21.15.123:0/3945326795 reap_dead start 2024-04-17T05:33:45.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.154+0000 7f2635400640 1 -- 172.21.15.123:0/3945326795 shutdown_connections 2024-04-17T05:33:45.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.154+0000 7f2635400640 1 -- 172.21.15.123:0/3945326795 >> 172.21.15.123:0/3945326795 conn(0x7f263006bda0 msgr2=0x7f263006c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:45.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.154+0000 7f2635400640 1 -- 172.21.15.123:0/3945326795 shutdown_connections 2024-04-17T05:33:45.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.154+0000 7f2635400640 1 -- 172.21.15.123:0/3945326795 wait complete. 2024-04-17T05:33:45.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.156+0000 7f2635400640 1 Processor -- start 2024-04-17T05:33:45.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.156+0000 7f2635400640 1 -- start start 2024-04-17T05:33:45.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.157+0000 7f2635400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26301cf5a0 0x7f26301dd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:45.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.157+0000 7f2635400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26301d06a0 0x7f26301ddab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:45.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.157+0000 7f2635400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2630144ff0 0x7f2630145470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:45.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.157+0000 7f2635400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f26300b7600 con 0x7f26301d06a0 2024-04-17T05:33:45.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.157+0000 7f2635400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f26300b8660 con 0x7f2630144ff0 2024-04-17T05:33:45.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.157+0000 7f2635400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f26300b90b0 con 0x7f26301cf5a0 2024-04-17T05:33:45.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.157+0000 7f262de00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26301d06a0 0x7f26301ddab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:45.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.157+0000 7f262de00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26301d06a0 0x7f26301ddab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45950/0 (socket says 172.21.15.123:45950) 2024-04-17T05:33:45.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.157+0000 7f262de00640 1 -- 172.21.15.123:0/1646245891 learned_addr learned my addr 172.21.15.123:0/1646245891 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:45.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.157+0000 7f262e800640 1 --2- 172.21.15.123:0/1646245891 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26301cf5a0 0x7f26301dd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:45.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.157+0000 7f262f200640 1 --2- 172.21.15.123:0/1646245891 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2630144ff0 0x7f2630145470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:45.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.157+0000 7f262de00640 1 -- 172.21.15.123:0/1646245891 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26301cf5a0 msgr2=0x7f26301dd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:45.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.157+0000 7f262de00640 1 --2- 172.21.15.123:0/1646245891 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26301cf5a0 0x7f26301dd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:45.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.158+0000 7f262de00640 1 -- 172.21.15.123:0/1646245891 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2630144ff0 msgr2=0x7f2630145470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:45.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.158+0000 7f262de00640 1 --2- 172.21.15.123:0/1646245891 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2630144ff0 0x7f2630145470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:45.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.158+0000 7f262de00640 1 -- 172.21.15.123:0/1646245891 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26301cf980 con 0x7f26301d06a0 2024-04-17T05:33:45.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.158+0000 7f262f200640 1 --2- 172.21.15.123:0/1646245891 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2630144ff0 0x7f2630145470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:33:45.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.158+0000 7f262de00640 1 --2- 172.21.15.123:0/1646245891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26301d06a0 0x7f26301ddab0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f261c007830 tx=0x7f261c00e9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:45.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.158+0000 7f2626a00640 1 -- 172.21.15.123:0/1646245891 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f261c0052e0 con 0x7f26301d06a0 2024-04-17T05:33:45.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.158+0000 7f2626a00640 1 -- 172.21.15.123:0/1646245891 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f261c018070 con 0x7f26301d06a0 2024-04-17T05:33:45.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.158+0000 7f2635400640 1 -- 172.21.15.123:0/1646245891 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26301d0bf0 con 0x7f26301d06a0 2024-04-17T05:33:45.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.158+0000 7f2626a00640 1 -- 172.21.15.123:0/1646245891 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f261c0037f0 con 0x7f26301d06a0 2024-04-17T05:33:45.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.158+0000 7f2635400640 1 -- 172.21.15.123:0/1646245891 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2630072c70 con 0x7f26301d06a0 2024-04-17T05:33:45.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.160+0000 7f2635400640 1 -- 172.21.15.123:0/1646245891 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2630075bd0 con 0x7f26301d06a0 2024-04-17T05:33:45.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.160+0000 7f2626a00640 1 -- 172.21.15.123:0/1646245891 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f261c003990 con 0x7f26301d06a0 2024-04-17T05:33:45.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.162+0000 7f2626a00640 1 --2- 172.21.15.123:0/1646245891 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f261006c8f0 0x7f261006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:45.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.162+0000 7f2626a00640 1 -- 172.21.15.123:0/1646245891 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f261c08bcd0 con 0x7f26301d06a0 2024-04-17T05:33:45.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.162+0000 7f262e800640 1 --2- 172.21.15.123:0/1646245891 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f261006c8f0 0x7f261006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:45.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.163+0000 7f262e800640 1 --2- 172.21.15.123:0/1646245891 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f261006c8f0 0x7f261006edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2620004840 tx=0x7f2620009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:45.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.166+0000 7f2626a00640 1 -- 172.21.15.123:0/1646245891 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f261c059cd0 con 0x7f26301d06a0 2024-04-17T05:33:45.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.373+0000 7f2635400640 1 -- 172.21.15.123:0/1646245891 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f263006d9a0 con 0x7f26301d06a0 2024-04-17T05:33:45.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.374+0000 7f2626a00640 1 -- 172.21.15.123:0/1646245891 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7f261c0595d0 con 0x7f26301d06a0 2024-04-17T05:33:45.372 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-04-17T05:33:45.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.376+0000 7f2635400640 1 -- 172.21.15.123:0/1646245891 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f261006c8f0 msgr2=0x7f261006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:45.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.376+0000 7f2635400640 1 --2- 172.21.15.123:0/1646245891 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f261006c8f0 0x7f261006edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2620004840 tx=0x7f2620009040 comp rx=0 tx=0).stop 2024-04-17T05:33:45.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.376+0000 7f2635400640 1 -- 172.21.15.123:0/1646245891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26301d06a0 msgr2=0x7f26301ddab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:45.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.376+0000 7f2635400640 1 --2- 172.21.15.123:0/1646245891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26301d06a0 0x7f26301ddab0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f261c007830 tx=0x7f261c00e9e0 comp rx=0 tx=0).stop 2024-04-17T05:33:45.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.377+0000 7f2635400640 1 -- 172.21.15.123:0/1646245891 shutdown_connections 2024-04-17T05:33:45.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.377+0000 7f2635400640 1 --2- 172.21.15.123:0/1646245891 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2630144ff0 0x7f2630145470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:45.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.377+0000 7f2635400640 1 --2- 172.21.15.123:0/1646245891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26301d06a0 0x7f26301ddab0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:45.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.377+0000 7f2635400640 1 --2- 172.21.15.123:0/1646245891 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f261006c8f0 0x7f261006edb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:45.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.377+0000 7f2635400640 1 --2- 172.21.15.123:0/1646245891 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f26301cf5a0 0x7f26301dd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:45.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.377+0000 7f2635400640 1 -- 172.21.15.123:0/1646245891 >> 172.21.15.123:0/1646245891 conn(0x7f263006bda0 msgr2=0x7f26300af950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:45.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.377+0000 7f2635400640 1 -- 172.21.15.123:0/1646245891 shutdown_connections 2024-04-17T05:33:45.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.377+0000 7f2635400640 1 -- 172.21.15.123:0/1646245891 wait complete. 2024-04-17T05:33:45.395 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T05:33:45.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.609+0000 7fc08aa00640 1 Processor -- start 2024-04-17T05:33:45.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.609+0000 7fc08aa00640 1 -- start start 2024-04-17T05:33:45.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.611+0000 7fc08aa00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc0840b4d70 0x7fc0840b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:45.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.611+0000 7fc08aa00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc084148430 con 0x7fc0840b41e0 2024-04-17T05:33:45.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.611+0000 7fc08aa00640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0840b45c0 con 0x7fc0840b68c0 2024-04-17T05:33:45.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.611+0000 7fc08aa00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7fc0840b56e0 con 0x7fc0840b4d70 2024-04-17T05:33:45.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.611+0000 7fc083e00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc0840b41e0 0x7fc084147d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42144/0 (socket says 172.21.15.123:42144) 2024-04-17T05:33:45.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.611+0000 7fc083e00640 1 -- 172.21.15.123:0/1656474640 learned_addr learned my addr 172.21.15.123:0/1656474640 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:33:45.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.611+0000 7fc088a00640 1 --2- 172.21.15.123:0/1656474640 >> v2:172.21.15.164:3300/0 conn(0x7fc0840b4d70 0x7fc0840b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:45.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.611+0000 7fc082a00640 1 -- 172.21.15.123:0/1656474640 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4060963753 0 0) 0x7fc084148430 con 0x7fc0840b41e0 2024-04-17T05:33:45.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.612+0000 7fc082a00640 1 -- 172.21.15.123:0/1656474640 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc068003520 con 0x7fc0840b41e0 2024-04-17T05:33:45.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.612+0000 7fc082a00640 1 -- 172.21.15.123:0/1656474640 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2614571008 0 0) 0x7fc068003520 con 0x7fc0840b41e0 2024-04-17T05:33:45.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.612+0000 7fc082a00640 1 -- 172.21.15.123:0/1656474640 >> v2:172.21.15.164:3300/0 conn(0x7fc0840b4d70 msgr2=0x7fc0840b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:45.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.612+0000 7fc082a00640 1 --2- 172.21.15.123:0/1656474640 >> v2:172.21.15.164:3300/0 conn(0x7fc0840b4d70 0x7fc0840b51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:45.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.612+0000 7fc082a00640 1 -- 172.21.15.123:0/1656474640 >> v1:172.21.15.164:6789/0 conn(0x7fc0840b68c0 legacy=0x7fc0840b2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:45.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.612+0000 7fc082a00640 1 -- 172.21.15.123:0/1656474640 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0841486a0 con 0x7fc0840b41e0 2024-04-17T05:33:45.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.612+0000 7fc082a00640 1 -- 172.21.15.123:0/1656474640 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1042962670 0 0) 0x7fc0740019f0 con 0x7fc0840b41e0 2024-04-17T05:33:45.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.612+0000 7fc082a00640 1 -- 172.21.15.123:0/1656474640 >> v1:172.21.15.123:6789/0 conn(0x7fc0840b41e0 legacy=0x7fc084147d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:45.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.612+0000 7fc082a00640 1 --2- 172.21.15.123:0/1656474640 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc068003a00 0x7fc068003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:45.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.612+0000 7fc082a00640 1 --2- 172.21.15.123:0/1656474640 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc068004800 0x7fc068004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:45.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.612+0000 7fc082a00640 1 --2- 172.21.15.123:0/1656474640 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc068005210 0x7fc06800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:45.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.612+0000 7fc082a00640 1 -- 172.21.15.123:0/1656474640 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc0840b56e0 con 0x7fc068003a00 2024-04-17T05:33:45.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.612+0000 7fc082a00640 1 -- 172.21.15.123:0/1656474640 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc06800c160 con 0x7fc068005210 2024-04-17T05:33:45.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.612+0000 7fc082a00640 1 -- 172.21.15.123:0/1656474640 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fc06800c360 con 0x7fc068004800 2024-04-17T05:33:45.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.612+0000 7fc083e00640 1 --2- 172.21.15.123:0/1656474640 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc068003a00 0x7fc068003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:45.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.613+0000 7fc088a00640 1 --2- 172.21.15.123:0/1656474640 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc068005210 0x7fc06800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:45.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.613+0000 7fc083400640 1 --2- 172.21.15.123:0/1656474640 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc068004800 0x7fc068004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:45.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.613+0000 7fc083e00640 1 -- 172.21.15.123:0/1656474640 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc068004800 msgr2=0x7fc068004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:45.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.613+0000 7fc083e00640 1 --2- 172.21.15.123:0/1656474640 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc068004800 0x7fc068004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:45.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.613+0000 7fc083e00640 1 -- 172.21.15.123:0/1656474640 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc068005210 msgr2=0x7fc06800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:45.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.613+0000 7fc083e00640 1 --2- 172.21.15.123:0/1656474640 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc068005210 0x7fc06800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:45.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.613+0000 7fc083e00640 1 -- 172.21.15.123:0/1656474640 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc068003520 con 0x7fc068003a00 2024-04-17T05:33:45.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.613+0000 7fc088a00640 1 -- 172.21.15.123:0/1656474640 reap_dead start 2024-04-17T05:33:45.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.613+0000 7fc083400640 1 --2- 172.21.15.123:0/1656474640 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc068004800 0x7fc068004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:33:45.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.614+0000 7fc083e00640 1 --2- 172.21.15.123:0/1656474640 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc068003a00 0x7fc068003e20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc07400a780 tx=0x7fc068005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd80435969b4503 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:45.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.614+0000 7fc082a00640 1 -- 172.21.15.123:0/1656474640 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07400a3d0 con 0x7fc068003a00 2024-04-17T05:33:45.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.614+0000 7fc082a00640 1 -- 172.21.15.123:0/1656474640 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc074034650 con 0x7fc068003a00 2024-04-17T05:33:45.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.614+0000 7fc082a00640 1 -- 172.21.15.123:0/1656474640 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc074034ac0 con 0x7fc068003a00 2024-04-17T05:33:45.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.615+0000 7fc08aa00640 1 -- 172.21.15.123:0/1656474640 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc068003a00 msgr2=0x7fc068003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:45.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.615+0000 7fc08aa00640 1 --2- 172.21.15.123:0/1656474640 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc068003a00 0x7fc068003e20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc07400a780 tx=0x7fc068005830 comp rx=0 tx=0).stop 2024-04-17T05:33:45.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.615+0000 7fc08aa00640 1 -- 172.21.15.123:0/1656474640 shutdown_connections 2024-04-17T05:33:45.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.615+0000 7fc08aa00640 1 --2- 172.21.15.123:0/1656474640 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc068003a00 0x7fc068003e20 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:45.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.615+0000 7fc08aa00640 1 -- 172.21.15.123:0/1656474640 >> 172.21.15.123:0/1656474640 conn(0x7fc0840bd5b0 msgr2=0x7fc0840bd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:45.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.615+0000 7fc08aa00640 1 -- 172.21.15.123:0/1656474640 shutdown_connections 2024-04-17T05:33:45.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.615+0000 7fc08aa00640 1 -- 172.21.15.123:0/1656474640 wait complete. 2024-04-17T05:33:45.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.617+0000 7fc08aa00640 1 Processor -- start 2024-04-17T05:33:45.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.617+0000 7fc08aa00640 1 -- start start 2024-04-17T05:33:45.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.617+0000 7fc08aa00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc068003a00 0x7fc0841d3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:45.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.617+0000 7fc08aa00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc084144a40 0x7fc0841dd960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:45.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.617+0000 7fc08aa00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc08413caf0 0x7fc0841e0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:45.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.618+0000 7fc08aa00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc0840b51a0 con 0x7fc08413caf0 2024-04-17T05:33:45.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.618+0000 7fc08aa00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc084148c60 con 0x7fc084144a40 2024-04-17T05:33:45.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.618+0000 7fc08aa00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fc0840b5320 con 0x7fc068003a00 2024-04-17T05:33:45.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.618+0000 7fc088a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc08413caf0 0x7fc0841e0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:45.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.618+0000 7fc088a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc08413caf0 0x7fc0841e0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45964/0 (socket says 172.21.15.123:45964) 2024-04-17T05:33:45.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.618+0000 7fc088a00640 1 -- 172.21.15.123:0/3192507532 learned_addr learned my addr 172.21.15.123:0/3192507532 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:45.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.618+0000 7fc083e00640 1 --2- 172.21.15.123:0/3192507532 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc068003a00 0x7fc0841d3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:45.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.618+0000 7fc083400640 1 --2- 172.21.15.123:0/3192507532 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc084144a40 0x7fc0841dd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:45.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.618+0000 7fc088a00640 1 -- 172.21.15.123:0/3192507532 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc068003a00 msgr2=0x7fc0841d3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:45.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.618+0000 7fc088a00640 1 --2- 172.21.15.123:0/3192507532 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc068003a00 0x7fc0841d3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:45.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.618+0000 7fc088a00640 1 -- 172.21.15.123:0/3192507532 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc084144a40 msgr2=0x7fc0841dd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:45.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.618+0000 7fc088a00640 1 --2- 172.21.15.123:0/3192507532 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc084144a40 0x7fc0841dd960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:45.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.618+0000 7fc088a00640 1 -- 172.21.15.123:0/3192507532 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc084144240 con 0x7fc08413caf0 2024-04-17T05:33:45.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.619+0000 7fc088a00640 1 --2- 172.21.15.123:0/3192507532 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc08413caf0 0x7fc0841e0ed0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc08406cec0 tx=0x7fc07c011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:45.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.619+0000 7fc07be00640 1 -- 172.21.15.123:0/3192507532 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07c019020 con 0x7fc08413caf0 2024-04-17T05:33:45.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.619+0000 7fc07be00640 1 -- 172.21.15.123:0/3192507532 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc07c003610 con 0x7fc08413caf0 2024-04-17T05:33:45.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.619+0000 7fc07be00640 1 -- 172.21.15.123:0/3192507532 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07c003a00 con 0x7fc08413caf0 2024-04-17T05:33:45.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.619+0000 7fc08aa00640 1 -- 172.21.15.123:0/3192507532 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0840b2e20 con 0x7fc08413caf0 2024-04-17T05:33:45.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.619+0000 7fc08aa00640 1 -- 172.21.15.123:0/3192507532 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc084147d20 con 0x7fc08413caf0 2024-04-17T05:33:45.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.620+0000 7fc08aa00640 1 -- 172.21.15.123:0/3192507532 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc084069090 con 0x7fc08413caf0 2024-04-17T05:33:45.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.621+0000 7fc07be00640 1 -- 172.21.15.123:0/3192507532 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc07c01c020 con 0x7fc08413caf0 2024-04-17T05:33:45.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.622+0000 7fc07be00640 1 --2- 172.21.15.123:0/3192507532 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc06006c8f0 0x7fc06006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:45.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.622+0000 7fc07be00640 1 -- 172.21.15.123:0/3192507532 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fc07c08c1c0 con 0x7fc08413caf0 2024-04-17T05:33:45.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.622+0000 7fc083e00640 1 --2- 172.21.15.123:0/3192507532 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc06006c8f0 0x7fc06006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:45.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.624+0000 7fc083e00640 1 --2- 172.21.15.123:0/3192507532 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc06006c8f0 0x7fc06006edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc068004780 tx=0x7fc07402f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:45.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.627+0000 7fc07be00640 1 -- 172.21.15.123:0/3192507532 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fc07c023030 con 0x7fc08413caf0 2024-04-17T05:33:45.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.822+0000 7fc08aa00640 1 -- 172.21.15.123:0/3192507532 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc0840bb5e0 con 0x7fc08413caf0 2024-04-17T05:33:45.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.823+0000 7fc07be00640 1 -- 172.21.15.123:0/3192507532 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) ==== 104+0+11 (secure 0 0 0) 0x7fc07c05a1c0 con 0x7fc08413caf0 2024-04-17T05:33:45.821 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-04-17T05:33:45.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.825+0000 7fc08aa00640 1 -- 172.21.15.123:0/3192507532 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc06006c8f0 msgr2=0x7fc06006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:45.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.825+0000 7fc08aa00640 1 --2- 172.21.15.123:0/3192507532 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc06006c8f0 0x7fc06006edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc068004780 tx=0x7fc07402f000 comp rx=0 tx=0).stop 2024-04-17T05:33:45.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.825+0000 7fc08aa00640 1 -- 172.21.15.123:0/3192507532 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc08413caf0 msgr2=0x7fc0841e0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:45.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.825+0000 7fc08aa00640 1 --2- 172.21.15.123:0/3192507532 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc08413caf0 0x7fc0841e0ed0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc08406cec0 tx=0x7fc07c011920 comp rx=0 tx=0).stop 2024-04-17T05:33:45.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.826+0000 7fc08aa00640 1 -- 172.21.15.123:0/3192507532 shutdown_connections 2024-04-17T05:33:45.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.826+0000 7fc08aa00640 1 --2- 172.21.15.123:0/3192507532 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc08413caf0 0x7fc0841e0ed0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:45.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.826+0000 7fc08aa00640 1 --2- 172.21.15.123:0/3192507532 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc084144a40 0x7fc0841dd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:45.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.826+0000 7fc08aa00640 1 --2- 172.21.15.123:0/3192507532 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc06006c8f0 0x7fc06006edb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:45.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.826+0000 7fc08aa00640 1 --2- 172.21.15.123:0/3192507532 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc068003a00 0x7fc0841d3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:45.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.826+0000 7fc08aa00640 1 -- 172.21.15.123:0/3192507532 >> 172.21.15.123:0/3192507532 conn(0x7fc0840bd5b0 msgr2=0x7fc0840ba570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:45.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.826+0000 7fc08aa00640 1 -- 172.21.15.123:0/3192507532 shutdown_connections 2024-04-17T05:33:45.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:45.826+0000 7fc08aa00640 1 -- 172.21.15.123:0/3192507532 wait complete. 2024-04-17T05:33:45.841 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T05:33:46.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.051+0000 7f8edb200640 1 Processor -- start 2024-04-17T05:33:46.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.051+0000 7f8edb200640 1 -- start start 2024-04-17T05:33:46.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.052+0000 7f8edb200640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f8edc0b66c0 0x7f8edc0b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:46.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.052+0000 7f8edb200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8edc0732e0 0x7f8edc073770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:46.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.052+0000 7f8edb200640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8edc1400b0 con 0x7f8edc0b5490 2024-04-17T05:33:46.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.052+0000 7f8edb200640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f8edc0b4ca0 con 0x7f8edc0b66c0 2024-04-17T05:33:46.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.052+0000 7f8edb200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f8edc0b6aa0 con 0x7f8edc0732e0 2024-04-17T05:33:46.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.053+0000 7f8ed9e00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f8edc0b66c0 0x7f8edc0b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:46.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.053+0000 7f8eda800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8edc0732e0 0x7f8edc073770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:46.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.053+0000 7f8eda800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8edc0732e0 0x7f8edc073770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.123:45048/0 (socket says 172.21.15.123:45048) 2024-04-17T05:33:46.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.053+0000 7f8eda800640 1 -- 172.21.15.123:0/3177887721 learned_addr learned my addr 172.21.15.123:0/3177887721 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:46.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.054+0000 7f8eda800640 1 -- 172.21.15.123:0/3177887721 >> v2:172.21.15.164:3300/0 conn(0x7f8edc0b66c0 msgr2=0x7f8edc0b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:46.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.054+0000 7f8eda800640 1 --2- 172.21.15.123:0/3177887721 >> v2:172.21.15.164:3300/0 conn(0x7f8edc0b66c0 0x7f8edc0b3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:46.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.054+0000 7f8eda800640 1 -- 172.21.15.123:0/3177887721 >> v1:172.21.15.164:6789/0 conn(0x7f8edc0b5490 legacy=0x7f8edc13f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:46.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.054+0000 7f8eda800640 1 -- 172.21.15.123:0/3177887721 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8edc0b5af0 con 0x7f8edc0732e0 2024-04-17T05:33:46.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.055+0000 7f8eda800640 1 --2- 172.21.15.123:0/3177887721 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8edc0732e0 0x7f8edc073770 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4009e50 tx=0x7f8ed402bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4a2d0046785e9d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:46.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.055+0000 7f8ed8a00640 1 -- 172.21.15.123:0/3177887721 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed402ca70 con 0x7f8edc0732e0 2024-04-17T05:33:46.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.055+0000 7f8ed8a00640 1 -- 172.21.15.123:0/3177887721 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ed402cc10 con 0x7f8edc0732e0 2024-04-17T05:33:46.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.055+0000 7f8ed8a00640 1 -- 172.21.15.123:0/3177887721 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed40343f0 con 0x7f8edc0732e0 2024-04-17T05:33:46.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.056+0000 7f8edb200640 1 -- 172.21.15.123:0/3177887721 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8edc0732e0 msgr2=0x7f8edc073770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:46.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.056+0000 7f8edb200640 1 --2- 172.21.15.123:0/3177887721 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8edc0732e0 0x7f8edc073770 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4009e50 tx=0x7f8ed402bed0 comp rx=0 tx=0).stop 2024-04-17T05:33:46.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.056+0000 7f8edb200640 1 -- 172.21.15.123:0/3177887721 shutdown_connections 2024-04-17T05:33:46.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.056+0000 7f8edb200640 1 --2- 172.21.15.123:0/3177887721 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8edc0732e0 0x7f8edc073770 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:46.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.056+0000 7f8edb200640 1 --2- 172.21.15.123:0/3177887721 >> v2:172.21.15.164:3300/0 conn(0x7f8edc0b66c0 0x7f8edc0b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:46.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.056+0000 7f8edb200640 1 -- 172.21.15.123:0/3177887721 >> 172.21.15.123:0/3177887721 conn(0x7f8edc0b9a30 msgr2=0x7f8edc0b5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:46.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.056+0000 7f8edb200640 1 -- 172.21.15.123:0/3177887721 shutdown_connections 2024-04-17T05:33:46.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.056+0000 7f8edb200640 1 -- 172.21.15.123:0/3177887721 wait complete. 2024-04-17T05:33:46.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.058+0000 7f8edb200640 1 Processor -- start 2024-04-17T05:33:46.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.058+0000 7f8edb200640 1 -- start start 2024-04-17T05:33:46.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.059+0000 7f8edb200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8edc0732e0 0x7f8edc13edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:46.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.059+0000 7f8edb200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8edc0b5490 0x7f8edc13d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:46.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.059+0000 7f8edb200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8edc0b66c0 0x7f8edc0b8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:46.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.059+0000 7f8edb200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8edc1502a0 con 0x7f8edc0732e0 2024-04-17T05:33:46.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.059+0000 7f8edb200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8edc0b4930 con 0x7f8edc0b66c0 2024-04-17T05:33:46.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.059+0000 7f8edb200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f8edc150420 con 0x7f8edc0b5490 2024-04-17T05:33:46.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.059+0000 7f8ed9e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8edc0732e0 0x7f8edc13edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:46.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.059+0000 7f8ed9e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8edc0732e0 0x7f8edc13edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45972/0 (socket says 172.21.15.123:45972) 2024-04-17T05:33:46.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.059+0000 7f8ed9e00640 1 -- 172.21.15.123:0/1582108758 learned_addr learned my addr 172.21.15.123:0/1582108758 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:46.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.059+0000 7f8ed9e00640 1 -- 172.21.15.123:0/1582108758 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8edc0b5490 msgr2=0x7f8edc13d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:46.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.059+0000 7f8ed9e00640 1 --2- 172.21.15.123:0/1582108758 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8edc0b5490 0x7f8edc13d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:46.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.059+0000 7f8ed9e00640 1 -- 172.21.15.123:0/1582108758 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8edc0b66c0 msgr2=0x7f8edc0b8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:46.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.059+0000 7f8ed9e00640 1 --2- 172.21.15.123:0/1582108758 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8edc0b66c0 0x7f8edc0b8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:46.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.059+0000 7f8ed9e00640 1 -- 172.21.15.123:0/1582108758 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8edc13e3f0 con 0x7f8edc0732e0 2024-04-17T05:33:46.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.059+0000 7f8ed9e00640 1 --2- 172.21.15.123:0/1582108758 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8edc0732e0 0x7f8edc13edd0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc00e8a0 tx=0x7f8ecc00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:46.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.060+0000 7f8ed2000640 1 -- 172.21.15.123:0/1582108758 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc017070 con 0x7f8edc0732e0 2024-04-17T05:33:46.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.060+0000 7f8ed2000640 1 -- 172.21.15.123:0/1582108758 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ecc00c940 con 0x7f8edc0732e0 2024-04-17T05:33:46.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.060+0000 7f8ed2000640 1 -- 172.21.15.123:0/1582108758 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc00cd30 con 0x7f8edc0732e0 2024-04-17T05:33:46.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.060+0000 7f8edb200640 1 -- 172.21.15.123:0/1582108758 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8edc13caa0 con 0x7f8edc0732e0 2024-04-17T05:33:46.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.060+0000 7f8edb200640 1 -- 172.21.15.123:0/1582108758 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8edc138750 con 0x7f8edc0732e0 2024-04-17T05:33:46.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.061+0000 7f8edb200640 1 -- 172.21.15.123:0/1582108758 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8edc075b30 con 0x7f8edc0732e0 2024-04-17T05:33:46.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.062+0000 7f8ed2000640 1 -- 172.21.15.123:0/1582108758 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8ecc01a070 con 0x7f8edc0732e0 2024-04-17T05:33:46.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.063+0000 7f8ed2000640 1 --2- 172.21.15.123:0/1582108758 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8ebc06c8f0 0x7f8ebc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:46.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.063+0000 7f8ed2000640 1 -- 172.21.15.123:0/1582108758 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f8ecc08be50 con 0x7f8edc0732e0 2024-04-17T05:33:46.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.063+0000 7f8ed9400640 1 --2- 172.21.15.123:0/1582108758 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8ebc06c8f0 0x7f8ebc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:46.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.065+0000 7f8ed9400640 1 --2- 172.21.15.123:0/1582108758 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8ebc06c8f0 0x7f8ebc06edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8000f60 tx=0x7f8ec80079d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:46.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.067+0000 7f8ed2000640 1 -- 172.21.15.123:0/1582108758 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f8ecc059dd0 con 0x7f8edc0732e0 2024-04-17T05:33:46.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.265+0000 7f8edb200640 1 -- 172.21.15.123:0/1582108758 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8edc13e660 con 0x7f8edc0732e0 2024-04-17T05:33:46.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.266+0000 7f8ed2000640 1 -- 172.21.15.123:0/1582108758 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) ==== 100+0+11 (secure 0 0 0) 0x7f8ecc0596d0 con 0x7f8edc0732e0 2024-04-17T05:33:46.264 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-04-17T05:33:46.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.269+0000 7f8edb200640 1 -- 172.21.15.123:0/1582108758 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8ebc06c8f0 msgr2=0x7f8ebc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:46.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.269+0000 7f8edb200640 1 --2- 172.21.15.123:0/1582108758 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8ebc06c8f0 0x7f8ebc06edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8000f60 tx=0x7f8ec80079d0 comp rx=0 tx=0).stop 2024-04-17T05:33:46.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.269+0000 7f8edb200640 1 -- 172.21.15.123:0/1582108758 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8edc0732e0 msgr2=0x7f8edc13edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:46.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.269+0000 7f8edb200640 1 --2- 172.21.15.123:0/1582108758 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8edc0732e0 0x7f8edc13edd0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc00e8a0 tx=0x7f8ecc00ed60 comp rx=0 tx=0).stop 2024-04-17T05:33:46.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.269+0000 7f8edb200640 1 -- 172.21.15.123:0/1582108758 shutdown_connections 2024-04-17T05:33:46.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.269+0000 7f8edb200640 1 --2- 172.21.15.123:0/1582108758 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8edc0b66c0 0x7f8edc0b8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:46.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.269+0000 7f8edb200640 1 --2- 172.21.15.123:0/1582108758 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8ebc06c8f0 0x7f8ebc06edb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:46.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.269+0000 7f8edb200640 1 --2- 172.21.15.123:0/1582108758 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8edc0b5490 0x7f8edc13d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:46.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.269+0000 7f8edb200640 1 --2- 172.21.15.123:0/1582108758 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8edc0732e0 0x7f8edc13edd0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:46.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.269+0000 7f8edb200640 1 -- 172.21.15.123:0/1582108758 >> 172.21.15.123:0/1582108758 conn(0x7f8edc0b9a30 msgr2=0x7f8edc09e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:46.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.269+0000 7f8edb200640 1 -- 172.21.15.123:0/1582108758 shutdown_connections 2024-04-17T05:33:46.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.269+0000 7f8edb200640 1 -- 172.21.15.123:0/1582108758 wait complete. 2024-04-17T05:33:46.287 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T05:33:46.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.501+0000 7f0d78e00640 1 Processor -- start 2024-04-17T05:33:46.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.501+0000 7f0d78e00640 1 -- start start 2024-04-17T05:33:46.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.502+0000 7f0d78e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d740b61f0 0x7f0d740b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:46.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.503+0000 7f0d78e00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0d740b42e0 0x7f0d74147ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:46.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.503+0000 7f0d78e00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d740b65d0 con 0x7f0d74148410 2024-04-17T05:33:46.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.503+0000 7f0d78e00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f0d740b4d50 con 0x7f0d740b42e0 2024-04-17T05:33:46.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.503+0000 7f0d78e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f0d740b75a0 con 0x7f0d740b61f0 2024-04-17T05:33:46.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.503+0000 7f0d73e00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f0d74148410 0x7f0d740b51e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42146/0 (socket says 172.21.15.123:42146) 2024-04-17T05:33:46.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.503+0000 7f0d73e00640 1 -- 172.21.15.123:0/2647151979 learned_addr learned my addr 172.21.15.123:0/2647151979 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:33:46.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.503+0000 7f0d6aa00640 1 --2- 172.21.15.123:0/2647151979 >> v2:172.21.15.164:3300/0 conn(0x7f0d740b42e0 0x7f0d74147ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:46.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.503+0000 7f0d73400640 1 --2- 172.21.15.123:0/2647151979 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d740b61f0 0x7f0d740b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:46.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.503+0000 7f0d72a00640 1 -- 172.21.15.123:0/2647151979 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2775396263 0 0) 0x7f0d740b65d0 con 0x7f0d74148410 2024-04-17T05:33:46.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.504+0000 7f0d72a00640 1 -- 172.21.15.123:0/2647151979 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d58003520 con 0x7f0d74148410 2024-04-17T05:33:46.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.504+0000 7f0d6aa00640 1 -- 172.21.15.123:0/2647151979 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d740b61f0 msgr2=0x7f0d740b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:46.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.504+0000 7f0d6aa00640 1 --2- 172.21.15.123:0/2647151979 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d740b61f0 0x7f0d740b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:46.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.504+0000 7f0d6aa00640 1 -- 172.21.15.123:0/2647151979 >> v1:172.21.15.123:6789/0 conn(0x7f0d74148410 legacy=0x7f0d740b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:46.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.504+0000 7f0d6aa00640 1 -- 172.21.15.123:0/2647151979 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d740b49e0 con 0x7f0d740b42e0 2024-04-17T05:33:46.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.504+0000 7f0d73400640 1 --2- 172.21.15.123:0/2647151979 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d740b61f0 0x7f0d740b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T05:33:46.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.505+0000 7f0d6aa00640 1 --2- 172.21.15.123:0/2647151979 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d740b42e0 0x7f0d74147ed0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c0097a0 tx=0x7f0d5c02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e65a3d28c37174c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:46.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.506+0000 7f0d72a00640 1 -- 172.21.15.123:0/2647151979 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c035020 con 0x7f0d740b42e0 2024-04-17T05:33:46.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.506+0000 7f0d72a00640 1 -- 172.21.15.123:0/2647151979 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d5c031810 con 0x7f0d740b42e0 2024-04-17T05:33:46.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.506+0000 7f0d72a00640 1 -- 172.21.15.123:0/2647151979 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c031bc0 con 0x7f0d740b42e0 2024-04-17T05:33:46.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.506+0000 7f0d78e00640 1 -- 172.21.15.123:0/2647151979 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d740b42e0 msgr2=0x7f0d74147ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:46.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.506+0000 7f0d78e00640 1 --2- 172.21.15.123:0/2647151979 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d740b42e0 0x7f0d74147ed0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c0097a0 tx=0x7f0d5c02b8b0 comp rx=0 tx=0).stop 2024-04-17T05:33:46.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.507+0000 7f0d78e00640 1 -- 172.21.15.123:0/2647151979 shutdown_connections 2024-04-17T05:33:46.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.507+0000 7f0d78e00640 1 --2- 172.21.15.123:0/2647151979 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d740b42e0 0x7f0d74147ed0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:46.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.507+0000 7f0d78e00640 1 --2- 172.21.15.123:0/2647151979 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d740b61f0 0x7f0d740b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:46.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.507+0000 7f0d78e00640 1 -- 172.21.15.123:0/2647151979 >> 172.21.15.123:0/2647151979 conn(0x7f0d7406c260 msgr2=0x7f0d740b9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:46.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.507+0000 7f0d78e00640 1 -- 172.21.15.123:0/2647151979 shutdown_connections 2024-04-17T05:33:46.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.507+0000 7f0d78e00640 1 -- 172.21.15.123:0/2647151979 wait complete. 2024-04-17T05:33:46.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.508+0000 7f0d78e00640 1 Processor -- start 2024-04-17T05:33:46.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.508+0000 7f0d78e00640 1 -- start start 2024-04-17T05:33:46.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.509+0000 7f0d78e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d740b42e0 0x7f0d7413fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:46.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.509+0000 7f0d78e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d740b61f0 0x7f0d741409b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:46.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.509+0000 7f0d78e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d74148410 0x7f0d7413c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:46.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.509+0000 7f0d78e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0d74152320 con 0x7f0d740b61f0 2024-04-17T05:33:46.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.509+0000 7f0d78e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f0d740b5b40 con 0x7f0d74148410 2024-04-17T05:33:46.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.509+0000 7f0d78e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f0d741524a0 con 0x7f0d740b42e0 2024-04-17T05:33:46.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.509+0000 7f0d6aa00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d740b61f0 0x7f0d741409b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:46.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.509+0000 7f0d6aa00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d740b61f0 0x7f0d741409b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45976/0 (socket says 172.21.15.123:45976) 2024-04-17T05:33:46.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.509+0000 7f0d6aa00640 1 -- 172.21.15.123:0/3576383118 learned_addr learned my addr 172.21.15.123:0/3576383118 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:46.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.510+0000 7f0d73400640 1 --2- 172.21.15.123:0/3576383118 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d740b42e0 0x7f0d7413fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:46.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.510+0000 7f0d73e00640 1 --2- 172.21.15.123:0/3576383118 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d74148410 0x7f0d7413c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:46.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.510+0000 7f0d6aa00640 1 -- 172.21.15.123:0/3576383118 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d740b42e0 msgr2=0x7f0d7413fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:46.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.510+0000 7f0d6aa00640 1 --2- 172.21.15.123:0/3576383118 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d740b42e0 0x7f0d7413fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:46.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.510+0000 7f0d6aa00640 1 -- 172.21.15.123:0/3576383118 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d74148410 msgr2=0x7f0d7413c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:46.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.510+0000 7f0d6aa00640 1 --2- 172.21.15.123:0/3576383118 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d74148410 0x7f0d7413c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:46.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.510+0000 7f0d6aa00640 1 -- 172.21.15.123:0/3576383118 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d741351b0 con 0x7f0d740b61f0 2024-04-17T05:33:46.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.510+0000 7f0d6aa00640 1 --2- 172.21.15.123:0/3576383118 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d740b61f0 0x7f0d741409b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c02b8f0 tx=0x7f0d5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:46.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.510+0000 7f0d6be00640 1 -- 172.21.15.123:0/3576383118 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c035040 con 0x7f0d740b61f0 2024-04-17T05:33:46.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.510+0000 7f0d6be00640 1 -- 172.21.15.123:0/3576383118 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d5c003820 con 0x7f0d740b61f0 2024-04-17T05:33:46.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.510+0000 7f0d6be00640 1 -- 172.21.15.123:0/3576383118 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c003bd0 con 0x7f0d740b61f0 2024-04-17T05:33:46.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.510+0000 7f0d78e00640 1 -- 172.21.15.123:0/3576383118 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d741414a0 con 0x7f0d740b61f0 2024-04-17T05:33:46.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.511+0000 7f0d78e00640 1 -- 172.21.15.123:0/3576383118 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d74140ef0 con 0x7f0d740b61f0 2024-04-17T05:33:46.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.512+0000 7f0d78e00640 1 -- 172.21.15.123:0/3576383118 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d74075b30 con 0x7f0d740b61f0 2024-04-17T05:33:46.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.512+0000 7f0d6be00640 1 -- 172.21.15.123:0/3576383118 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0d5c038020 con 0x7f0d740b61f0 2024-04-17T05:33:46.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.513+0000 7f0d6be00640 1 --2- 172.21.15.123:0/3576383118 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f0d5006c8f0 0x7f0d5006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:46.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.513+0000 7f0d6be00640 1 -- 172.21.15.123:0/3576383118 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f0d5c0ae3e0 con 0x7f0d740b61f0 2024-04-17T05:33:46.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.514+0000 7f0d73400640 1 --2- 172.21.15.123:0/3576383118 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f0d5006c8f0 0x7f0d5006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:46.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.515+0000 7f0d73400640 1 --2- 172.21.15.123:0/3576383118 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f0d5006c8f0 0x7f0d5006edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0d64009560 tx=0x7f0d64008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:46.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.518+0000 7f0d6be00640 1 -- 172.21.15.123:0/3576383118 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f0d5c07c360 con 0x7f0d740b61f0 2024-04-17T05:33:46.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.716+0000 7f0d78e00640 1 -- 172.21.15.123:0/3576383118 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f0d741411e0 con 0x7f0d740b61f0 2024-04-17T05:33:46.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.717+0000 7f0d6be00640 1 -- 172.21.15.123:0/3576383118 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) ==== 103+0+11 (secure 0 0 0) 0x7f0d5c07bc60 con 0x7f0d740b61f0 2024-04-17T05:33:46.716 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-04-17T05:33:46.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.720+0000 7f0d78e00640 1 -- 172.21.15.123:0/3576383118 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f0d5006c8f0 msgr2=0x7f0d5006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:46.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.720+0000 7f0d78e00640 1 --2- 172.21.15.123:0/3576383118 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f0d5006c8f0 0x7f0d5006edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0d64009560 tx=0x7f0d64008040 comp rx=0 tx=0).stop 2024-04-17T05:33:46.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.720+0000 7f0d78e00640 1 -- 172.21.15.123:0/3576383118 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d740b61f0 msgr2=0x7f0d741409b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:46.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.720+0000 7f0d78e00640 1 --2- 172.21.15.123:0/3576383118 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d740b61f0 0x7f0d741409b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c02b8f0 tx=0x7f0d5c0046c0 comp rx=0 tx=0).stop 2024-04-17T05:33:46.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.720+0000 7f0d78e00640 1 -- 172.21.15.123:0/3576383118 shutdown_connections 2024-04-17T05:33:46.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.720+0000 7f0d78e00640 1 --2- 172.21.15.123:0/3576383118 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d74148410 0x7f0d7413c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:46.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.720+0000 7f0d78e00640 1 --2- 172.21.15.123:0/3576383118 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d740b61f0 0x7f0d741409b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:46.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.720+0000 7f0d78e00640 1 --2- 172.21.15.123:0/3576383118 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f0d5006c8f0 0x7f0d5006edb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:46.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.720+0000 7f0d78e00640 1 --2- 172.21.15.123:0/3576383118 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0d740b42e0 0x7f0d7413fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:46.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.720+0000 7f0d78e00640 1 -- 172.21.15.123:0/3576383118 >> 172.21.15.123:0/3576383118 conn(0x7f0d7406c260 msgr2=0x7f0d740bb860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:46.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.720+0000 7f0d78e00640 1 -- 172.21.15.123:0/3576383118 shutdown_connections 2024-04-17T05:33:46.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.720+0000 7f0d78e00640 1 -- 172.21.15.123:0/3576383118 wait complete. 2024-04-17T05:33:46.737 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-17T05:33:46.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.955+0000 7f90d3200640 1 Processor -- start 2024-04-17T05:33:46.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.956+0000 7f90d3200640 1 -- start start 2024-04-17T05:33:46.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.957+0000 7f90d3200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90d4147ed0 0x7f90d41482f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:46.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.957+0000 7f90d3200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90d40b65d0 con 0x7f90d40b51e0 2024-04-17T05:33:46.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.957+0000 7f90d3200640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90d40b75a0 con 0x7f90d40b61f0 2024-04-17T05:33:46.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.957+0000 7f90d3200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f90d40b4d50 con 0x7f90d4147ed0 2024-04-17T05:33:46.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.957+0000 7f90d2800640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f90d40b51e0 0x7f90d40b5640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42152/0 (socket says 172.21.15.123:42152) 2024-04-17T05:33:46.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.957+0000 7f90d2800640 1 -- 172.21.15.123:0/1452075472 learned_addr learned my addr 172.21.15.123:0/1452075472 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:33:46.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.957+0000 7f90c9400640 1 --2- 172.21.15.123:0/1452075472 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90d4147ed0 0x7f90d41482f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:46.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.958+0000 7f90d1400640 1 -- 172.21.15.123:0/1452075472 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1009347988 0 0) 0x7f90d40b65d0 con 0x7f90d40b51e0 2024-04-17T05:33:46.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.958+0000 7f90d1400640 1 -- 172.21.15.123:0/1452075472 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90b8003520 con 0x7f90d40b51e0 2024-04-17T05:33:46.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.958+0000 7f90d1400640 1 -- 172.21.15.123:0/1452075472 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2195366585 0 0) 0x7f90b8003520 con 0x7f90d40b51e0 2024-04-17T05:33:46.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.958+0000 7f90d1400640 1 -- 172.21.15.123:0/1452075472 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90d4147ed0 msgr2=0x7f90d41482f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:46.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.958+0000 7f90d1400640 1 --2- 172.21.15.123:0/1452075472 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90d4147ed0 0x7f90d41482f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:46.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.958+0000 7f90d1400640 1 -- 172.21.15.123:0/1452075472 >> v1:172.21.15.164:6789/0 conn(0x7f90d40b61f0 legacy=0x7f90d40b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:46.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.958+0000 7f90d1400640 1 -- 172.21.15.123:0/1452075472 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90d40b49e0 con 0x7f90d40b51e0 2024-04-17T05:33:46.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.958+0000 7f90d1400640 1 -- 172.21.15.123:0/1452075472 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1042962670 0 0) 0x7f90cc0019f0 con 0x7f90d40b51e0 2024-04-17T05:33:46.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.958+0000 7f90d1400640 1 -- 172.21.15.123:0/1452075472 >> v1:172.21.15.123:6789/0 conn(0x7f90d40b51e0 legacy=0x7f90d40b5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:46.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.958+0000 7f90d1400640 1 --2- 172.21.15.123:0/1452075472 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90b80039e0 0x7f90b8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:46.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.958+0000 7f90d1400640 1 --2- 172.21.15.123:0/1452075472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90b8004390 0x7f90b8004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:46.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.958+0000 7f90d1400640 1 --2- 172.21.15.123:0/1452075472 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90d4147ed0 0x7f90b80050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:46.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.958+0000 7f90d1400640 1 -- 172.21.15.123:0/1452075472 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f90d40b4d50 con 0x7f90b8004390 2024-04-17T05:33:46.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.958+0000 7f90d1400640 1 -- 172.21.15.123:0/1452075472 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f90b800b9c0 con 0x7f90b80039e0 2024-04-17T05:33:46.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.958+0000 7f90d1400640 1 -- 172.21.15.123:0/1452075472 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f90b800bbc0 con 0x7f90d4147ed0 2024-04-17T05:33:46.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.958+0000 7f90c9400640 1 --2- 172.21.15.123:0/1452075472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90b8004390 0x7f90b8004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:46.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.959+0000 7f90d1e00640 1 --2- 172.21.15.123:0/1452075472 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90b80039e0 0x7f90b8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:46.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.959+0000 7f90d2800640 1 --2- 172.21.15.123:0/1452075472 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90d4147ed0 0x7f90b80050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:46.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.959+0000 7f90c9400640 1 -- 172.21.15.123:0/1452075472 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90d4147ed0 msgr2=0x7f90b80050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:46.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.959+0000 7f90c9400640 1 --2- 172.21.15.123:0/1452075472 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90d4147ed0 0x7f90b80050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:46.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.959+0000 7f90c9400640 1 -- 172.21.15.123:0/1452075472 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90b80039e0 msgr2=0x7f90b8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:46.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.959+0000 7f90c9400640 1 --2- 172.21.15.123:0/1452075472 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90b80039e0 0x7f90b8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:46.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.959+0000 7f90c9400640 1 -- 172.21.15.123:0/1452075472 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b8003520 con 0x7f90b8004390 2024-04-17T05:33:46.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.959+0000 7f90d2800640 1 --2- 172.21.15.123:0/1452075472 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90d4147ed0 0x7f90b80050c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:33:46.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.960+0000 7f90c9400640 1 --2- 172.21.15.123:0/1452075472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90b8004390 0x7f90b8004860 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f90bc009ac0 tx=0x7f90b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=234eb6fcfc6503a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:46.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.960+0000 7f90d1400640 1 -- 172.21.15.123:0/1452075472 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90bc039070 con 0x7f90b8004390 2024-04-17T05:33:46.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.960+0000 7f90d1400640 1 -- 172.21.15.123:0/1452075472 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90bc02c6b0 con 0x7f90b8004390 2024-04-17T05:33:46.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.960+0000 7f90d1400640 1 -- 172.21.15.123:0/1452075472 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90bc009690 con 0x7f90b8004390 2024-04-17T05:33:46.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.961+0000 7f90d3200640 1 -- 172.21.15.123:0/1452075472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90b8004390 msgr2=0x7f90b8004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:46.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.961+0000 7f90d3200640 1 --2- 172.21.15.123:0/1452075472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90b8004390 0x7f90b8004860 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f90bc009ac0 tx=0x7f90b8005830 comp rx=0 tx=0).stop 2024-04-17T05:33:46.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.961+0000 7f90d2800640 1 -- 172.21.15.123:0/1452075472 reap_dead start 2024-04-17T05:33:46.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.961+0000 7f90d3200640 1 -- 172.21.15.123:0/1452075472 shutdown_connections 2024-04-17T05:33:46.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.961+0000 7f90d3200640 1 -- 172.21.15.123:0/1452075472 >> 172.21.15.123:0/1452075472 conn(0x7f90d406c260 msgr2=0x7f90d40b9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:46.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.961+0000 7f90d3200640 1 -- 172.21.15.123:0/1452075472 shutdown_connections 2024-04-17T05:33:46.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.961+0000 7f90d3200640 1 -- 172.21.15.123:0/1452075472 wait complete. 2024-04-17T05:33:46.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.963+0000 7f90d3200640 1 Processor -- start 2024-04-17T05:33:46.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.963+0000 7f90d3200640 1 -- start start 2024-04-17T05:33:46.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.964+0000 7f90d3200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90b8004390 0x7f90d41dcfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:46.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.964+0000 7f90d3200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90d41450c0 0x7f90d41259b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:46.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.964+0000 7f90d3200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90d412cb10 0x7f90d412cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:46.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.964+0000 7f90d3200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f90d4148470 con 0x7f90d41450c0 2024-04-17T05:33:46.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.964+0000 7f90d3200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f90d41482f0 con 0x7f90b8004390 2024-04-17T05:33:46.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.964+0000 7f90d3200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f90d41485f0 con 0x7f90d412cb10 2024-04-17T05:33:46.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.964+0000 7f90c9400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90d41450c0 0x7f90d41259b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:46.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.964+0000 7f90c9400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90d41450c0 0x7f90d41259b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45982/0 (socket says 172.21.15.123:45982) 2024-04-17T05:33:46.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.964+0000 7f90c9400640 1 -- 172.21.15.123:0/3447245951 learned_addr learned my addr 172.21.15.123:0/3447245951 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:46.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.964+0000 7f90d1e00640 1 --2- 172.21.15.123:0/3447245951 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90b8004390 0x7f90d41dcfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:46.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.965+0000 7f90d2800640 1 --2- 172.21.15.123:0/3447245951 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90d412cb10 0x7f90d412cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:46.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.965+0000 7f90c9400640 1 -- 172.21.15.123:0/3447245951 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90d412cb10 msgr2=0x7f90d412cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:46.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.965+0000 7f90c9400640 1 --2- 172.21.15.123:0/3447245951 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90d412cb10 0x7f90d412cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:46.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.965+0000 7f90c9400640 1 -- 172.21.15.123:0/3447245951 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90b8004390 msgr2=0x7f90d41dcfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:46.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.965+0000 7f90c9400640 1 --2- 172.21.15.123:0/3447245951 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90b8004390 0x7f90d41dcfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:46.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.965+0000 7f90c9400640 1 -- 172.21.15.123:0/3447245951 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90d4126e20 con 0x7f90d41450c0 2024-04-17T05:33:46.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.965+0000 7f90d2800640 1 --2- 172.21.15.123:0/3447245951 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90d412cb10 0x7f90d412cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:33:46.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.965+0000 7f90c9400640 1 --2- 172.21.15.123:0/3447245951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90d41450c0 0x7f90d41259b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f90bc009be0 tx=0x7f90bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:46.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.965+0000 7f90caa00640 1 -- 172.21.15.123:0/3447245951 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90bc042020 con 0x7f90d41450c0 2024-04-17T05:33:46.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.965+0000 7f90caa00640 1 -- 172.21.15.123:0/3447245951 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90bc03a040 con 0x7f90d41450c0 2024-04-17T05:33:46.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.965+0000 7f90d3200640 1 -- 172.21.15.123:0/3447245951 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90d4125050 con 0x7f90d41450c0 2024-04-17T05:33:46.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.965+0000 7f90caa00640 1 -- 172.21.15.123:0/3447245951 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90bc039070 con 0x7f90d41450c0 2024-04-17T05:33:46.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.966+0000 7f90d3200640 1 -- 172.21.15.123:0/3447245951 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90d41dd510 con 0x7f90d41450c0 2024-04-17T05:33:46.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.967+0000 7f90d3200640 1 -- 172.21.15.123:0/3447245951 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90d4075b30 con 0x7f90d41450c0 2024-04-17T05:33:46.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.968+0000 7f90caa00640 1 -- 172.21.15.123:0/3447245951 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f90bc045020 con 0x7f90d41450c0 2024-04-17T05:33:46.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.968+0000 7f90caa00640 1 --2- 172.21.15.123:0/3447245951 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f90b006c8f0 0x7f90b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:46.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.969+0000 7f90caa00640 1 -- 172.21.15.123:0/3447245951 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f90bc0adb60 con 0x7f90d41450c0 2024-04-17T05:33:46.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.969+0000 7f90d1e00640 1 --2- 172.21.15.123:0/3447245951 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f90b006c8f0 0x7f90b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:46.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.970+0000 7f90d1e00640 1 --2- 172.21.15.123:0/3447245951 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f90b006c8f0 0x7f90b006edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f90c4005500 tx=0x7f90c4007f10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:46.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:46.973+0000 7f90caa00640 1 -- 172.21.15.123:0/3447245951 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f90bc04c020 con 0x7f90d41450c0 2024-04-17T05:33:47.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:47.190+0000 7f90d3200640 1 -- 172.21.15.123:0/3447245951 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f90d40b72c0 con 0x7f90d41450c0 2024-04-17T05:33:47.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:47.190+0000 7f90caa00640 1 -- 172.21.15.123:0/3447245951 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7f90bc07bb60 con 0x7f90d41450c0 2024-04-17T05:33:47.188 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-04-17T05:33:47.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:47.193+0000 7f90d3200640 1 -- 172.21.15.123:0/3447245951 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f90b006c8f0 msgr2=0x7f90b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:47.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:47.193+0000 7f90d3200640 1 --2- 172.21.15.123:0/3447245951 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f90b006c8f0 0x7f90b006edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f90c4005500 tx=0x7f90c4007f10 comp rx=0 tx=0).stop 2024-04-17T05:33:47.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:47.193+0000 7f90d3200640 1 -- 172.21.15.123:0/3447245951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90d41450c0 msgr2=0x7f90d41259b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:47.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:47.193+0000 7f90d3200640 1 --2- 172.21.15.123:0/3447245951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90d41450c0 0x7f90d41259b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f90bc009be0 tx=0x7f90bc004730 comp rx=0 tx=0).stop 2024-04-17T05:33:47.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:47.193+0000 7f90d3200640 1 -- 172.21.15.123:0/3447245951 shutdown_connections 2024-04-17T05:33:47.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:47.193+0000 7f90d3200640 1 --2- 172.21.15.123:0/3447245951 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f90b006c8f0 0x7f90b006edb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:47.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:47.193+0000 7f90d3200640 1 --2- 172.21.15.123:0/3447245951 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f90d412cb10 0x7f90d412cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:47.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:47.193+0000 7f90d3200640 1 --2- 172.21.15.123:0/3447245951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90d41450c0 0x7f90d41259b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:47.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:47.193+0000 7f90d3200640 1 --2- 172.21.15.123:0/3447245951 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90b8004390 0x7f90d41dcfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:47.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:47.193+0000 7f90d3200640 1 -- 172.21.15.123:0/3447245951 >> 172.21.15.123:0/3447245951 conn(0x7f90d406c260 msgr2=0x7f90d41461a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:47.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:47.193+0000 7f90d3200640 1 -- 172.21.15.123:0/3447245951 shutdown_connections 2024-04-17T05:33:47.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:47.193+0000 7f90d3200640 1 -- 172.21.15.123:0/3447245951 wait complete. 2024-04-17T05:33:47.210 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi123.front.sepia.ceph.com... 2024-04-17T05:33:47.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T05:33:47.210 DEBUG:teuthology.orchestra.run.smithi123:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-17T05:33:47.315 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi123.stderr:ceph-fuse[46921]: fuse finished with error 0 and tester_r 0 2024-04-17T05:33:47.319 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T05:33:49.313 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:33:49.321 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:33:53.421 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-04-17T05:33:53.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T05:33:53.421 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-17T05:33:53.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T05:33:53.493 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-04-17T05:33:53.588 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-17T05:33:53.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T05:33:53.590 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T05:33:53.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T05:33:53.691 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link delete ceph-brx 2024-04-17T05:33:53.810 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-17T05:33:53.821 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-17T05:33:53.821 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T05:33:54.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.025+0000 7f8e1c200640 1 Processor -- start 2024-04-17T05:33:54.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.026+0000 7f8e1c200640 1 -- start start 2024-04-17T05:33:54.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.026+0000 7f8e1c200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8e1406d2d0 0x7f8e140afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:54.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.026+0000 7f8e1c200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e1406e450 con 0x7f8e140963e0 2024-04-17T05:33:54.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.026+0000 7f8e1c200640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e1406d6b0 con 0x7f8e140b0000 2024-04-17T05:33:54.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.026+0000 7f8e1c200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f8e140ae520 con 0x7f8e1406d2d0 2024-04-17T05:33:54.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.027+0000 7f8e19800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8e1406d2d0 0x7f8e140afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:54.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.027+0000 7f8e1a200640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8e140963e0 0x7f8e1415f270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:42166/0 (socket says 172.21.15.123:42166) 2024-04-17T05:33:54.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.027+0000 7f8e1a200640 1 -- 172.21.15.123:0/1146321043 learned_addr learned my addr 172.21.15.123:0/1146321043 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:33:54.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.027+0000 7f8e13e00640 1 -- 172.21.15.123:0/1146321043 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1671782506 0 0) 0x7f8e1406e450 con 0x7f8e140963e0 2024-04-17T05:33:54.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.035+0000 7f8e13e00640 1 -- 172.21.15.123:0/1146321043 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8dfc003500 con 0x7f8e140963e0 2024-04-17T05:33:54.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.035+0000 7f8e13e00640 1 -- 172.21.15.123:0/1146321043 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 252174564 0 0) 0x7f8e1406d6b0 con 0x7f8e140b0000 2024-04-17T05:33:54.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.036+0000 7f8e13e00640 1 -- 172.21.15.123:0/1146321043 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e1406e450 con 0x7f8e140b0000 2024-04-17T05:33:54.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.036+0000 7f8e19800640 1 -- 172.21.15.123:0/1146321043 >> v1:172.21.15.164:6789/0 conn(0x7f8e140b0000 legacy=0x7f8e14095cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:54.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.036+0000 7f8e19800640 1 -- 172.21.15.123:0/1146321043 >> v1:172.21.15.123:6789/0 conn(0x7f8e140963e0 legacy=0x7f8e1415f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:54.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.036+0000 7f8e19800640 1 -- 172.21.15.123:0/1146321043 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e140b9ed0 con 0x7f8e1406d2d0 2024-04-17T05:33:54.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.037+0000 7f8e19800640 1 --2- 172.21.15.123:0/1146321043 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e1406d2d0 0x7f8e140afac0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8e080097d0 tx=0x7f8e0802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d566cea94b7be4e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:54.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.037+0000 7f8e13e00640 1 -- 172.21.15.123:0/1146321043 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e08034020 con 0x7f8e1406d2d0 2024-04-17T05:33:54.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.037+0000 7f8e13e00640 1 -- 172.21.15.123:0/1146321043 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e080092d0 con 0x7f8e1406d2d0 2024-04-17T05:33:54.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.037+0000 7f8e13e00640 1 -- 172.21.15.123:0/1146321043 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e080076b0 con 0x7f8e1406d2d0 2024-04-17T05:33:54.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.038+0000 7f8e1c200640 1 -- 172.21.15.123:0/1146321043 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e1406d2d0 msgr2=0x7f8e140afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:54.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.038+0000 7f8e1c200640 1 --2- 172.21.15.123:0/1146321043 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e1406d2d0 0x7f8e140afac0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8e080097d0 tx=0x7f8e0802b960 comp rx=0 tx=0).stop 2024-04-17T05:33:54.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.038+0000 7f8e1c200640 1 -- 172.21.15.123:0/1146321043 shutdown_connections 2024-04-17T05:33:54.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.038+0000 7f8e1c200640 1 --2- 172.21.15.123:0/1146321043 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e1406d2d0 0x7f8e140afac0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:54.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.038+0000 7f8e1c200640 1 -- 172.21.15.123:0/1146321043 >> 172.21.15.123:0/1146321043 conn(0x7f8e140b93b0 msgr2=0x7f8e140b97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:54.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.038+0000 7f8e1c200640 1 -- 172.21.15.123:0/1146321043 shutdown_connections 2024-04-17T05:33:54.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.038+0000 7f8e1c200640 1 -- 172.21.15.123:0/1146321043 wait complete. 2024-04-17T05:33:54.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.040+0000 7f8e1c200640 1 Processor -- start 2024-04-17T05:33:54.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.040+0000 7f8e1c200640 1 -- start start 2024-04-17T05:33:54.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.041+0000 7f8e1c200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e1406d2d0 0x7f8e140b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:54.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.041+0000 7f8e1c200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e140963e0 0x7f8e141ea390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:54.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.041+0000 7f8e1c200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e140b0000 0x7f8e141ea8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:54.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.041+0000 7f8e1c200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8e140b0460 con 0x7f8e140b0000 2024-04-17T05:33:54.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.041+0000 7f8e1c200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8e140b5940 con 0x7f8e1406d2d0 2024-04-17T05:33:54.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.041+0000 7f8e1c200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f8e1409e790 con 0x7f8e140963e0 2024-04-17T05:33:54.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.041+0000 7f8e1a200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e140b0000 0x7f8e141ea8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:54.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.041+0000 7f8e1a200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e140b0000 0x7f8e141ea8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46006/0 (socket says 172.21.15.123:46006) 2024-04-17T05:33:54.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.041+0000 7f8e1a200640 1 -- 172.21.15.123:0/3652615662 learned_addr learned my addr 172.21.15.123:0/3652615662 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:54.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.041+0000 7f8e19800640 1 --2- 172.21.15.123:0/3652615662 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e1406d2d0 0x7f8e140b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:54.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.041+0000 7f8e1a200640 1 -- 172.21.15.123:0/3652615662 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e140963e0 msgr2=0x7f8e141ea390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:54.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.041+0000 7f8e18e00640 1 --2- 172.21.15.123:0/3652615662 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e140963e0 0x7f8e141ea390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:54.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.041+0000 7f8e1a200640 1 --2- 172.21.15.123:0/3652615662 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e140963e0 0x7f8e141ea390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:54.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.041+0000 7f8e1a200640 1 -- 172.21.15.123:0/3652615662 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e1406d2d0 msgr2=0x7f8e140b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:54.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.041+0000 7f8e1a200640 1 --2- 172.21.15.123:0/3652615662 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e1406d2d0 0x7f8e140b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:54.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.041+0000 7f8e1a200640 1 -- 172.21.15.123:0/3652615662 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e14156df0 con 0x7f8e140b0000 2024-04-17T05:33:54.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.041+0000 7f8e19800640 1 --2- 172.21.15.123:0/3652615662 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e1406d2d0 0x7f8e140b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:33:54.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.041+0000 7f8e18e00640 1 --2- 172.21.15.123:0/3652615662 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e140963e0 0x7f8e141ea390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:33:54.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.042+0000 7f8e1a200640 1 --2- 172.21.15.123:0/3652615662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e140b0000 0x7f8e141ea8d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c00cbf0 tx=0x7f8e0c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:54.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.042+0000 7f8e11600640 1 -- 172.21.15.123:0/3652615662 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c017070 con 0x7f8e140b0000 2024-04-17T05:33:54.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.042+0000 7f8e11600640 1 -- 172.21.15.123:0/3652615662 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e0c00ace0 con 0x7f8e140b0000 2024-04-17T05:33:54.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.042+0000 7f8e11600640 1 -- 172.21.15.123:0/3652615662 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c012600 con 0x7f8e140b0000 2024-04-17T05:33:54.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.042+0000 7f8e1c200640 1 -- 172.21.15.123:0/3652615662 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e14158430 con 0x7f8e140b0000 2024-04-17T05:33:54.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.042+0000 7f8e1c200640 1 -- 172.21.15.123:0/3652615662 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e141570b0 con 0x7f8e140b0000 2024-04-17T05:33:54.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.043+0000 7f8e1c200640 1 -- 172.21.15.123:0/3652615662 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e1409e580 con 0x7f8e140b0000 2024-04-17T05:33:54.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.044+0000 7f8e11600640 1 -- 172.21.15.123:0/3652615662 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8e0c01a070 con 0x7f8e140b0000 2024-04-17T05:33:54.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.045+0000 7f8e11600640 1 --2- 172.21.15.123:0/3652615662 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8df406c920 0x7f8df406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:54.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.045+0000 7f8e11600640 1 -- 172.21.15.123:0/3652615662 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f8e0c08bc50 con 0x7f8e140b0000 2024-04-17T05:33:54.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.046+0000 7f8e19800640 1 --2- 172.21.15.123:0/3652615662 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8df406c920 0x7f8df406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:54.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.047+0000 7f8e19800640 1 --2- 172.21.15.123:0/3652615662 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8df406c920 0x7f8df406ede0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8e08035000 tx=0x7f8e08009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:54.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.050+0000 7f8e11600640 1 -- 172.21.15.123:0/3652615662 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f8e1409e580 con 0x7f8e140b0000 2024-04-17T05:33:54.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.251+0000 7f8e1c200640 1 -- 172.21.15.123:0/3652615662 --> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8e14097930 con 0x7f8df406c920 2024-04-17T05:33:54.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.282+0000 7f8e11600640 1 -- 172.21.15.123:0/3652615662 <== mgr.4103 v2:172.21.15.164:6832/4204006015 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332872 (secure 0 0 0) 0x7f8e14097930 con 0x7f8df406c920 2024-04-17T05:33:54.287 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:33:54.289 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-04-17T05:33:54.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.288+0000 7f8e1c200640 1 -- 172.21.15.123:0/3652615662 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8df406c920 msgr2=0x7f8df406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:54.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.288+0000 7f8e1c200640 1 --2- 172.21.15.123:0/3652615662 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8df406c920 0x7f8df406ede0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8e08035000 tx=0x7f8e08009000 comp rx=0 tx=0).stop 2024-04-17T05:33:54.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.288+0000 7f8e1c200640 1 -- 172.21.15.123:0/3652615662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e140b0000 msgr2=0x7f8e141ea8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:54.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.288+0000 7f8e1c200640 1 --2- 172.21.15.123:0/3652615662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e140b0000 0x7f8e141ea8d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c00cbf0 tx=0x7f8e0c00a430 comp rx=0 tx=0).stop 2024-04-17T05:33:54.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.288+0000 7f8e1c200640 1 -- 172.21.15.123:0/3652615662 shutdown_connections 2024-04-17T05:33:54.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.288+0000 7f8e1c200640 1 --2- 172.21.15.123:0/3652615662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e140b0000 0x7f8e141ea8d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:54.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.288+0000 7f8e1c200640 1 --2- 172.21.15.123:0/3652615662 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f8df406c920 0x7f8df406ede0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:54.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.288+0000 7f8e1c200640 1 --2- 172.21.15.123:0/3652615662 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f8e140963e0 0x7f8e141ea390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:54.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.288+0000 7f8e1c200640 1 --2- 172.21.15.123:0/3652615662 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e1406d2d0 0x7f8e140b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:54.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.288+0000 7f8e1c200640 1 -- 172.21.15.123:0/3652615662 >> 172.21.15.123:0/3652615662 conn(0x7f8e140b93b0 msgr2=0x7f8e14098130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:54.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.288+0000 7f8e1c200640 1 -- 172.21.15.123:0/3652615662 shutdown_connections 2024-04-17T05:33:54.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.288+0000 7f8e1c200640 1 -- 172.21.15.123:0/3652615662 wait complete. 2024-04-17T05:33:54.308 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":235,"stamp":"2024-04-17T05:33:52.479321+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1536271,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":152,"num_read_kb":136,"num_write":562,"num_write_kb":3543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1014,"ondisk_log_size":1014,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225688,"kb_used_data":5400,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749032,"statfs":{"total":773094113280,"available":772863008768,"internally_reserved":0,"allocated":5529600,"data_stored":4051390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":83,"apply_latency_ms":83,"commit_latency_ns":83000000,"apply_latency_ns":83000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14151,"num_objects":-1,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":24,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005306"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:05.380186+0000","last_change":"2024-04-17T05:26:52.205802+0000","last_active":"2024-04-17T05:31:05.380186+0000","last_peered":"2024-04-17T05:31:05.380186+0000","last_clean":"2024-04-17T05:31:05.380186+0000","last_became_active":"2024-04-17T05:26:52.205459+0000","last_became_peered":"2024-04-17T05:26:52.205459+0000","last_unstale":"2024-04-17T05:31:05.380186+0000","last_undegraded":"2024-04-17T05:31:05.380186+0000","last_fullsized":"2024-04-17T05:31:05.380186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:12:06.528342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.381240+0000","last_change":"2024-04-17T05:26:53.231441+0000","last_active":"2024-04-17T05:33:47.381240+0000","last_peered":"2024-04-17T05:33:47.381240+0000","last_clean":"2024-04-17T05:33:47.381240+0000","last_became_active":"2024-04-17T05:26:53.231139+0000","last_became_peered":"2024-04-17T05:26:53.231139+0000","last_unstale":"2024-04-17T05:33:47.381240+0000","last_undegraded":"2024-04-17T05:33:47.381240+0000","last_fullsized":"2024-04-17T05:33:47.381240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:38:13.010763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:25.362764+0000","last_change":"2024-04-17T05:26:57.347742+0000","last_active":"2024-04-17T05:29:25.362764+0000","last_peered":"2024-04-17T05:29:25.362764+0000","last_clean":"2024-04-17T05:29:25.362764+0000","last_became_active":"2024-04-17T05:26:57.347333+0000","last_became_peered":"2024-04-17T05:26:57.347333+0000","last_unstale":"2024-04-17T05:29:25.362764+0000","last_undegraded":"2024-04-17T05:29:25.362764+0000","last_fullsized":"2024-04-17T05:29:25.362764+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:23:44.724644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:55.377844+0000","last_change":"2024-04-17T05:26:52.203448+0000","last_active":"2024-04-17T05:30:55.377844+0000","last_peered":"2024-04-17T05:30:55.377844+0000","last_clean":"2024-04-17T05:30:55.377844+0000","last_became_active":"2024-04-17T05:26:52.203161+0000","last_became_peered":"2024-04-17T05:26:52.203161+0000","last_unstale":"2024-04-17T05:30:55.377844+0000","last_undegraded":"2024-04-17T05:30:55.377844+0000","last_fullsized":"2024-04-17T05:30:55.377844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:11:26.292397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.396658+0000","last_change":"2024-04-17T05:26:53.241735+0000","last_active":"2024-04-17T05:33:47.396658+0000","last_peered":"2024-04-17T05:33:47.396658+0000","last_clean":"2024-04-17T05:33:47.396658+0000","last_became_active":"2024-04-17T05:26:53.241460+0000","last_became_peered":"2024-04-17T05:26:53.241460+0000","last_unstale":"2024-04-17T05:33:47.396658+0000","last_undegraded":"2024-04-17T05:33:47.396658+0000","last_fullsized":"2024-04-17T05:33:47.396658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:32.131344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:25.360061+0000","last_change":"2024-04-17T05:26:57.310052+0000","last_active":"2024-04-17T05:29:25.360061+0000","last_peered":"2024-04-17T05:29:25.360061+0000","last_clean":"2024-04-17T05:29:25.360061+0000","last_became_active":"2024-04-17T05:26:57.309057+0000","last_became_peered":"2024-04-17T05:26:57.309057+0000","last_unstale":"2024-04-17T05:29:25.360061+0000","last_undegraded":"2024-04-17T05:29:25.360061+0000","last_fullsized":"2024-04-17T05:29:25.360061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:32:29.420749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'6","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:42.521017+0000","last_change":"2024-04-17T05:26:52.217413+0000","last_active":"2024-04-17T05:29:42.521017+0000","last_peered":"2024-04-17T05:29:42.521017+0000","last_clean":"2024-04-17T05:29:42.521017+0000","last_became_active":"2024-04-17T05:26:52.217101+0000","last_became_peered":"2024-04-17T05:26:52.217101+0000","last_unstale":"2024-04-17T05:29:42.521017+0000","last_undegraded":"2024-04-17T05:29:42.521017+0000","last_fullsized":"2024-04-17T05:29:42.521017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:39:51.930934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'8","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.393645+0000","last_change":"2024-04-17T05:26:53.219012+0000","last_active":"2024-04-17T05:33:47.393645+0000","last_peered":"2024-04-17T05:33:47.393645+0000","last_clean":"2024-04-17T05:33:47.393645+0000","last_became_active":"2024-04-17T05:26:53.216591+0000","last_became_peered":"2024-04-17T05:26:53.216591+0000","last_unstale":"2024-04-17T05:33:47.393645+0000","last_undegraded":"2024-04-17T05:33:47.393645+0000","last_fullsized":"2024-04-17T05:33:47.393645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:02:12.833146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:30.361050+0000","last_change":"2024-04-17T05:26:57.310537+0000","last_active":"2024-04-17T05:29:30.361050+0000","last_peered":"2024-04-17T05:29:30.361050+0000","last_clean":"2024-04-17T05:29:30.361050+0000","last_became_active":"2024-04-17T05:26:57.309381+0000","last_became_peered":"2024-04-17T05:26:57.309381+0000","last_unstale":"2024-04-17T05:29:30.361050+0000","last_undegraded":"2024-04-17T05:29:30.361050+0000","last_fullsized":"2024-04-17T05:29:30.361050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:38:17.093545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'5","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:55.432886+0000","last_change":"2024-04-17T05:26:52.218309+0000","last_active":"2024-04-17T05:31:55.432886+0000","last_peered":"2024-04-17T05:31:55.432886+0000","last_clean":"2024-04-17T05:31:55.432886+0000","last_became_active":"2024-04-17T05:26:52.217898+0000","last_became_peered":"2024-04-17T05:26:52.217898+0000","last_unstale":"2024-04-17T05:31:55.432886+0000","last_undegraded":"2024-04-17T05:31:55.432886+0000","last_fullsized":"2024-04-17T05:31:55.432886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:16:02.152039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'14","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.396662+0000","last_change":"2024-04-17T05:26:53.232546+0000","last_active":"2024-04-17T05:33:47.396662+0000","last_peered":"2024-04-17T05:33:47.396662+0000","last_clean":"2024-04-17T05:33:47.396662+0000","last_became_active":"2024-04-17T05:26:53.232239+0000","last_became_peered":"2024-04-17T05:26:53.232239+0000","last_unstale":"2024-04-17T05:33:47.396662+0000","last_undegraded":"2024-04-17T05:33:47.396662+0000","last_fullsized":"2024-04-17T05:33:47.396662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:38:13.010763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:30.361003+0000","last_change":"2024-04-17T05:26:57.297256+0000","last_active":"2024-04-17T05:29:30.361003+0000","last_peered":"2024-04-17T05:29:30.361003+0000","last_clean":"2024-04-17T05:29:30.361003+0000","last_became_active":"2024-04-17T05:26:57.296757+0000","last_became_peered":"2024-04-17T05:26:57.296757+0000","last_unstale":"2024-04-17T05:29:30.361003+0000","last_undegraded":"2024-04-17T05:29:30.361003+0000","last_fullsized":"2024-04-17T05:29:30.361003+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:45:59.432940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.386895+0000","last_change":"2024-04-17T05:26:53.244539+0000","last_active":"2024-04-17T05:33:47.386895+0000","last_peered":"2024-04-17T05:33:47.386895+0000","last_clean":"2024-04-17T05:33:47.386895+0000","last_became_active":"2024-04-17T05:26:53.244104+0000","last_became_peered":"2024-04-17T05:26:53.244104+0000","last_unstale":"2024-04-17T05:33:47.386895+0000","last_undegraded":"2024-04-17T05:33:47.386895+0000","last_fullsized":"2024-04-17T05:33:47.386895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:41:48.514881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'8","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:25.427323+0000","last_change":"2024-04-17T05:26:52.214434+0000","last_active":"2024-04-17T05:31:25.427323+0000","last_peered":"2024-04-17T05:31:25.427323+0000","last_clean":"2024-04-17T05:31:25.427323+0000","last_became_active":"2024-04-17T05:26:52.214158+0000","last_became_peered":"2024-04-17T05:26:52.214158+0000","last_unstale":"2024-04-17T05:31:25.427323+0000","last_undegraded":"2024-04-17T05:31:25.427323+0000","last_fullsized":"2024-04-17T05:31:25.427323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:36:56.201576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:30.379674+0000","last_change":"2024-04-17T05:26:57.307151+0000","last_active":"2024-04-17T05:31:30.379674+0000","last_peered":"2024-04-17T05:31:30.379674+0000","last_clean":"2024-04-17T05:31:30.379674+0000","last_became_active":"2024-04-17T05:26:57.305676+0000","last_became_peered":"2024-04-17T05:26:57.305676+0000","last_unstale":"2024-04-17T05:31:30.379674+0000","last_undegraded":"2024-04-17T05:31:30.379674+0000","last_fullsized":"2024-04-17T05:31:30.379674+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:40:55.126943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.377372+0000","last_change":"2024-04-17T05:26:53.230514+0000","last_active":"2024-04-17T05:33:47.377372+0000","last_peered":"2024-04-17T05:33:47.377372+0000","last_clean":"2024-04-17T05:33:47.377372+0000","last_became_active":"2024-04-17T05:26:53.230175+0000","last_became_peered":"2024-04-17T05:26:53.230175+0000","last_unstale":"2024-04-17T05:33:47.377372+0000","last_undegraded":"2024-04-17T05:33:47.377372+0000","last_fullsized":"2024-04-17T05:33:47.377372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:32.131344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:15.387164+0000","last_change":"2024-04-17T05:26:52.207664+0000","last_active":"2024-04-17T05:31:15.387164+0000","last_peered":"2024-04-17T05:31:15.387164+0000","last_clean":"2024-04-17T05:31:15.387164+0000","last_became_active":"2024-04-17T05:26:52.207343+0000","last_became_peered":"2024-04-17T05:26:52.207343+0000","last_unstale":"2024-04-17T05:31:15.387164+0000","last_undegraded":"2024-04-17T05:31:15.387164+0000","last_fullsized":"2024-04-17T05:31:15.387164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:05:28.743450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:30.379630+0000","last_change":"2024-04-17T05:26:57.311205+0000","last_active":"2024-04-17T05:31:30.379630+0000","last_peered":"2024-04-17T05:31:30.379630+0000","last_clean":"2024-04-17T05:31:30.379630+0000","last_became_active":"2024-04-17T05:26:57.310038+0000","last_became_peered":"2024-04-17T05:26:57.310038+0000","last_unstale":"2024-04-17T05:31:30.379630+0000","last_undegraded":"2024-04-17T05:31:30.379630+0000","last_fullsized":"2024-04-17T05:31:30.379630+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:02:16.915928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'6","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.369668+0000","last_change":"2024-04-17T05:27:39.897206+0000","last_active":"2024-04-17T05:33:47.369668+0000","last_peered":"2024-04-17T05:33:47.369668+0000","last_clean":"2024-04-17T05:33:47.369668+0000","last_became_active":"2024-04-17T05:27:39.896306+0000","last_became_peered":"2024-04-17T05:27:39.896306+0000","last_unstale":"2024-04-17T05:33:47.369668+0000","last_undegraded":"2024-04-17T05:33:47.369668+0000","last_fullsized":"2024-04-17T05:33:47.369668+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:40:51.044161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:15.387119+0000","last_change":"2024-04-17T05:26:52.207557+0000","last_active":"2024-04-17T05:31:15.387119+0000","last_peered":"2024-04-17T05:31:15.387119+0000","last_clean":"2024-04-17T05:31:15.387119+0000","last_became_active":"2024-04-17T05:26:52.207019+0000","last_became_peered":"2024-04-17T05:26:52.207019+0000","last_unstale":"2024-04-17T05:31:15.387119+0000","last_undegraded":"2024-04-17T05:31:15.387119+0000","last_fullsized":"2024-04-17T05:31:15.387119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:43.039139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:30.389826+0000","last_change":"2024-04-17T05:26:57.345734+0000","last_active":"2024-04-17T05:31:30.389826+0000","last_peered":"2024-04-17T05:31:30.389826+0000","last_clean":"2024-04-17T05:31:30.389826+0000","last_became_active":"2024-04-17T05:26:57.345300+0000","last_became_peered":"2024-04-17T05:26:57.345300+0000","last_unstale":"2024-04-17T05:31:30.389826+0000","last_undegraded":"2024-04-17T05:31:30.389826+0000","last_fullsized":"2024-04-17T05:31:30.389826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:45:07.123915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"28'3","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.385628+0000","last_change":"2024-04-17T05:26:53.218687+0000","last_active":"2024-04-17T05:33:47.385628+0000","last_peered":"2024-04-17T05:33:47.385628+0000","last_clean":"2024-04-17T05:33:47.385628+0000","last_became_active":"2024-04-17T05:26:53.218355+0000","last_became_peered":"2024-04-17T05:26:53.218355+0000","last_unstale":"2024-04-17T05:33:47.385628+0000","last_undegraded":"2024-04-17T05:33:47.385628+0000","last_fullsized":"2024-04-17T05:33:47.385628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:05:29.762149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:15.425628+0000","last_change":"2024-04-17T05:26:52.214868+0000","last_active":"2024-04-17T05:31:15.425628+0000","last_peered":"2024-04-17T05:31:15.425628+0000","last_clean":"2024-04-17T05:31:15.425628+0000","last_became_active":"2024-04-17T05:26:52.214633+0000","last_became_peered":"2024-04-17T05:26:52.214633+0000","last_unstale":"2024-04-17T05:31:15.425628+0000","last_undegraded":"2024-04-17T05:31:15.425628+0000","last_fullsized":"2024-04-17T05:31:15.425628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:10:33.072665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:30.379693+0000","last_change":"2024-04-17T05:26:57.309644+0000","last_active":"2024-04-17T05:31:30.379693+0000","last_peered":"2024-04-17T05:31:30.379693+0000","last_clean":"2024-04-17T05:31:30.379693+0000","last_became_active":"2024-04-17T05:26:57.309175+0000","last_became_peered":"2024-04-17T05:26:57.309175+0000","last_unstale":"2024-04-17T05:31:30.379693+0000","last_undegraded":"2024-04-17T05:31:30.379693+0000","last_fullsized":"2024-04-17T05:31:30.379693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:31:30.903722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.375868+0000","last_change":"2024-04-17T05:26:53.220368+0000","last_active":"2024-04-17T05:33:47.375868+0000","last_peered":"2024-04-17T05:33:47.375868+0000","last_clean":"2024-04-17T05:33:47.375868+0000","last_became_active":"2024-04-17T05:26:53.220068+0000","last_became_peered":"2024-04-17T05:26:53.220068+0000","last_unstale":"2024-04-17T05:33:47.375868+0000","last_undegraded":"2024-04-17T05:33:47.375868+0000","last_fullsized":"2024-04-17T05:33:47.375868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:04:57.213834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:15.414626+0000","last_change":"2024-04-17T05:26:52.215954+0000","last_active":"2024-04-17T05:31:15.414626+0000","last_peered":"2024-04-17T05:31:15.414626+0000","last_clean":"2024-04-17T05:31:15.414626+0000","last_became_active":"2024-04-17T05:26:52.215637+0000","last_became_peered":"2024-04-17T05:26:52.215637+0000","last_unstale":"2024-04-17T05:31:15.414626+0000","last_undegraded":"2024-04-17T05:31:15.414626+0000","last_fullsized":"2024-04-17T05:31:15.414626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:05:12.780620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:10.376588+0000","last_change":"2024-04-17T05:26:57.342654+0000","last_active":"2024-04-17T05:31:10.376588+0000","last_peered":"2024-04-17T05:31:10.376588+0000","last_clean":"2024-04-17T05:31:10.376588+0000","last_became_active":"2024-04-17T05:26:57.342205+0000","last_became_peered":"2024-04-17T05:26:57.342205+0000","last_unstale":"2024-04-17T05:31:10.376588+0000","last_undegraded":"2024-04-17T05:31:10.376588+0000","last_fullsized":"2024-04-17T05:31:10.376588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:08:20.405780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.381614+0000","last_change":"2024-04-17T05:26:53.238192+0000","last_active":"2024-04-17T05:33:47.381614+0000","last_peered":"2024-04-17T05:33:47.381614+0000","last_clean":"2024-04-17T05:33:47.381614+0000","last_became_active":"2024-04-17T05:26:53.237901+0000","last_became_peered":"2024-04-17T05:26:53.237901+0000","last_unstale":"2024-04-17T05:33:47.381614+0000","last_undegraded":"2024-04-17T05:33:47.381614+0000","last_fullsized":"2024-04-17T05:33:47.381614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:31:26.820940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'106","reported_seq":135,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:46.314246+0000","last_change":"2024-04-17T05:26:52.213337+0000","last_active":"2024-04-17T05:33:46.314246+0000","last_peered":"2024-04-17T05:33:46.314246+0000","last_clean":"2024-04-17T05:33:46.314246+0000","last_became_active":"2024-04-17T05:26:52.213091+0000","last_became_peered":"2024-04-17T05:26:52.213091+0000","last_unstale":"2024-04-17T05:33:46.314246+0000","last_undegraded":"2024-04-17T05:33:46.314246+0000","last_fullsized":"2024-04-17T05:33:46.314246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:26.013417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":210,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:00.378550+0000","last_change":"2024-04-17T05:26:57.342025+0000","last_active":"2024-04-17T05:31:00.378550+0000","last_peered":"2024-04-17T05:31:00.378550+0000","last_clean":"2024-04-17T05:31:00.378550+0000","last_became_active":"2024-04-17T05:26:57.341654+0000","last_became_peered":"2024-04-17T05:26:57.341654+0000","last_unstale":"2024-04-17T05:31:00.378550+0000","last_undegraded":"2024-04-17T05:31:00.378550+0000","last_fullsized":"2024-04-17T05:31:00.378550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:43:39.199679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'11","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.364293+0000","last_change":"2024-04-17T05:26:53.220626+0000","last_active":"2024-04-17T05:33:47.364293+0000","last_peered":"2024-04-17T05:33:47.364293+0000","last_clean":"2024-04-17T05:33:47.364293+0000","last_became_active":"2024-04-17T05:26:53.220331+0000","last_became_peered":"2024-04-17T05:26:53.220331+0000","last_unstale":"2024-04-17T05:33:47.364293+0000","last_undegraded":"2024-04-17T05:33:47.364293+0000","last_fullsized":"2024-04-17T05:33:47.364293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:32:25.337967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:05.423944+0000","last_change":"2024-04-17T05:26:52.216060+0000","last_active":"2024-04-17T05:31:05.423944+0000","last_peered":"2024-04-17T05:31:05.423944+0000","last_clean":"2024-04-17T05:31:05.423944+0000","last_became_active":"2024-04-17T05:26:52.215771+0000","last_became_peered":"2024-04-17T05:26:52.215771+0000","last_unstale":"2024-04-17T05:31:05.423944+0000","last_undegraded":"2024-04-17T05:31:05.423944+0000","last_fullsized":"2024-04-17T05:31:05.423944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:14:11.769826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'5","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:32:12.762866+0000","last_change":"2024-04-17T05:27:39.587602+0000","last_active":"2024-04-17T05:32:12.762866+0000","last_peered":"2024-04-17T05:32:12.762866+0000","last_clean":"2024-04-17T05:32:12.762866+0000","last_became_active":"2024-04-17T05:27:39.586593+0000","last_became_peered":"2024-04-17T05:27:39.586593+0000","last_unstale":"2024-04-17T05:32:12.762866+0000","last_undegraded":"2024-04-17T05:32:12.762866+0000","last_fullsized":"2024-04-17T05:32:12.762866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:46:03.707528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.396983+0000","last_change":"2024-04-17T05:26:53.238977+0000","last_active":"2024-04-17T05:33:47.396983+0000","last_peered":"2024-04-17T05:33:47.396983+0000","last_clean":"2024-04-17T05:33:47.396983+0000","last_became_active":"2024-04-17T05:26:53.238516+0000","last_became_peered":"2024-04-17T05:26:53.238516+0000","last_unstale":"2024-04-17T05:33:47.396983+0000","last_undegraded":"2024-04-17T05:33:47.396983+0000","last_fullsized":"2024-04-17T05:33:47.396983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:59:47.655532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:05.385269+0000","last_change":"2024-04-17T05:26:52.204960+0000","last_active":"2024-04-17T05:31:05.385269+0000","last_peered":"2024-04-17T05:31:05.385269+0000","last_clean":"2024-04-17T05:31:05.385269+0000","last_became_active":"2024-04-17T05:26:52.204529+0000","last_became_peered":"2024-04-17T05:26:52.204529+0000","last_unstale":"2024-04-17T05:31:05.385269+0000","last_undegraded":"2024-04-17T05:31:05.385269+0000","last_fullsized":"2024-04-17T05:31:05.385269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:28.440614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:10.386195+0000","last_change":"2024-04-17T05:26:57.300433+0000","last_active":"2024-04-17T05:31:10.386195+0000","last_peered":"2024-04-17T05:31:10.386195+0000","last_clean":"2024-04-17T05:31:10.386195+0000","last_became_active":"2024-04-17T05:26:57.299625+0000","last_became_peered":"2024-04-17T05:26:57.299625+0000","last_unstale":"2024-04-17T05:31:10.386195+0000","last_undegraded":"2024-04-17T05:31:10.386195+0000","last_fullsized":"2024-04-17T05:31:10.386195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:59:51.738314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.382415+0000","last_change":"2024-04-17T05:26:53.221039+0000","last_active":"2024-04-17T05:33:47.382415+0000","last_peered":"2024-04-17T05:33:47.382415+0000","last_clean":"2024-04-17T05:33:47.382415+0000","last_became_active":"2024-04-17T05:26:53.220763+0000","last_became_peered":"2024-04-17T05:26:53.220763+0000","last_unstale":"2024-04-17T05:33:47.382415+0000","last_undegraded":"2024-04-17T05:33:47.382415+0000","last_fullsized":"2024-04-17T05:33:47.382415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:06:06.694765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:05.373798+0000","last_change":"2024-04-17T05:26:52.200059+0000","last_active":"2024-04-17T05:31:05.373798+0000","last_peered":"2024-04-17T05:31:05.373798+0000","last_clean":"2024-04-17T05:31:05.373798+0000","last_became_active":"2024-04-17T05:26:52.199528+0000","last_became_peered":"2024-04-17T05:26:52.199528+0000","last_unstale":"2024-04-17T05:31:05.373798+0000","last_undegraded":"2024-04-17T05:31:05.373798+0000","last_fullsized":"2024-04-17T05:31:05.373798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:39:42.873364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'2","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:39.476676+0000","last_change":"2024-04-17T05:27:39.629806+0000","last_active":"2024-04-17T05:33:39.476676+0000","last_peered":"2024-04-17T05:33:39.476676+0000","last_clean":"2024-04-17T05:33:39.476676+0000","last_became_active":"2024-04-17T05:27:39.628034+0000","last_became_peered":"2024-04-17T05:27:39.628034+0000","last_unstale":"2024-04-17T05:33:39.476676+0000","last_undegraded":"2024-04-17T05:33:39.476676+0000","last_fullsized":"2024-04-17T05:33:39.476676+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:39:30.581787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.372142+0000","last_change":"2024-04-17T05:26:53.225946+0000","last_active":"2024-04-17T05:33:47.372142+0000","last_peered":"2024-04-17T05:33:47.372142+0000","last_clean":"2024-04-17T05:33:47.372142+0000","last_became_active":"2024-04-17T05:26:53.220930+0000","last_became_peered":"2024-04-17T05:26:53.220930+0000","last_unstale":"2024-04-17T05:33:47.372142+0000","last_undegraded":"2024-04-17T05:33:47.372142+0000","last_fullsized":"2024-04-17T05:33:47.372142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:08:41.870139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'42","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:42.901807+0000","last_change":"2024-04-17T05:26:52.200139+0000","last_active":"2024-04-17T05:33:42.901807+0000","last_peered":"2024-04-17T05:33:42.901807+0000","last_clean":"2024-04-17T05:33:42.901807+0000","last_became_active":"2024-04-17T05:26:52.199804+0000","last_became_peered":"2024-04-17T05:26:52.199804+0000","last_unstale":"2024-04-17T05:33:42.901807+0000","last_undegraded":"2024-04-17T05:33:42.901807+0000","last_fullsized":"2024-04-17T05:33:42.901807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:05:28.743450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10823,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":36,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:20.388171+0000","last_change":"2024-04-17T05:26:57.303365+0000","last_active":"2024-04-17T05:31:20.388171+0000","last_peered":"2024-04-17T05:31:20.388171+0000","last_clean":"2024-04-17T05:31:20.388171+0000","last_became_active":"2024-04-17T05:26:57.301101+0000","last_became_peered":"2024-04-17T05:26:57.301101+0000","last_unstale":"2024-04-17T05:31:20.388171+0000","last_undegraded":"2024-04-17T05:31:20.388171+0000","last_fullsized":"2024-04-17T05:31:20.388171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:43:39.199679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.386448+0000","last_change":"2024-04-17T05:26:53.238762+0000","last_active":"2024-04-17T05:33:47.386448+0000","last_peered":"2024-04-17T05:33:47.386448+0000","last_clean":"2024-04-17T05:33:47.386448+0000","last_became_active":"2024-04-17T05:26:53.238488+0000","last_became_peered":"2024-04-17T05:26:53.238488+0000","last_unstale":"2024-04-17T05:33:47.386448+0000","last_undegraded":"2024-04-17T05:33:47.386448+0000","last_fullsized":"2024-04-17T05:33:47.386448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:38.214751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:55.422328+0000","last_change":"2024-04-17T05:26:52.213104+0000","last_active":"2024-04-17T05:30:55.422328+0000","last_peered":"2024-04-17T05:30:55.422328+0000","last_clean":"2024-04-17T05:30:55.422328+0000","last_became_active":"2024-04-17T05:26:52.212838+0000","last_became_peered":"2024-04-17T05:26:52.212838+0000","last_unstale":"2024-04-17T05:30:55.422328+0000","last_undegraded":"2024-04-17T05:30:55.422328+0000","last_fullsized":"2024-04-17T05:30:55.422328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:11:58.913400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:20.382835+0000","last_change":"2024-04-17T05:26:57.342387+0000","last_active":"2024-04-17T05:31:20.382835+0000","last_peered":"2024-04-17T05:31:20.382835+0000","last_clean":"2024-04-17T05:31:20.382835+0000","last_became_active":"2024-04-17T05:26:57.342008+0000","last_became_peered":"2024-04-17T05:26:57.342008+0000","last_unstale":"2024-04-17T05:31:20.382835+0000","last_undegraded":"2024-04-17T05:31:20.382835+0000","last_fullsized":"2024-04-17T05:31:20.382835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:43:39.199679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.393491+0000","last_change":"2024-04-17T05:26:53.243046+0000","last_active":"2024-04-17T05:33:47.393491+0000","last_peered":"2024-04-17T05:33:47.393491+0000","last_clean":"2024-04-17T05:33:47.393491+0000","last_became_active":"2024-04-17T05:26:53.242778+0000","last_became_peered":"2024-04-17T05:26:53.242778+0000","last_unstale":"2024-04-17T05:33:47.393491+0000","last_undegraded":"2024-04-17T05:33:47.393491+0000","last_fullsized":"2024-04-17T05:33:47.393491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:32:25.337967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:05.373837+0000","last_change":"2024-04-17T05:26:52.198125+0000","last_active":"2024-04-17T05:31:05.373837+0000","last_peered":"2024-04-17T05:31:05.373837+0000","last_clean":"2024-04-17T05:31:05.373837+0000","last_became_active":"2024-04-17T05:26:52.197762+0000","last_became_peered":"2024-04-17T05:26:52.197762+0000","last_unstale":"2024-04-17T05:31:05.373837+0000","last_undegraded":"2024-04-17T05:31:05.373837+0000","last_fullsized":"2024-04-17T05:31:05.373837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:28.440614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":185,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:50.421452+0000","last_change":"2024-04-17T05:26:48.072527+0000","last_active":"2024-04-17T05:30:50.421452+0000","last_peered":"2024-04-17T05:30:50.421452+0000","last_clean":"2024-04-17T05:30:50.421452+0000","last_became_active":"2024-04-17T05:26:48.070585+0000","last_became_peered":"2024-04-17T05:26:48.070585+0000","last_unstale":"2024-04-17T05:30:50.421452+0000","last_undegraded":"2024-04-17T05:30:50.421452+0000","last_fullsized":"2024-04-17T05:30:50.421452+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:46.995002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:46.995002+0000","last_clean_scrub_stamp":"2024-04-17T05:26:46.995002+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:48:35.792125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:10.413588+0000","last_change":"2024-04-17T05:26:57.346681+0000","last_active":"2024-04-17T05:31:10.413588+0000","last_peered":"2024-04-17T05:31:10.413588+0000","last_clean":"2024-04-17T05:31:10.413588+0000","last_became_active":"2024-04-17T05:26:57.345320+0000","last_became_peered":"2024-04-17T05:26:57.345320+0000","last_unstale":"2024-04-17T05:31:10.413588+0000","last_undegraded":"2024-04-17T05:31:10.413588+0000","last_fullsized":"2024-04-17T05:31:10.413588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:14:02.473527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'5","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.384494+0000","last_change":"2024-04-17T05:27:39.898572+0000","last_active":"2024-04-17T05:33:47.384494+0000","last_peered":"2024-04-17T05:33:47.384494+0000","last_clean":"2024-04-17T05:33:47.384494+0000","last_became_active":"2024-04-17T05:27:39.897777+0000","last_became_peered":"2024-04-17T05:27:39.897777+0000","last_unstale":"2024-04-17T05:33:47.384494+0000","last_undegraded":"2024-04-17T05:33:47.384494+0000","last_fullsized":"2024-04-17T05:33:47.384494+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:31:02.906556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:40.399880+0000","last_change":"2024-04-17T05:26:52.209276+0000","last_active":"2024-04-17T05:33:40.399880+0000","last_peered":"2024-04-17T05:33:40.399880+0000","last_clean":"2024-04-17T05:33:40.399880+0000","last_became_active":"2024-04-17T05:26:52.208422+0000","last_became_peered":"2024-04-17T05:26:52.208422+0000","last_unstale":"2024-04-17T05:33:40.399880+0000","last_undegraded":"2024-04-17T05:33:40.399880+0000","last_fullsized":"2024-04-17T05:33:40.399880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:39:42.873364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:20.415373+0000","last_change":"2024-04-17T05:26:57.342209+0000","last_active":"2024-04-17T05:31:20.415373+0000","last_peered":"2024-04-17T05:31:20.415373+0000","last_clean":"2024-04-17T05:31:20.415373+0000","last_became_active":"2024-04-17T05:26:57.341658+0000","last_became_peered":"2024-04-17T05:26:57.341658+0000","last_unstale":"2024-04-17T05:31:20.415373+0000","last_undegraded":"2024-04-17T05:31:20.415373+0000","last_fullsized":"2024-04-17T05:31:20.415373+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:49.740852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.392825+0000","last_change":"2024-04-17T05:26:53.239720+0000","last_active":"2024-04-17T05:33:47.392825+0000","last_peered":"2024-04-17T05:33:47.392825+0000","last_clean":"2024-04-17T05:33:47.392825+0000","last_became_active":"2024-04-17T05:26:53.238669+0000","last_became_peered":"2024-04-17T05:26:53.238669+0000","last_unstale":"2024-04-17T05:33:47.392825+0000","last_undegraded":"2024-04-17T05:33:47.392825+0000","last_fullsized":"2024-04-17T05:33:47.392825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:58:59.967200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:25.388997+0000","last_change":"2024-04-17T05:26:52.202596+0000","last_active":"2024-04-17T05:31:25.388997+0000","last_peered":"2024-04-17T05:31:25.388997+0000","last_clean":"2024-04-17T05:31:25.388997+0000","last_became_active":"2024-04-17T05:26:52.202246+0000","last_became_peered":"2024-04-17T05:26:52.202246+0000","last_unstale":"2024-04-17T05:31:25.388997+0000","last_undegraded":"2024-04-17T05:31:25.388997+0000","last_fullsized":"2024-04-17T05:31:25.388997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:30.475514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:30.384580+0000","last_change":"2024-04-17T05:26:57.303069+0000","last_active":"2024-04-17T05:31:30.384580+0000","last_peered":"2024-04-17T05:31:30.384580+0000","last_clean":"2024-04-17T05:31:30.384580+0000","last_became_active":"2024-04-17T05:26:57.302457+0000","last_became_peered":"2024-04-17T05:26:57.302457+0000","last_unstale":"2024-04-17T05:31:30.384580+0000","last_undegraded":"2024-04-17T05:31:30.384580+0000","last_fullsized":"2024-04-17T05:31:30.384580+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:45:07.123915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.391025+0000","last_change":"2024-04-17T05:26:53.255140+0000","last_active":"2024-04-17T05:33:47.391025+0000","last_peered":"2024-04-17T05:33:47.391025+0000","last_clean":"2024-04-17T05:33:47.391025+0000","last_became_active":"2024-04-17T05:26:53.254371+0000","last_became_peered":"2024-04-17T05:26:53.254371+0000","last_unstale":"2024-04-17T05:33:47.391025+0000","last_undegraded":"2024-04-17T05:33:47.391025+0000","last_fullsized":"2024-04-17T05:33:47.391025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:33:12.651636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:25.381608+0000","last_change":"2024-04-17T05:26:52.204598+0000","last_active":"2024-04-17T05:31:25.381608+0000","last_peered":"2024-04-17T05:31:25.381608+0000","last_clean":"2024-04-17T05:31:25.381608+0000","last_became_active":"2024-04-17T05:26:52.204139+0000","last_became_peered":"2024-04-17T05:26:52.204139+0000","last_unstale":"2024-04-17T05:31:25.381608+0000","last_undegraded":"2024-04-17T05:31:25.381608+0000","last_fullsized":"2024-04-17T05:31:25.381608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:11:26.292397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:20.376450+0000","last_change":"2024-04-17T05:26:57.345152+0000","last_active":"2024-04-17T05:31:20.376450+0000","last_peered":"2024-04-17T05:31:20.376450+0000","last_clean":"2024-04-17T05:31:20.376450+0000","last_became_active":"2024-04-17T05:26:57.342006+0000","last_became_peered":"2024-04-17T05:26:57.342006+0000","last_unstale":"2024-04-17T05:31:20.376450+0000","last_undegraded":"2024-04-17T05:31:20.376450+0000","last_fullsized":"2024-04-17T05:31:20.376450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:56:05.345989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.389227+0000","last_change":"2024-04-17T05:26:53.253746+0000","last_active":"2024-04-17T05:33:47.389227+0000","last_peered":"2024-04-17T05:33:47.389227+0000","last_clean":"2024-04-17T05:33:47.389227+0000","last_became_active":"2024-04-17T05:26:53.253395+0000","last_became_peered":"2024-04-17T05:26:53.253395+0000","last_unstale":"2024-04-17T05:33:47.389227+0000","last_undegraded":"2024-04-17T05:33:47.389227+0000","last_fullsized":"2024-04-17T05:33:47.389227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:46:38.091860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:25.378894+0000","last_change":"2024-04-17T05:26:52.199105+0000","last_active":"2024-04-17T05:31:25.378894+0000","last_peered":"2024-04-17T05:31:25.378894+0000","last_clean":"2024-04-17T05:31:25.378894+0000","last_became_active":"2024-04-17T05:26:52.198798+0000","last_became_peered":"2024-04-17T05:26:52.198798+0000","last_unstale":"2024-04-17T05:31:25.378894+0000","last_undegraded":"2024-04-17T05:31:25.378894+0000","last_fullsized":"2024-04-17T05:31:25.378894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:34:06.405382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:20.378107+0000","last_change":"2024-04-17T05:26:57.306130+0000","last_active":"2024-04-17T05:31:20.378107+0000","last_peered":"2024-04-17T05:31:20.378107+0000","last_clean":"2024-04-17T05:31:20.378107+0000","last_became_active":"2024-04-17T05:26:57.305415+0000","last_became_peered":"2024-04-17T05:26:57.305415+0000","last_unstale":"2024-04-17T05:31:20.378107+0000","last_undegraded":"2024-04-17T05:31:20.378107+0000","last_fullsized":"2024-04-17T05:31:20.378107+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:36.214126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"28'7","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.386317+0000","last_change":"2024-04-17T05:27:39.579857+0000","last_active":"2024-04-17T05:33:47.386317+0000","last_peered":"2024-04-17T05:33:47.386317+0000","last_clean":"2024-04-17T05:33:47.386317+0000","last_became_active":"2024-04-17T05:27:39.579096+0000","last_became_peered":"2024-04-17T05:27:39.579096+0000","last_unstale":"2024-04-17T05:33:47.386317+0000","last_undegraded":"2024-04-17T05:33:47.386317+0000","last_fullsized":"2024-04-17T05:33:47.386317+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:52:32.392870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"28'11","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:27.598751+0000","last_change":"2024-04-17T05:26:52.197556+0000","last_active":"2024-04-17T05:30:27.598751+0000","last_peered":"2024-04-17T05:30:27.598751+0000","last_clean":"2024-04-17T05:30:27.598751+0000","last_became_active":"2024-04-17T05:26:52.197250+0000","last_became_peered":"2024-04-17T05:26:52.197250+0000","last_unstale":"2024-04-17T05:30:27.598751+0000","last_undegraded":"2024-04-17T05:30:27.598751+0000","last_fullsized":"2024-04-17T05:30:27.598751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:12:06.528342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:25.364162+0000","last_change":"2024-04-17T05:26:57.296438+0000","last_active":"2024-04-17T05:29:25.364162+0000","last_peered":"2024-04-17T05:29:25.364162+0000","last_clean":"2024-04-17T05:29:25.364162+0000","last_became_active":"2024-04-17T05:26:57.296040+0000","last_became_peered":"2024-04-17T05:26:57.296040+0000","last_unstale":"2024-04-17T05:29:25.364162+0000","last_undegraded":"2024-04-17T05:29:25.364162+0000","last_fullsized":"2024-04-17T05:29:25.364162+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:43:13.615366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'9","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.382356+0000","last_change":"2024-04-17T05:26:53.231338+0000","last_active":"2024-04-17T05:33:47.382356+0000","last_peered":"2024-04-17T05:33:47.382356+0000","last_clean":"2024-04-17T05:33:47.382356+0000","last_became_active":"2024-04-17T05:26:53.230987+0000","last_became_peered":"2024-04-17T05:26:53.230987+0000","last_unstale":"2024-04-17T05:33:47.382356+0000","last_undegraded":"2024-04-17T05:33:47.382356+0000","last_fullsized":"2024-04-17T05:33:47.382356+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:08:10.489719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'3","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:17.583470+0000","last_change":"2024-04-17T05:26:52.207087+0000","last_active":"2024-04-17T05:30:17.583470+0000","last_peered":"2024-04-17T05:30:17.583470+0000","last_clean":"2024-04-17T05:30:17.583470+0000","last_became_active":"2024-04-17T05:26:52.206401+0000","last_became_peered":"2024-04-17T05:26:52.206401+0000","last_unstale":"2024-04-17T05:30:17.583470+0000","last_undegraded":"2024-04-17T05:30:17.583470+0000","last_fullsized":"2024-04-17T05:30:17.583470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:56:53.915549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:25.362846+0000","last_change":"2024-04-17T05:26:57.346955+0000","last_active":"2024-04-17T05:29:25.362846+0000","last_peered":"2024-04-17T05:29:25.362846+0000","last_clean":"2024-04-17T05:29:25.362846+0000","last_became_active":"2024-04-17T05:26:57.346516+0000","last_became_peered":"2024-04-17T05:26:57.346516+0000","last_unstale":"2024-04-17T05:29:25.362846+0000","last_undegraded":"2024-04-17T05:29:25.362846+0000","last_fullsized":"2024-04-17T05:29:25.362846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:00:55.830345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"28'20","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.392299+0000","last_change":"2024-04-17T05:26:53.254195+0000","last_active":"2024-04-17T05:33:47.392299+0000","last_peered":"2024-04-17T05:33:47.392299+0000","last_clean":"2024-04-17T05:33:47.392299+0000","last_became_active":"2024-04-17T05:26:53.253813+0000","last_became_peered":"2024-04-17T05:26:53.253813+0000","last_unstale":"2024-04-17T05:33:47.392299+0000","last_undegraded":"2024-04-17T05:33:47.392299+0000","last_fullsized":"2024-04-17T05:33:47.392299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:18:31.208224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'8","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:27.599886+0000","last_change":"2024-04-17T05:26:52.211664+0000","last_active":"2024-04-17T05:30:27.599886+0000","last_peered":"2024-04-17T05:30:27.599886+0000","last_clean":"2024-04-17T05:30:27.599886+0000","last_became_active":"2024-04-17T05:26:52.210106+0000","last_became_peered":"2024-04-17T05:26:52.210106+0000","last_unstale":"2024-04-17T05:30:27.599886+0000","last_undegraded":"2024-04-17T05:30:27.599886+0000","last_fullsized":"2024-04-17T05:30:27.599886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:11:26.292397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:20.361839+0000","last_change":"2024-04-17T05:26:57.344473+0000","last_active":"2024-04-17T05:29:20.361839+0000","last_peered":"2024-04-17T05:29:20.361839+0000","last_clean":"2024-04-17T05:29:20.361839+0000","last_became_active":"2024-04-17T05:26:57.341999+0000","last_became_peered":"2024-04-17T05:26:57.341999+0000","last_unstale":"2024-04-17T05:29:20.361839+0000","last_undegraded":"2024-04-17T05:29:20.361839+0000","last_fullsized":"2024-04-17T05:29:20.361839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:35:19.879335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.386810+0000","last_change":"2024-04-17T05:26:53.235732+0000","last_active":"2024-04-17T05:33:47.386810+0000","last_peered":"2024-04-17T05:33:47.386810+0000","last_clean":"2024-04-17T05:33:47.386810+0000","last_became_active":"2024-04-17T05:26:53.233202+0000","last_became_peered":"2024-04-17T05:26:53.233202+0000","last_unstale":"2024-04-17T05:33:47.386810+0000","last_undegraded":"2024-04-17T05:33:47.386810+0000","last_fullsized":"2024-04-17T05:33:47.386810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:58:23.088108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'4","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:32.503235+0000","last_change":"2024-04-17T05:26:52.194788+0000","last_active":"2024-04-17T05:29:32.503235+0000","last_peered":"2024-04-17T05:29:32.503235+0000","last_clean":"2024-04-17T05:29:32.503235+0000","last_became_active":"2024-04-17T05:26:52.194504+0000","last_became_peered":"2024-04-17T05:26:52.194504+0000","last_unstale":"2024-04-17T05:29:32.503235+0000","last_undegraded":"2024-04-17T05:29:32.503235+0000","last_fullsized":"2024-04-17T05:29:32.503235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:29:09.631143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:25.357676+0000","last_change":"2024-04-17T05:26:57.344052+0000","last_active":"2024-04-17T05:29:25.357676+0000","last_peered":"2024-04-17T05:29:25.357676+0000","last_clean":"2024-04-17T05:29:25.357676+0000","last_became_active":"2024-04-17T05:26:57.343479+0000","last_became_peered":"2024-04-17T05:26:57.343479+0000","last_unstale":"2024-04-17T05:29:25.357676+0000","last_undegraded":"2024-04-17T05:29:25.357676+0000","last_fullsized":"2024-04-17T05:29:25.357676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:23:44.724644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.384414+0000","last_change":"2024-04-17T05:26:53.250744+0000","last_active":"2024-04-17T05:33:47.384414+0000","last_peered":"2024-04-17T05:33:47.384414+0000","last_clean":"2024-04-17T05:33:47.384414+0000","last_became_active":"2024-04-17T05:26:53.249125+0000","last_became_peered":"2024-04-17T05:26:53.249125+0000","last_unstale":"2024-04-17T05:33:47.384414+0000","last_undegraded":"2024-04-17T05:33:47.384414+0000","last_fullsized":"2024-04-17T05:33:47.384414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:29.313074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'95","reported_seq":123,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.322968+0000","last_change":"2024-04-17T05:26:52.208074+0000","last_active":"2024-04-17T05:33:47.322968+0000","last_peered":"2024-04-17T05:33:47.322968+0000","last_clean":"2024-04-17T05:33:47.322968+0000","last_became_active":"2024-04-17T05:26:52.207696+0000","last_became_peered":"2024-04-17T05:26:52.207696+0000","last_unstale":"2024-04-17T05:33:47.322968+0000","last_undegraded":"2024-04-17T05:33:47.322968+0000","last_fullsized":"2024-04-17T05:33:47.322968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:10:33.072665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":934282,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:20.368982+0000","last_change":"2024-04-17T05:26:57.303649+0000","last_active":"2024-04-17T05:29:20.368982+0000","last_peered":"2024-04-17T05:29:20.368982+0000","last_clean":"2024-04-17T05:29:20.368982+0000","last_became_active":"2024-04-17T05:26:57.303124+0000","last_became_peered":"2024-04-17T05:26:57.303124+0000","last_unstale":"2024-04-17T05:29:20.368982+0000","last_undegraded":"2024-04-17T05:29:20.368982+0000","last_fullsized":"2024-04-17T05:29:20.368982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:59:04.049982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'12","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.391609+0000","last_change":"2024-04-17T05:26:53.232911+0000","last_active":"2024-04-17T05:33:47.391609+0000","last_peered":"2024-04-17T05:33:47.391609+0000","last_clean":"2024-04-17T05:33:47.391609+0000","last_became_active":"2024-04-17T05:26:53.232624+0000","last_became_peered":"2024-04-17T05:26:53.232624+0000","last_unstale":"2024-04-17T05:33:47.391609+0000","last_undegraded":"2024-04-17T05:33:47.391609+0000","last_fullsized":"2024-04-17T05:33:47.391609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:31.494213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'26","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:41.911653+0000","last_change":"2024-04-17T05:26:52.207484+0000","last_active":"2024-04-17T05:33:41.911653+0000","last_peered":"2024-04-17T05:33:41.911653+0000","last_clean":"2024-04-17T05:33:41.911653+0000","last_became_active":"2024-04-17T05:26:52.207181+0000","last_became_peered":"2024-04-17T05:26:52.207181+0000","last_unstale":"2024-04-17T05:33:41.911653+0000","last_undegraded":"2024-04-17T05:33:41.911653+0000","last_fullsized":"2024-04-17T05:33:41.911653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:06:05.676066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:20.359125+0000","last_change":"2024-04-17T05:27:39.629173+0000","last_active":"2024-04-17T05:29:20.359125+0000","last_peered":"2024-04-17T05:29:20.359125+0000","last_clean":"2024-04-17T05:29:20.359125+0000","last_became_active":"2024-04-17T05:27:39.627825+0000","last_became_peered":"2024-04-17T05:27:39.627825+0000","last_unstale":"2024-04-17T05:29:20.359125+0000","last_undegraded":"2024-04-17T05:29:20.359125+0000","last_fullsized":"2024-04-17T05:29:20.359125+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:00:55.830345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"28'9","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.396634+0000","last_change":"2024-04-17T05:26:53.241678+0000","last_active":"2024-04-17T05:33:47.396634+0000","last_peered":"2024-04-17T05:33:47.396634+0000","last_clean":"2024-04-17T05:33:47.396634+0000","last_became_active":"2024-04-17T05:26:53.241388+0000","last_became_peered":"2024-04-17T05:26:53.241388+0000","last_unstale":"2024-04-17T05:33:47.396634+0000","last_undegraded":"2024-04-17T05:33:47.396634+0000","last_fullsized":"2024-04-17T05:33:47.396634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:32:25.337967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'7","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:17.584715+0000","last_change":"2024-04-17T05:26:52.213786+0000","last_active":"2024-04-17T05:30:17.584715+0000","last_peered":"2024-04-17T05:30:17.584715+0000","last_clean":"2024-04-17T05:30:17.584715+0000","last_became_active":"2024-04-17T05:26:52.212440+0000","last_became_peered":"2024-04-17T05:26:52.212440+0000","last_unstale":"2024-04-17T05:30:17.584715+0000","last_undegraded":"2024-04-17T05:30:17.584715+0000","last_fullsized":"2024-04-17T05:30:17.584715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:06:05.676066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:20.361590+0000","last_change":"2024-04-17T05:26:57.300596+0000","last_active":"2024-04-17T05:29:20.361590+0000","last_peered":"2024-04-17T05:29:20.361590+0000","last_clean":"2024-04-17T05:29:20.361590+0000","last_became_active":"2024-04-17T05:26:57.300156+0000","last_became_peered":"2024-04-17T05:26:57.300156+0000","last_unstale":"2024-04-17T05:29:20.361590+0000","last_undegraded":"2024-04-17T05:29:20.361590+0000","last_fullsized":"2024-04-17T05:29:20.361590+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:11:16.497552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.395877+0000","last_change":"2024-04-17T05:26:53.238893+0000","last_active":"2024-04-17T05:33:47.395877+0000","last_peered":"2024-04-17T05:33:47.395877+0000","last_clean":"2024-04-17T05:33:47.395877+0000","last_became_active":"2024-04-17T05:26:53.238566+0000","last_became_peered":"2024-04-17T05:26:53.238566+0000","last_unstale":"2024-04-17T05:33:47.395877+0000","last_undegraded":"2024-04-17T05:33:47.395877+0000","last_fullsized":"2024-04-17T05:33:47.395877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:52:32.392870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"28'5","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:27.602689+0000","last_change":"2024-04-17T05:26:52.215304+0000","last_active":"2024-04-17T05:30:27.602689+0000","last_peered":"2024-04-17T05:30:27.602689+0000","last_clean":"2024-04-17T05:30:27.602689+0000","last_became_active":"2024-04-17T05:26:52.214958+0000","last_became_peered":"2024-04-17T05:26:52.214958+0000","last_unstale":"2024-04-17T05:30:27.602689+0000","last_undegraded":"2024-04-17T05:30:27.602689+0000","last_fullsized":"2024-04-17T05:30:27.602689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:13:25.702517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:20.361720+0000","last_change":"2024-04-17T05:26:57.342083+0000","last_active":"2024-04-17T05:29:20.361720+0000","last_peered":"2024-04-17T05:29:20.361720+0000","last_clean":"2024-04-17T05:29:20.361720+0000","last_became_active":"2024-04-17T05:26:57.341304+0000","last_became_peered":"2024-04-17T05:26:57.341304+0000","last_unstale":"2024-04-17T05:29:20.361720+0000","last_undegraded":"2024-04-17T05:29:20.361720+0000","last_fullsized":"2024-04-17T05:29:20.361720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:56:05.345989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:00.379085+0000","last_change":"2024-04-17T05:26:57.342446+0000","last_active":"2024-04-17T05:31:00.379085+0000","last_peered":"2024-04-17T05:31:00.379085+0000","last_clean":"2024-04-17T05:31:00.379085+0000","last_became_active":"2024-04-17T05:26:57.342076+0000","last_became_peered":"2024-04-17T05:26:57.342076+0000","last_unstale":"2024-04-17T05:31:00.379085+0000","last_undegraded":"2024-04-17T05:31:00.379085+0000","last_fullsized":"2024-04-17T05:31:00.379085+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:59:51.738314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'11","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.374673+0000","last_change":"2024-04-17T05:26:53.228706+0000","last_active":"2024-04-17T05:33:47.374673+0000","last_peered":"2024-04-17T05:33:47.374673+0000","last_clean":"2024-04-17T05:33:47.374673+0000","last_became_active":"2024-04-17T05:26:53.228381+0000","last_became_peered":"2024-04-17T05:26:53.228381+0000","last_unstale":"2024-04-17T05:33:47.374673+0000","last_undegraded":"2024-04-17T05:33:47.374673+0000","last_fullsized":"2024-04-17T05:33:47.374673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:04:57.213834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'5","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:27.602400+0000","last_change":"2024-04-17T05:26:52.195697+0000","last_active":"2024-04-17T05:30:27.602400+0000","last_peered":"2024-04-17T05:30:27.602400+0000","last_clean":"2024-04-17T05:30:27.602400+0000","last_became_active":"2024-04-17T05:26:52.193995+0000","last_became_peered":"2024-04-17T05:26:52.193995+0000","last_unstale":"2024-04-17T05:30:27.602400+0000","last_undegraded":"2024-04-17T05:30:27.602400+0000","last_fullsized":"2024-04-17T05:30:27.602400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:05:28.743450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:10.413660+0000","last_change":"2024-04-17T05:26:57.306563+0000","last_active":"2024-04-17T05:31:10.413660+0000","last_peered":"2024-04-17T05:31:10.413660+0000","last_clean":"2024-04-17T05:31:10.413660+0000","last_became_active":"2024-04-17T05:26:57.305777+0000","last_became_peered":"2024-04-17T05:26:57.305777+0000","last_unstale":"2024-04-17T05:31:10.413660+0000","last_undegraded":"2024-04-17T05:31:10.413660+0000","last_fullsized":"2024-04-17T05:31:10.413660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:33.395856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.376456+0000","last_change":"2024-04-17T05:26:53.229100+0000","last_active":"2024-04-17T05:33:47.376456+0000","last_peered":"2024-04-17T05:33:47.376456+0000","last_clean":"2024-04-17T05:33:47.376456+0000","last_became_active":"2024-04-17T05:26:53.225554+0000","last_became_peered":"2024-04-17T05:26:53.225554+0000","last_unstale":"2024-04-17T05:33:47.376456+0000","last_undegraded":"2024-04-17T05:33:47.376456+0000","last_fullsized":"2024-04-17T05:33:47.376456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:04:57.213834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'2","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:22.591064+0000","last_change":"2024-04-17T05:26:52.205214+0000","last_active":"2024-04-17T05:30:22.591064+0000","last_peered":"2024-04-17T05:30:22.591064+0000","last_clean":"2024-04-17T05:30:22.591064+0000","last_became_active":"2024-04-17T05:26:52.204982+0000","last_became_peered":"2024-04-17T05:26:52.204982+0000","last_unstale":"2024-04-17T05:30:22.591064+0000","last_undegraded":"2024-04-17T05:30:22.591064+0000","last_fullsized":"2024-04-17T05:30:22.591064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:12:06.528342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"28'4","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:02.559734+0000","last_change":"2024-04-17T05:26:52.211538+0000","last_active":"2024-04-17T05:30:02.559734+0000","last_peered":"2024-04-17T05:30:02.559734+0000","last_clean":"2024-04-17T05:30:02.559734+0000","last_became_active":"2024-04-17T05:26:52.211242+0000","last_became_peered":"2024-04-17T05:26:52.211242+0000","last_unstale":"2024-04-17T05:30:02.559734+0000","last_undegraded":"2024-04-17T05:30:02.559734+0000","last_fullsized":"2024-04-17T05:30:02.559734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:30:14.163882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'7","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.391215+0000","last_change":"2024-04-17T05:26:53.239968+0000","last_active":"2024-04-17T05:33:47.391215+0000","last_peered":"2024-04-17T05:33:47.391215+0000","last_clean":"2024-04-17T05:33:47.391215+0000","last_became_active":"2024-04-17T05:26:53.239688+0000","last_became_peered":"2024-04-17T05:26:53.239688+0000","last_unstale":"2024-04-17T05:33:47.391215+0000","last_undegraded":"2024-04-17T05:33:47.391215+0000","last_fullsized":"2024-04-17T05:33:47.391215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:19:17.442103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:30.363424+0000","last_change":"2024-04-17T05:26:57.297209+0000","last_active":"2024-04-17T05:29:30.363424+0000","last_peered":"2024-04-17T05:29:30.363424+0000","last_clean":"2024-04-17T05:29:30.363424+0000","last_became_active":"2024-04-17T05:26:57.295730+0000","last_became_peered":"2024-04-17T05:26:57.295730+0000","last_unstale":"2024-04-17T05:29:30.363424+0000","last_undegraded":"2024-04-17T05:29:30.363424+0000","last_fullsized":"2024-04-17T05:29:30.363424+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:47:55.696215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'3","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:47.532063+0000","last_change":"2024-04-17T05:26:52.214520+0000","last_active":"2024-04-17T05:29:47.532063+0000","last_peered":"2024-04-17T05:29:47.532063+0000","last_clean":"2024-04-17T05:29:47.532063+0000","last_became_active":"2024-04-17T05:26:52.214153+0000","last_became_peered":"2024-04-17T05:26:52.214153+0000","last_unstale":"2024-04-17T05:29:47.532063+0000","last_undegraded":"2024-04-17T05:29:47.532063+0000","last_fullsized":"2024-04-17T05:29:47.532063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:29:09.631143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'7","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.371493+0000","last_change":"2024-04-17T05:26:53.218086+0000","last_active":"2024-04-17T05:33:47.371493+0000","last_peered":"2024-04-17T05:33:47.371493+0000","last_clean":"2024-04-17T05:33:47.371493+0000","last_became_active":"2024-04-17T05:26:53.213566+0000","last_became_peered":"2024-04-17T05:26:53.213566+0000","last_unstale":"2024-04-17T05:33:47.371493+0000","last_undegraded":"2024-04-17T05:33:47.371493+0000","last_fullsized":"2024-04-17T05:33:47.371493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:29.459313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:30.363303+0000","last_change":"2024-04-17T05:26:57.306742+0000","last_active":"2024-04-17T05:29:30.363303+0000","last_peered":"2024-04-17T05:29:30.363303+0000","last_clean":"2024-04-17T05:29:30.363303+0000","last_became_active":"2024-04-17T05:26:57.305115+0000","last_became_peered":"2024-04-17T05:26:57.305115+0000","last_unstale":"2024-04-17T05:29:30.363303+0000","last_undegraded":"2024-04-17T05:29:30.363303+0000","last_fullsized":"2024-04-17T05:29:30.363303+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:48:36.621042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.382150+0000","last_change":"2024-04-17T05:26:53.232255+0000","last_active":"2024-04-17T05:33:47.382150+0000","last_peered":"2024-04-17T05:33:47.382150+0000","last_clean":"2024-04-17T05:33:47.382150+0000","last_became_active":"2024-04-17T05:26:53.231624+0000","last_became_peered":"2024-04-17T05:26:53.231624+0000","last_unstale":"2024-04-17T05:33:47.382150+0000","last_undegraded":"2024-04-17T05:33:47.382150+0000","last_fullsized":"2024-04-17T05:33:47.382150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:27:51.120892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.392969+0000","last_change":"2024-04-17T05:26:53.222619+0000","last_active":"2024-04-17T05:33:47.392969+0000","last_peered":"2024-04-17T05:33:47.392969+0000","last_clean":"2024-04-17T05:33:47.392969+0000","last_became_active":"2024-04-17T05:26:53.222128+0000","last_became_peered":"2024-04-17T05:26:53.222128+0000","last_unstale":"2024-04-17T05:33:47.392969+0000","last_undegraded":"2024-04-17T05:33:47.392969+0000","last_fullsized":"2024-04-17T05:33:47.392969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:31.494213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.396844+0000","last_change":"2024-04-17T05:26:53.234820+0000","last_active":"2024-04-17T05:33:47.396844+0000","last_peered":"2024-04-17T05:33:47.396844+0000","last_clean":"2024-04-17T05:33:47.396844+0000","last_became_active":"2024-04-17T05:26:53.233708+0000","last_became_peered":"2024-04-17T05:26:53.233708+0000","last_unstale":"2024-04-17T05:33:47.396844+0000","last_undegraded":"2024-04-17T05:33:47.396844+0000","last_fullsized":"2024-04-17T05:33:47.396844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:08:16.322998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.372973+0000","last_change":"2024-04-17T05:26:53.234961+0000","last_active":"2024-04-17T05:33:47.372973+0000","last_peered":"2024-04-17T05:33:47.372973+0000","last_clean":"2024-04-17T05:33:47.372973+0000","last_became_active":"2024-04-17T05:26:53.234387+0000","last_became_peered":"2024-04-17T05:26:53.234387+0000","last_unstale":"2024-04-17T05:33:47.372973+0000","last_undegraded":"2024-04-17T05:33:47.372973+0000","last_fullsized":"2024-04-17T05:33:47.372973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:07:47.404346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.392306+0000","last_change":"2024-04-17T05:26:53.242359+0000","last_active":"2024-04-17T05:33:47.392306+0000","last_peered":"2024-04-17T05:33:47.392306+0000","last_clean":"2024-04-17T05:33:47.392306+0000","last_became_active":"2024-04-17T05:26:53.236476+0000","last_became_peered":"2024-04-17T05:26:53.236476+0000","last_unstale":"2024-04-17T05:33:47.392306+0000","last_undegraded":"2024-04-17T05:33:47.392306+0000","last_fullsized":"2024-04-17T05:33:47.392306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:08:16.322998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.374292+0000","last_change":"2024-04-17T05:26:53.231647+0000","last_active":"2024-04-17T05:33:47.374292+0000","last_peered":"2024-04-17T05:33:47.374292+0000","last_clean":"2024-04-17T05:33:47.374292+0000","last_became_active":"2024-04-17T05:26:53.231335+0000","last_became_peered":"2024-04-17T05:26:53.231335+0000","last_unstale":"2024-04-17T05:33:47.374292+0000","last_undegraded":"2024-04-17T05:33:47.374292+0000","last_fullsized":"2024-04-17T05:33:47.374292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:19:17.442103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"28'13","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.393123+0000","last_change":"2024-04-17T05:26:53.234892+0000","last_active":"2024-04-17T05:33:47.393123+0000","last_peered":"2024-04-17T05:33:47.393123+0000","last_clean":"2024-04-17T05:33:47.393123+0000","last_became_active":"2024-04-17T05:26:53.234582+0000","last_became_peered":"2024-04-17T05:26:53.234582+0000","last_unstale":"2024-04-17T05:33:47.393123+0000","last_undegraded":"2024-04-17T05:33:47.393123+0000","last_fullsized":"2024-04-17T05:33:47.393123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:48:56.352270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.391200+0000","last_change":"2024-04-17T05:26:53.245242+0000","last_active":"2024-04-17T05:33:47.391200+0000","last_peered":"2024-04-17T05:33:47.391200+0000","last_clean":"2024-04-17T05:33:47.391200+0000","last_became_active":"2024-04-17T05:26:53.244910+0000","last_became_peered":"2024-04-17T05:26:53.244910+0000","last_unstale":"2024-04-17T05:33:47.391200+0000","last_undegraded":"2024-04-17T05:33:47.391200+0000","last_fullsized":"2024-04-17T05:33:47.391200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:45:55.350158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'9","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.376735+0000","last_change":"2024-04-17T05:27:39.627151+0000","last_active":"2024-04-17T05:33:47.376735+0000","last_peered":"2024-04-17T05:33:47.376735+0000","last_clean":"2024-04-17T05:33:47.376735+0000","last_became_active":"2024-04-17T05:27:39.626252+0000","last_became_peered":"2024-04-17T05:27:39.626252+0000","last_unstale":"2024-04-17T05:33:47.376735+0000","last_undegraded":"2024-04-17T05:33:47.376735+0000","last_fullsized":"2024-04-17T05:33:47.376735+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:02:12.833146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.391575+0000","last_change":"2024-04-17T05:26:53.236750+0000","last_active":"2024-04-17T05:33:47.391575+0000","last_peered":"2024-04-17T05:33:47.391575+0000","last_clean":"2024-04-17T05:33:47.391575+0000","last_became_active":"2024-04-17T05:26:53.236386+0000","last_became_peered":"2024-04-17T05:26:53.236386+0000","last_unstale":"2024-04-17T05:33:47.391575+0000","last_undegraded":"2024-04-17T05:33:47.391575+0000","last_fullsized":"2024-04-17T05:33:47.391575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:19:17.442103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"28'13","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.397229+0000","last_change":"2024-04-17T05:26:53.242520+0000","last_active":"2024-04-17T05:33:47.397229+0000","last_peered":"2024-04-17T05:33:47.397229+0000","last_clean":"2024-04-17T05:33:47.397229+0000","last_became_active":"2024-04-17T05:26:53.242213+0000","last_became_peered":"2024-04-17T05:26:53.242213+0000","last_unstale":"2024-04-17T05:33:47.397229+0000","last_undegraded":"2024-04-17T05:33:47.397229+0000","last_fullsized":"2024-04-17T05:33:47.397229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:32.131344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"28'11","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.387905+0000","last_change":"2024-04-17T05:26:53.230464+0000","last_active":"2024-04-17T05:33:47.387905+0000","last_peered":"2024-04-17T05:33:47.387905+0000","last_clean":"2024-04-17T05:33:47.387905+0000","last_became_active":"2024-04-17T05:26:53.230146+0000","last_became_peered":"2024-04-17T05:26:53.230146+0000","last_unstale":"2024-04-17T05:33:47.387905+0000","last_undegraded":"2024-04-17T05:33:47.387905+0000","last_fullsized":"2024-04-17T05:33:47.387905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:20:19.035658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.388426+0000","last_change":"2024-04-17T05:26:53.252592+0000","last_active":"2024-04-17T05:33:47.388426+0000","last_peered":"2024-04-17T05:33:47.388426+0000","last_clean":"2024-04-17T05:33:47.388426+0000","last_became_active":"2024-04-17T05:26:53.252280+0000","last_became_peered":"2024-04-17T05:26:53.252280+0000","last_unstale":"2024-04-17T05:33:47.388426+0000","last_undegraded":"2024-04-17T05:33:47.388426+0000","last_fullsized":"2024-04-17T05:33:47.388426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:47:18.182576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.387703+0000","last_change":"2024-04-17T05:26:53.242405+0000","last_active":"2024-04-17T05:33:47.387703+0000","last_peered":"2024-04-17T05:33:47.387703+0000","last_clean":"2024-04-17T05:33:47.387703+0000","last_became_active":"2024-04-17T05:26:53.242046+0000","last_became_peered":"2024-04-17T05:26:53.242046+0000","last_unstale":"2024-04-17T05:33:47.387703+0000","last_undegraded":"2024-04-17T05:33:47.387703+0000","last_fullsized":"2024-04-17T05:33:47.387703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:25:09.244149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"28'12","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.381814+0000","last_change":"2024-04-17T05:26:53.228029+0000","last_active":"2024-04-17T05:33:47.381814+0000","last_peered":"2024-04-17T05:33:47.381814+0000","last_clean":"2024-04-17T05:33:47.381814+0000","last_became_active":"2024-04-17T05:26:53.227572+0000","last_became_peered":"2024-04-17T05:26:53.227572+0000","last_unstale":"2024-04-17T05:33:47.381814+0000","last_undegraded":"2024-04-17T05:33:47.381814+0000","last_fullsized":"2024-04-17T05:33:47.381814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:27.032116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.395644+0000","last_change":"2024-04-17T05:26:53.226283+0000","last_active":"2024-04-17T05:33:47.395644+0000","last_peered":"2024-04-17T05:33:47.395644+0000","last_clean":"2024-04-17T05:33:47.395644+0000","last_became_active":"2024-04-17T05:26:53.225983+0000","last_became_peered":"2024-04-17T05:26:53.225983+0000","last_unstale":"2024-04-17T05:33:47.395644+0000","last_undegraded":"2024-04-17T05:33:47.395644+0000","last_fullsized":"2024-04-17T05:33:47.395644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:40:51.044161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"28'11","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.397095+0000","last_change":"2024-04-17T05:26:53.230256+0000","last_active":"2024-04-17T05:33:47.397095+0000","last_peered":"2024-04-17T05:33:47.397095+0000","last_clean":"2024-04-17T05:33:47.397095+0000","last_became_active":"2024-04-17T05:26:53.229888+0000","last_became_peered":"2024-04-17T05:26:53.229888+0000","last_unstale":"2024-04-17T05:33:47.397095+0000","last_undegraded":"2024-04-17T05:33:47.397095+0000","last_fullsized":"2024-04-17T05:33:47.397095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:45:55.350158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.383533+0000","last_change":"2024-04-17T05:26:53.211199+0000","last_active":"2024-04-17T05:33:47.383533+0000","last_peered":"2024-04-17T05:33:47.383533+0000","last_clean":"2024-04-17T05:33:47.383533+0000","last_became_active":"2024-04-17T05:26:53.208394+0000","last_became_peered":"2024-04-17T05:26:53.208394+0000","last_unstale":"2024-04-17T05:33:47.383533+0000","last_undegraded":"2024-04-17T05:33:47.383533+0000","last_fullsized":"2024-04-17T05:33:47.383533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:20:19.035658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"28'5","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.375609+0000","last_change":"2024-04-17T05:26:53.224930+0000","last_active":"2024-04-17T05:33:47.375609+0000","last_peered":"2024-04-17T05:33:47.375609+0000","last_clean":"2024-04-17T05:33:47.375609+0000","last_became_active":"2024-04-17T05:26:53.224314+0000","last_became_peered":"2024-04-17T05:26:53.224314+0000","last_unstale":"2024-04-17T05:33:47.375609+0000","last_undegraded":"2024-04-17T05:33:47.375609+0000","last_fullsized":"2024-04-17T05:33:47.375609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:00:05.875990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"28'10","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.379525+0000","last_change":"2024-04-17T05:26:53.234152+0000","last_active":"2024-04-17T05:33:47.379525+0000","last_peered":"2024-04-17T05:33:47.379525+0000","last_clean":"2024-04-17T05:33:47.379525+0000","last_became_active":"2024-04-17T05:26:53.233885+0000","last_became_peered":"2024-04-17T05:26:53.233885+0000","last_unstale":"2024-04-17T05:33:47.379525+0000","last_undegraded":"2024-04-17T05:33:47.379525+0000","last_fullsized":"2024-04-17T05:33:47.379525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:20:19.035658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.388203+0000","last_change":"2024-04-17T05:26:53.233213+0000","last_active":"2024-04-17T05:33:47.388203+0000","last_peered":"2024-04-17T05:33:47.388203+0000","last_clean":"2024-04-17T05:33:47.388203+0000","last_became_active":"2024-04-17T05:26:53.232809+0000","last_became_peered":"2024-04-17T05:26:53.232809+0000","last_unstale":"2024-04-17T05:33:47.388203+0000","last_undegraded":"2024-04-17T05:33:47.388203+0000","last_fullsized":"2024-04-17T05:33:47.388203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:44.057838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.384785+0000","last_change":"2024-04-17T05:26:53.245453+0000","last_active":"2024-04-17T05:33:47.384785+0000","last_peered":"2024-04-17T05:33:47.384785+0000","last_clean":"2024-04-17T05:33:47.384785+0000","last_became_active":"2024-04-17T05:26:53.245051+0000","last_became_peered":"2024-04-17T05:26:53.245051+0000","last_unstale":"2024-04-17T05:33:47.384785+0000","last_undegraded":"2024-04-17T05:33:47.384785+0000","last_fullsized":"2024-04-17T05:33:47.384785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:44:40.424363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"28'16","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.397336+0000","last_change":"2024-04-17T05:26:53.241934+0000","last_active":"2024-04-17T05:33:47.397336+0000","last_peered":"2024-04-17T05:33:47.397336+0000","last_clean":"2024-04-17T05:33:47.397336+0000","last_became_active":"2024-04-17T05:26:53.241108+0000","last_became_peered":"2024-04-17T05:26:53.241108+0000","last_unstale":"2024-04-17T05:33:47.397336+0000","last_undegraded":"2024-04-17T05:33:47.397336+0000","last_fullsized":"2024-04-17T05:33:47.397336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:53:43.076144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"28'9","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.364950+0000","last_change":"2024-04-17T05:27:39.898458+0000","last_active":"2024-04-17T05:33:47.364950+0000","last_peered":"2024-04-17T05:33:47.364950+0000","last_clean":"2024-04-17T05:33:47.364950+0000","last_became_active":"2024-04-17T05:27:39.897830+0000","last_became_peered":"2024-04-17T05:27:39.897830+0000","last_unstale":"2024-04-17T05:33:47.364950+0000","last_undegraded":"2024-04-17T05:33:47.364950+0000","last_fullsized":"2024-04-17T05:33:47.364950+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:15:26.293817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.394853+0000","last_change":"2024-04-17T05:26:53.244109+0000","last_active":"2024-04-17T05:33:47.394853+0000","last_peered":"2024-04-17T05:33:47.394853+0000","last_clean":"2024-04-17T05:33:47.394853+0000","last_became_active":"2024-04-17T05:26:53.243625+0000","last_became_peered":"2024-04-17T05:26:53.243625+0000","last_unstale":"2024-04-17T05:33:47.394853+0000","last_undegraded":"2024-04-17T05:33:47.394853+0000","last_fullsized":"2024-04-17T05:33:47.394853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:07:47.404346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"28'5","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.383931+0000","last_change":"2024-04-17T05:26:53.246489+0000","last_active":"2024-04-17T05:33:47.383931+0000","last_peered":"2024-04-17T05:33:47.383931+0000","last_clean":"2024-04-17T05:33:47.383931+0000","last_became_active":"2024-04-17T05:26:53.246286+0000","last_became_peered":"2024-04-17T05:26:53.246286+0000","last_unstale":"2024-04-17T05:33:47.383931+0000","last_undegraded":"2024-04-17T05:33:47.383931+0000","last_fullsized":"2024-04-17T05:33:47.383931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:45.658070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'5","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.396608+0000","last_change":"2024-04-17T05:26:53.229115+0000","last_active":"2024-04-17T05:33:47.396608+0000","last_peered":"2024-04-17T05:33:47.396608+0000","last_clean":"2024-04-17T05:33:47.396608+0000","last_became_active":"2024-04-17T05:26:53.228706+0000","last_became_peered":"2024-04-17T05:26:53.228706+0000","last_unstale":"2024-04-17T05:33:47.396608+0000","last_undegraded":"2024-04-17T05:33:47.396608+0000","last_fullsized":"2024-04-17T05:33:47.396608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:19:17.442103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.385791+0000","last_change":"2024-04-17T05:26:53.244961+0000","last_active":"2024-04-17T05:33:47.385791+0000","last_peered":"2024-04-17T05:33:47.385791+0000","last_clean":"2024-04-17T05:33:47.385791+0000","last_became_active":"2024-04-17T05:26:53.244595+0000","last_became_peered":"2024-04-17T05:26:53.244595+0000","last_unstale":"2024-04-17T05:33:47.385791+0000","last_undegraded":"2024-04-17T05:33:47.385791+0000","last_fullsized":"2024-04-17T05:33:47.385791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:13:34.455173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.392806+0000","last_change":"2024-04-17T05:26:53.241645+0000","last_active":"2024-04-17T05:33:47.392806+0000","last_peered":"2024-04-17T05:33:47.392806+0000","last_clean":"2024-04-17T05:33:47.392806+0000","last_became_active":"2024-04-17T05:26:53.241292+0000","last_became_peered":"2024-04-17T05:26:53.241292+0000","last_unstale":"2024-04-17T05:33:47.392806+0000","last_undegraded":"2024-04-17T05:33:47.392806+0000","last_fullsized":"2024-04-17T05:33:47.392806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:31:26.820940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.376112+0000","last_change":"2024-04-17T05:26:53.221256+0000","last_active":"2024-04-17T05:33:47.376112+0000","last_peered":"2024-04-17T05:33:47.376112+0000","last_clean":"2024-04-17T05:33:47.376112+0000","last_became_active":"2024-04-17T05:26:53.220445+0000","last_became_peered":"2024-04-17T05:26:53.220445+0000","last_unstale":"2024-04-17T05:33:47.376112+0000","last_undegraded":"2024-04-17T05:33:47.376112+0000","last_fullsized":"2024-04-17T05:33:47.376112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:08:41.870139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'4","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.375073+0000","last_change":"2024-04-17T05:26:53.214897+0000","last_active":"2024-04-17T05:33:47.375073+0000","last_peered":"2024-04-17T05:33:47.375073+0000","last_clean":"2024-04-17T05:33:47.375073+0000","last_became_active":"2024-04-17T05:26:53.214591+0000","last_became_peered":"2024-04-17T05:26:53.214591+0000","last_unstale":"2024-04-17T05:33:47.375073+0000","last_undegraded":"2024-04-17T05:33:47.375073+0000","last_fullsized":"2024-04-17T05:33:47.375073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:32.131344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"28'10","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.390013+0000","last_change":"2024-04-17T05:26:53.248726+0000","last_active":"2024-04-17T05:33:47.390013+0000","last_peered":"2024-04-17T05:33:47.390013+0000","last_clean":"2024-04-17T05:33:47.390013+0000","last_became_active":"2024-04-17T05:26:53.248143+0000","last_became_peered":"2024-04-17T05:26:53.248143+0000","last_unstale":"2024-04-17T05:33:47.390013+0000","last_undegraded":"2024-04-17T05:33:47.390013+0000","last_fullsized":"2024-04-17T05:33:47.390013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:02:51.306764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":945903,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":397,"num_write_kb":1123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1949696,"data_stored":1891806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":388,"ondisk_log_size":388,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542233,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":897024,"data_stored":713306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542232,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28228,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343612,"statfs":{"total":96636764160,"available":96607858688,"internally_reserved":0,"allocated":1241088,"data_stored":1056638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542233,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":122446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542232,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":122482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542234,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1253376,"data_stored":1067461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542232,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":133179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542233,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":122516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542232,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":905216,"data_stored":713362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":10823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":954368,"data_stored":945105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":942080,"data_stored":934282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T05:33:54.315 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T05:33:54.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.563+0000 7fa38a200640 1 Processor -- start 2024-04-17T05:33:54.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.563+0000 7fa38a200640 1 -- start start 2024-04-17T05:33:54.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.565+0000 7fa38a200640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fa3840b3dc0 0x7fa384147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:54.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.565+0000 7fa38a200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa384148420 0x7fa38413e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:54.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.565+0000 7fa38a200640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3840b5910 con 0x7fa38413e920 2024-04-17T05:33:54.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.565+0000 7fa38a200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fa3840b2c80 con 0x7fa384148420 2024-04-17T05:33:54.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.565+0000 7fa38a200640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7fa3840708c0 con 0x7fa3840b3dc0 2024-04-17T05:33:54.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.565+0000 7fa383e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa384148420 0x7fa38413e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:54.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.565+0000 7fa383e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa384148420 0x7fa38413e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46008/0 (socket says 172.21.15.123:46008) 2024-04-17T05:33:54.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.565+0000 7fa383e00640 1 -- 172.21.15.123:0/3708048263 learned_addr learned my addr 172.21.15.123:0/3708048263 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:54.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.565+0000 7fa388e00640 1 --2- 172.21.15.123:0/3708048263 >> v2:172.21.15.164:3300/0 conn(0x7fa3840b3dc0 0x7fa384147ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:54.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.566+0000 7fa383e00640 1 -- 172.21.15.123:0/3708048263 >> v2:172.21.15.164:3300/0 conn(0x7fa3840b3dc0 msgr2=0x7fa384147ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:54.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.566+0000 7fa383e00640 1 --2- 172.21.15.123:0/3708048263 >> v2:172.21.15.164:3300/0 conn(0x7fa3840b3dc0 0x7fa384147ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:54.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.566+0000 7fa383e00640 1 -- 172.21.15.123:0/3708048263 >> v1:172.21.15.164:6789/0 conn(0x7fa38413e920 legacy=0x7fa3840b0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:54.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.566+0000 7fa383e00640 1 -- 172.21.15.123:0/3708048263 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3840b1870 con 0x7fa384148420 2024-04-17T05:33:54.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.567+0000 7fa383e00640 1 --2- 172.21.15.123:0/3708048263 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa384148420 0x7fa38413e3e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa3840b5680 tx=0x7fa37002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c572173c7507371 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:54.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.567+0000 7fa383400640 1 -- 172.21.15.123:0/3708048263 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37002e070 con 0x7fa384148420 2024-04-17T05:33:54.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.567+0000 7fa383400640 1 -- 172.21.15.123:0/3708048263 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa370037070 con 0x7fa384148420 2024-04-17T05:33:54.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.567+0000 7fa383400640 1 -- 172.21.15.123:0/3708048263 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa370031a00 con 0x7fa384148420 2024-04-17T05:33:54.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.568+0000 7fa38a200640 1 -- 172.21.15.123:0/3708048263 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa384148420 msgr2=0x7fa38413e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:54.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.568+0000 7fa38a200640 1 --2- 172.21.15.123:0/3708048263 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa384148420 0x7fa38413e3e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa3840b5680 tx=0x7fa37002b880 comp rx=0 tx=0).stop 2024-04-17T05:33:54.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.568+0000 7fa38a200640 1 -- 172.21.15.123:0/3708048263 shutdown_connections 2024-04-17T05:33:54.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.568+0000 7fa38a200640 1 --2- 172.21.15.123:0/3708048263 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa384148420 0x7fa38413e3e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:54.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.568+0000 7fa38a200640 1 --2- 172.21.15.123:0/3708048263 >> v2:172.21.15.164:3300/0 conn(0x7fa3840b3dc0 0x7fa384147ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:54.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.568+0000 7fa38a200640 1 -- 172.21.15.123:0/3708048263 >> 172.21.15.123:0/3708048263 conn(0x7fa3840b9150 msgr2=0x7fa3840b9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:54.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.568+0000 7fa38a200640 1 -- 172.21.15.123:0/3708048263 shutdown_connections 2024-04-17T05:33:54.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.568+0000 7fa38a200640 1 -- 172.21.15.123:0/3708048263 wait complete. 2024-04-17T05:33:54.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.570+0000 7fa38a200640 1 Processor -- start 2024-04-17T05:33:54.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.570+0000 7fa38a200640 1 -- start start 2024-04-17T05:33:54.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.571+0000 7fa38a200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3840b3dc0 0x7fa38413b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:54.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.571+0000 7fa38a200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa38413e920 0x7fa38413b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:54.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.571+0000 7fa38a200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa384148420 0x7fa3841e08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:54.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.571+0000 7fa38a200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa3840b2ed0 con 0x7fa38413e920 2024-04-17T05:33:54.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.571+0000 7fa38a200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fa384148880 con 0x7fa384148420 2024-04-17T05:33:54.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.571+0000 7fa38a200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fa3840b1b10 con 0x7fa3840b3dc0 2024-04-17T05:33:54.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.571+0000 7fa383e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa38413e920 0x7fa38413b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:54.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.571+0000 7fa383e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa38413e920 0x7fa38413b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46016/0 (socket says 172.21.15.123:46016) 2024-04-17T05:33:54.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.571+0000 7fa383e00640 1 -- 172.21.15.123:0/3031354514 learned_addr learned my addr 172.21.15.123:0/3031354514 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:54.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.572+0000 7fa388e00640 1 --2- 172.21.15.123:0/3031354514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3840b3dc0 0x7fa38413b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:54.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.572+0000 7fa389800640 1 --2- 172.21.15.123:0/3031354514 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa384148420 0x7fa3841e08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:54.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.572+0000 7fa383e00640 1 -- 172.21.15.123:0/3031354514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3840b3dc0 msgr2=0x7fa38413b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:54.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.572+0000 7fa383e00640 1 --2- 172.21.15.123:0/3031354514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3840b3dc0 0x7fa38413b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:54.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.572+0000 7fa383e00640 1 -- 172.21.15.123:0/3031354514 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa384148420 msgr2=0x7fa3841e08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:54.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.572+0000 7fa383e00640 1 --2- 172.21.15.123:0/3031354514 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa384148420 0x7fa3841e08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:54.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.572+0000 7fa383e00640 1 -- 172.21.15.123:0/3031354514 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa38413f130 con 0x7fa38413e920 2024-04-17T05:33:54.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.572+0000 7fa389800640 1 --2- 172.21.15.123:0/3031354514 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa384148420 0x7fa3841e08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:33:54.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.572+0000 7fa383e00640 1 --2- 172.21.15.123:0/3031354514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa38413e920 0x7fa38413b880 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa37002b8c0 tx=0x7fa3700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:54.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.573+0000 7fa380c00640 1 -- 172.21.15.123:0/3031354514 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa370032670 con 0x7fa38413e920 2024-04-17T05:33:54.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.573+0000 7fa380c00640 1 -- 172.21.15.123:0/3031354514 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa370032830 con 0x7fa38413e920 2024-04-17T05:33:54.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.573+0000 7fa380c00640 1 -- 172.21.15.123:0/3031354514 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa370032c20 con 0x7fa38413e920 2024-04-17T05:33:54.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.573+0000 7fa38a200640 1 -- 172.21.15.123:0/3031354514 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa384072ff0 con 0x7fa38413e920 2024-04-17T05:33:54.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.573+0000 7fa38a200640 1 -- 172.21.15.123:0/3031354514 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3840ae260 con 0x7fa38413e920 2024-04-17T05:33:54.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.574+0000 7fa38a200640 1 -- 172.21.15.123:0/3031354514 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3840759b0 con 0x7fa38413e920 2024-04-17T05:33:54.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.575+0000 7fa380c00640 1 -- 172.21.15.123:0/3031354514 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa3700453f0 con 0x7fa38413e920 2024-04-17T05:33:54.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.576+0000 7fa380c00640 1 --2- 172.21.15.123:0/3031354514 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fa36406c920 0x7fa36406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:54.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.576+0000 7fa380c00640 1 -- 172.21.15.123:0/3031354514 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fa3700add10 con 0x7fa38413e920 2024-04-17T05:33:54.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.576+0000 7fa388e00640 1 --2- 172.21.15.123:0/3031354514 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fa36406c920 0x7fa36406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:54.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.578+0000 7fa388e00640 1 --2- 172.21.15.123:0/3031354514 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fa36406c920 0x7fa36406ede0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa378006fd0 tx=0x7fa378008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:54.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.580+0000 7fa380c00640 1 -- 172.21.15.123:0/3031354514 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fa3700b3020 con 0x7fa38413e920 2024-04-17T05:33:54.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.776+0000 7fa38a200640 1 -- 172.21.15.123:0/3031354514 --> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa3840af5e0 con 0x7fa36406c920 2024-04-17T05:33:54.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.800+0000 7fa380c00640 1 -- 172.21.15.123:0/3031354514 <== mgr.4103 v2:172.21.15.164:6832/4204006015 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332872 (secure 0 0 0) 0x7fa3840af5e0 con 0x7fa36406c920 2024-04-17T05:33:54.804 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:33:54.806 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-04-17T05:33:54.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.806+0000 7fa38a200640 1 -- 172.21.15.123:0/3031354514 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fa36406c920 msgr2=0x7fa36406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:54.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.806+0000 7fa38a200640 1 --2- 172.21.15.123:0/3031354514 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fa36406c920 0x7fa36406ede0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa378006fd0 tx=0x7fa378008040 comp rx=0 tx=0).stop 2024-04-17T05:33:54.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.806+0000 7fa38a200640 1 -- 172.21.15.123:0/3031354514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa38413e920 msgr2=0x7fa38413b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:54.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.806+0000 7fa38a200640 1 --2- 172.21.15.123:0/3031354514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa38413e920 0x7fa38413b880 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa37002b8c0 tx=0x7fa3700046c0 comp rx=0 tx=0).stop 2024-04-17T05:33:54.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.806+0000 7fa38a200640 1 -- 172.21.15.123:0/3031354514 shutdown_connections 2024-04-17T05:33:54.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.806+0000 7fa38a200640 1 --2- 172.21.15.123:0/3031354514 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa384148420 0x7fa3841e08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:54.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.806+0000 7fa38a200640 1 --2- 172.21.15.123:0/3031354514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa38413e920 0x7fa38413b880 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:54.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.806+0000 7fa38a200640 1 --2- 172.21.15.123:0/3031354514 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fa36406c920 0x7fa36406ede0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:54.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.806+0000 7fa38a200640 1 --2- 172.21.15.123:0/3031354514 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa3840b3dc0 0x7fa38413b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:54.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.806+0000 7fa38a200640 1 -- 172.21.15.123:0/3031354514 >> 172.21.15.123:0/3031354514 conn(0x7fa3840b9150 msgr2=0x7fa3840b9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:54.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.806+0000 7fa38a200640 1 -- 172.21.15.123:0/3031354514 shutdown_connections 2024-04-17T05:33:54.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:54.806+0000 7fa38a200640 1 -- 172.21.15.123:0/3031354514 wait complete. 2024-04-17T05:33:54.825 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2024-04-17T05:33:54.479992+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1536271,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":152,"num_read_kb":136,"num_write":562,"num_write_kb":3543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1014,"ondisk_log_size":1014,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225688,"kb_used_data":5400,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749032,"statfs":{"total":773094113280,"available":772863008768,"internally_reserved":0,"allocated":5529600,"data_stored":4051390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":83,"apply_latency_ms":83,"commit_latency_ns":83000000,"apply_latency_ns":83000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14151,"num_objects":-1,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":24,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004775"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:05.380186+0000","last_change":"2024-04-17T05:26:52.205802+0000","last_active":"2024-04-17T05:31:05.380186+0000","last_peered":"2024-04-17T05:31:05.380186+0000","last_clean":"2024-04-17T05:31:05.380186+0000","last_became_active":"2024-04-17T05:26:52.205459+0000","last_became_peered":"2024-04-17T05:26:52.205459+0000","last_unstale":"2024-04-17T05:31:05.380186+0000","last_undegraded":"2024-04-17T05:31:05.380186+0000","last_fullsized":"2024-04-17T05:31:05.380186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:12:06.528342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.381240+0000","last_change":"2024-04-17T05:26:53.231441+0000","last_active":"2024-04-17T05:33:47.381240+0000","last_peered":"2024-04-17T05:33:47.381240+0000","last_clean":"2024-04-17T05:33:47.381240+0000","last_became_active":"2024-04-17T05:26:53.231139+0000","last_became_peered":"2024-04-17T05:26:53.231139+0000","last_unstale":"2024-04-17T05:33:47.381240+0000","last_undegraded":"2024-04-17T05:33:47.381240+0000","last_fullsized":"2024-04-17T05:33:47.381240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:38:13.010763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:25.362764+0000","last_change":"2024-04-17T05:26:57.347742+0000","last_active":"2024-04-17T05:29:25.362764+0000","last_peered":"2024-04-17T05:29:25.362764+0000","last_clean":"2024-04-17T05:29:25.362764+0000","last_became_active":"2024-04-17T05:26:57.347333+0000","last_became_peered":"2024-04-17T05:26:57.347333+0000","last_unstale":"2024-04-17T05:29:25.362764+0000","last_undegraded":"2024-04-17T05:29:25.362764+0000","last_fullsized":"2024-04-17T05:29:25.362764+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:23:44.724644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:55.377844+0000","last_change":"2024-04-17T05:26:52.203448+0000","last_active":"2024-04-17T05:30:55.377844+0000","last_peered":"2024-04-17T05:30:55.377844+0000","last_clean":"2024-04-17T05:30:55.377844+0000","last_became_active":"2024-04-17T05:26:52.203161+0000","last_became_peered":"2024-04-17T05:26:52.203161+0000","last_unstale":"2024-04-17T05:30:55.377844+0000","last_undegraded":"2024-04-17T05:30:55.377844+0000","last_fullsized":"2024-04-17T05:30:55.377844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:11:26.292397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.396658+0000","last_change":"2024-04-17T05:26:53.241735+0000","last_active":"2024-04-17T05:33:47.396658+0000","last_peered":"2024-04-17T05:33:47.396658+0000","last_clean":"2024-04-17T05:33:47.396658+0000","last_became_active":"2024-04-17T05:26:53.241460+0000","last_became_peered":"2024-04-17T05:26:53.241460+0000","last_unstale":"2024-04-17T05:33:47.396658+0000","last_undegraded":"2024-04-17T05:33:47.396658+0000","last_fullsized":"2024-04-17T05:33:47.396658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:32.131344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:25.360061+0000","last_change":"2024-04-17T05:26:57.310052+0000","last_active":"2024-04-17T05:29:25.360061+0000","last_peered":"2024-04-17T05:29:25.360061+0000","last_clean":"2024-04-17T05:29:25.360061+0000","last_became_active":"2024-04-17T05:26:57.309057+0000","last_became_peered":"2024-04-17T05:26:57.309057+0000","last_unstale":"2024-04-17T05:29:25.360061+0000","last_undegraded":"2024-04-17T05:29:25.360061+0000","last_fullsized":"2024-04-17T05:29:25.360061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:32:29.420749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'6","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:42.521017+0000","last_change":"2024-04-17T05:26:52.217413+0000","last_active":"2024-04-17T05:29:42.521017+0000","last_peered":"2024-04-17T05:29:42.521017+0000","last_clean":"2024-04-17T05:29:42.521017+0000","last_became_active":"2024-04-17T05:26:52.217101+0000","last_became_peered":"2024-04-17T05:26:52.217101+0000","last_unstale":"2024-04-17T05:29:42.521017+0000","last_undegraded":"2024-04-17T05:29:42.521017+0000","last_fullsized":"2024-04-17T05:29:42.521017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:39:51.930934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'8","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.393645+0000","last_change":"2024-04-17T05:26:53.219012+0000","last_active":"2024-04-17T05:33:47.393645+0000","last_peered":"2024-04-17T05:33:47.393645+0000","last_clean":"2024-04-17T05:33:47.393645+0000","last_became_active":"2024-04-17T05:26:53.216591+0000","last_became_peered":"2024-04-17T05:26:53.216591+0000","last_unstale":"2024-04-17T05:33:47.393645+0000","last_undegraded":"2024-04-17T05:33:47.393645+0000","last_fullsized":"2024-04-17T05:33:47.393645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:02:12.833146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:30.361050+0000","last_change":"2024-04-17T05:26:57.310537+0000","last_active":"2024-04-17T05:29:30.361050+0000","last_peered":"2024-04-17T05:29:30.361050+0000","last_clean":"2024-04-17T05:29:30.361050+0000","last_became_active":"2024-04-17T05:26:57.309381+0000","last_became_peered":"2024-04-17T05:26:57.309381+0000","last_unstale":"2024-04-17T05:29:30.361050+0000","last_undegraded":"2024-04-17T05:29:30.361050+0000","last_fullsized":"2024-04-17T05:29:30.361050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:38:17.093545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'5","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:55.432886+0000","last_change":"2024-04-17T05:26:52.218309+0000","last_active":"2024-04-17T05:31:55.432886+0000","last_peered":"2024-04-17T05:31:55.432886+0000","last_clean":"2024-04-17T05:31:55.432886+0000","last_became_active":"2024-04-17T05:26:52.217898+0000","last_became_peered":"2024-04-17T05:26:52.217898+0000","last_unstale":"2024-04-17T05:31:55.432886+0000","last_undegraded":"2024-04-17T05:31:55.432886+0000","last_fullsized":"2024-04-17T05:31:55.432886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:16:02.152039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'14","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.396662+0000","last_change":"2024-04-17T05:26:53.232546+0000","last_active":"2024-04-17T05:33:47.396662+0000","last_peered":"2024-04-17T05:33:47.396662+0000","last_clean":"2024-04-17T05:33:47.396662+0000","last_became_active":"2024-04-17T05:26:53.232239+0000","last_became_peered":"2024-04-17T05:26:53.232239+0000","last_unstale":"2024-04-17T05:33:47.396662+0000","last_undegraded":"2024-04-17T05:33:47.396662+0000","last_fullsized":"2024-04-17T05:33:47.396662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:38:13.010763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:30.361003+0000","last_change":"2024-04-17T05:26:57.297256+0000","last_active":"2024-04-17T05:29:30.361003+0000","last_peered":"2024-04-17T05:29:30.361003+0000","last_clean":"2024-04-17T05:29:30.361003+0000","last_became_active":"2024-04-17T05:26:57.296757+0000","last_became_peered":"2024-04-17T05:26:57.296757+0000","last_unstale":"2024-04-17T05:29:30.361003+0000","last_undegraded":"2024-04-17T05:29:30.361003+0000","last_fullsized":"2024-04-17T05:29:30.361003+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:45:59.432940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.386895+0000","last_change":"2024-04-17T05:26:53.244539+0000","last_active":"2024-04-17T05:33:47.386895+0000","last_peered":"2024-04-17T05:33:47.386895+0000","last_clean":"2024-04-17T05:33:47.386895+0000","last_became_active":"2024-04-17T05:26:53.244104+0000","last_became_peered":"2024-04-17T05:26:53.244104+0000","last_unstale":"2024-04-17T05:33:47.386895+0000","last_undegraded":"2024-04-17T05:33:47.386895+0000","last_fullsized":"2024-04-17T05:33:47.386895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:41:48.514881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'8","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:25.427323+0000","last_change":"2024-04-17T05:26:52.214434+0000","last_active":"2024-04-17T05:31:25.427323+0000","last_peered":"2024-04-17T05:31:25.427323+0000","last_clean":"2024-04-17T05:31:25.427323+0000","last_became_active":"2024-04-17T05:26:52.214158+0000","last_became_peered":"2024-04-17T05:26:52.214158+0000","last_unstale":"2024-04-17T05:31:25.427323+0000","last_undegraded":"2024-04-17T05:31:25.427323+0000","last_fullsized":"2024-04-17T05:31:25.427323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:36:56.201576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:30.379674+0000","last_change":"2024-04-17T05:26:57.307151+0000","last_active":"2024-04-17T05:31:30.379674+0000","last_peered":"2024-04-17T05:31:30.379674+0000","last_clean":"2024-04-17T05:31:30.379674+0000","last_became_active":"2024-04-17T05:26:57.305676+0000","last_became_peered":"2024-04-17T05:26:57.305676+0000","last_unstale":"2024-04-17T05:31:30.379674+0000","last_undegraded":"2024-04-17T05:31:30.379674+0000","last_fullsized":"2024-04-17T05:31:30.379674+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:40:55.126943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.377372+0000","last_change":"2024-04-17T05:26:53.230514+0000","last_active":"2024-04-17T05:33:47.377372+0000","last_peered":"2024-04-17T05:33:47.377372+0000","last_clean":"2024-04-17T05:33:47.377372+0000","last_became_active":"2024-04-17T05:26:53.230175+0000","last_became_peered":"2024-04-17T05:26:53.230175+0000","last_unstale":"2024-04-17T05:33:47.377372+0000","last_undegraded":"2024-04-17T05:33:47.377372+0000","last_fullsized":"2024-04-17T05:33:47.377372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:32.131344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:15.387164+0000","last_change":"2024-04-17T05:26:52.207664+0000","last_active":"2024-04-17T05:31:15.387164+0000","last_peered":"2024-04-17T05:31:15.387164+0000","last_clean":"2024-04-17T05:31:15.387164+0000","last_became_active":"2024-04-17T05:26:52.207343+0000","last_became_peered":"2024-04-17T05:26:52.207343+0000","last_unstale":"2024-04-17T05:31:15.387164+0000","last_undegraded":"2024-04-17T05:31:15.387164+0000","last_fullsized":"2024-04-17T05:31:15.387164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:05:28.743450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:30.379630+0000","last_change":"2024-04-17T05:26:57.311205+0000","last_active":"2024-04-17T05:31:30.379630+0000","last_peered":"2024-04-17T05:31:30.379630+0000","last_clean":"2024-04-17T05:31:30.379630+0000","last_became_active":"2024-04-17T05:26:57.310038+0000","last_became_peered":"2024-04-17T05:26:57.310038+0000","last_unstale":"2024-04-17T05:31:30.379630+0000","last_undegraded":"2024-04-17T05:31:30.379630+0000","last_fullsized":"2024-04-17T05:31:30.379630+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:02:16.915928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'6","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.369668+0000","last_change":"2024-04-17T05:27:39.897206+0000","last_active":"2024-04-17T05:33:47.369668+0000","last_peered":"2024-04-17T05:33:47.369668+0000","last_clean":"2024-04-17T05:33:47.369668+0000","last_became_active":"2024-04-17T05:27:39.896306+0000","last_became_peered":"2024-04-17T05:27:39.896306+0000","last_unstale":"2024-04-17T05:33:47.369668+0000","last_undegraded":"2024-04-17T05:33:47.369668+0000","last_fullsized":"2024-04-17T05:33:47.369668+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:40:51.044161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:15.387119+0000","last_change":"2024-04-17T05:26:52.207557+0000","last_active":"2024-04-17T05:31:15.387119+0000","last_peered":"2024-04-17T05:31:15.387119+0000","last_clean":"2024-04-17T05:31:15.387119+0000","last_became_active":"2024-04-17T05:26:52.207019+0000","last_became_peered":"2024-04-17T05:26:52.207019+0000","last_unstale":"2024-04-17T05:31:15.387119+0000","last_undegraded":"2024-04-17T05:31:15.387119+0000","last_fullsized":"2024-04-17T05:31:15.387119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:43.039139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:30.389826+0000","last_change":"2024-04-17T05:26:57.345734+0000","last_active":"2024-04-17T05:31:30.389826+0000","last_peered":"2024-04-17T05:31:30.389826+0000","last_clean":"2024-04-17T05:31:30.389826+0000","last_became_active":"2024-04-17T05:26:57.345300+0000","last_became_peered":"2024-04-17T05:26:57.345300+0000","last_unstale":"2024-04-17T05:31:30.389826+0000","last_undegraded":"2024-04-17T05:31:30.389826+0000","last_fullsized":"2024-04-17T05:31:30.389826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:45:07.123915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"28'3","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.385628+0000","last_change":"2024-04-17T05:26:53.218687+0000","last_active":"2024-04-17T05:33:47.385628+0000","last_peered":"2024-04-17T05:33:47.385628+0000","last_clean":"2024-04-17T05:33:47.385628+0000","last_became_active":"2024-04-17T05:26:53.218355+0000","last_became_peered":"2024-04-17T05:26:53.218355+0000","last_unstale":"2024-04-17T05:33:47.385628+0000","last_undegraded":"2024-04-17T05:33:47.385628+0000","last_fullsized":"2024-04-17T05:33:47.385628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:05:29.762149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:15.425628+0000","last_change":"2024-04-17T05:26:52.214868+0000","last_active":"2024-04-17T05:31:15.425628+0000","last_peered":"2024-04-17T05:31:15.425628+0000","last_clean":"2024-04-17T05:31:15.425628+0000","last_became_active":"2024-04-17T05:26:52.214633+0000","last_became_peered":"2024-04-17T05:26:52.214633+0000","last_unstale":"2024-04-17T05:31:15.425628+0000","last_undegraded":"2024-04-17T05:31:15.425628+0000","last_fullsized":"2024-04-17T05:31:15.425628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:10:33.072665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:30.379693+0000","last_change":"2024-04-17T05:26:57.309644+0000","last_active":"2024-04-17T05:31:30.379693+0000","last_peered":"2024-04-17T05:31:30.379693+0000","last_clean":"2024-04-17T05:31:30.379693+0000","last_became_active":"2024-04-17T05:26:57.309175+0000","last_became_peered":"2024-04-17T05:26:57.309175+0000","last_unstale":"2024-04-17T05:31:30.379693+0000","last_undegraded":"2024-04-17T05:31:30.379693+0000","last_fullsized":"2024-04-17T05:31:30.379693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:31:30.903722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.375868+0000","last_change":"2024-04-17T05:26:53.220368+0000","last_active":"2024-04-17T05:33:47.375868+0000","last_peered":"2024-04-17T05:33:47.375868+0000","last_clean":"2024-04-17T05:33:47.375868+0000","last_became_active":"2024-04-17T05:26:53.220068+0000","last_became_peered":"2024-04-17T05:26:53.220068+0000","last_unstale":"2024-04-17T05:33:47.375868+0000","last_undegraded":"2024-04-17T05:33:47.375868+0000","last_fullsized":"2024-04-17T05:33:47.375868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:04:57.213834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:15.414626+0000","last_change":"2024-04-17T05:26:52.215954+0000","last_active":"2024-04-17T05:31:15.414626+0000","last_peered":"2024-04-17T05:31:15.414626+0000","last_clean":"2024-04-17T05:31:15.414626+0000","last_became_active":"2024-04-17T05:26:52.215637+0000","last_became_peered":"2024-04-17T05:26:52.215637+0000","last_unstale":"2024-04-17T05:31:15.414626+0000","last_undegraded":"2024-04-17T05:31:15.414626+0000","last_fullsized":"2024-04-17T05:31:15.414626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:05:12.780620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:10.376588+0000","last_change":"2024-04-17T05:26:57.342654+0000","last_active":"2024-04-17T05:31:10.376588+0000","last_peered":"2024-04-17T05:31:10.376588+0000","last_clean":"2024-04-17T05:31:10.376588+0000","last_became_active":"2024-04-17T05:26:57.342205+0000","last_became_peered":"2024-04-17T05:26:57.342205+0000","last_unstale":"2024-04-17T05:31:10.376588+0000","last_undegraded":"2024-04-17T05:31:10.376588+0000","last_fullsized":"2024-04-17T05:31:10.376588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:08:20.405780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.381614+0000","last_change":"2024-04-17T05:26:53.238192+0000","last_active":"2024-04-17T05:33:47.381614+0000","last_peered":"2024-04-17T05:33:47.381614+0000","last_clean":"2024-04-17T05:33:47.381614+0000","last_became_active":"2024-04-17T05:26:53.237901+0000","last_became_peered":"2024-04-17T05:26:53.237901+0000","last_unstale":"2024-04-17T05:33:47.381614+0000","last_undegraded":"2024-04-17T05:33:47.381614+0000","last_fullsized":"2024-04-17T05:33:47.381614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:31:26.820940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'106","reported_seq":135,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:46.314246+0000","last_change":"2024-04-17T05:26:52.213337+0000","last_active":"2024-04-17T05:33:46.314246+0000","last_peered":"2024-04-17T05:33:46.314246+0000","last_clean":"2024-04-17T05:33:46.314246+0000","last_became_active":"2024-04-17T05:26:52.213091+0000","last_became_peered":"2024-04-17T05:26:52.213091+0000","last_unstale":"2024-04-17T05:33:46.314246+0000","last_undegraded":"2024-04-17T05:33:46.314246+0000","last_fullsized":"2024-04-17T05:33:46.314246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:26.013417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":210,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:00.378550+0000","last_change":"2024-04-17T05:26:57.342025+0000","last_active":"2024-04-17T05:31:00.378550+0000","last_peered":"2024-04-17T05:31:00.378550+0000","last_clean":"2024-04-17T05:31:00.378550+0000","last_became_active":"2024-04-17T05:26:57.341654+0000","last_became_peered":"2024-04-17T05:26:57.341654+0000","last_unstale":"2024-04-17T05:31:00.378550+0000","last_undegraded":"2024-04-17T05:31:00.378550+0000","last_fullsized":"2024-04-17T05:31:00.378550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:43:39.199679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'11","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.364293+0000","last_change":"2024-04-17T05:26:53.220626+0000","last_active":"2024-04-17T05:33:47.364293+0000","last_peered":"2024-04-17T05:33:47.364293+0000","last_clean":"2024-04-17T05:33:47.364293+0000","last_became_active":"2024-04-17T05:26:53.220331+0000","last_became_peered":"2024-04-17T05:26:53.220331+0000","last_unstale":"2024-04-17T05:33:47.364293+0000","last_undegraded":"2024-04-17T05:33:47.364293+0000","last_fullsized":"2024-04-17T05:33:47.364293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:32:25.337967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:05.423944+0000","last_change":"2024-04-17T05:26:52.216060+0000","last_active":"2024-04-17T05:31:05.423944+0000","last_peered":"2024-04-17T05:31:05.423944+0000","last_clean":"2024-04-17T05:31:05.423944+0000","last_became_active":"2024-04-17T05:26:52.215771+0000","last_became_peered":"2024-04-17T05:26:52.215771+0000","last_unstale":"2024-04-17T05:31:05.423944+0000","last_undegraded":"2024-04-17T05:31:05.423944+0000","last_fullsized":"2024-04-17T05:31:05.423944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:14:11.769826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'5","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:32:12.762866+0000","last_change":"2024-04-17T05:27:39.587602+0000","last_active":"2024-04-17T05:32:12.762866+0000","last_peered":"2024-04-17T05:32:12.762866+0000","last_clean":"2024-04-17T05:32:12.762866+0000","last_became_active":"2024-04-17T05:27:39.586593+0000","last_became_peered":"2024-04-17T05:27:39.586593+0000","last_unstale":"2024-04-17T05:32:12.762866+0000","last_undegraded":"2024-04-17T05:32:12.762866+0000","last_fullsized":"2024-04-17T05:32:12.762866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:46:03.707528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.396983+0000","last_change":"2024-04-17T05:26:53.238977+0000","last_active":"2024-04-17T05:33:47.396983+0000","last_peered":"2024-04-17T05:33:47.396983+0000","last_clean":"2024-04-17T05:33:47.396983+0000","last_became_active":"2024-04-17T05:26:53.238516+0000","last_became_peered":"2024-04-17T05:26:53.238516+0000","last_unstale":"2024-04-17T05:33:47.396983+0000","last_undegraded":"2024-04-17T05:33:47.396983+0000","last_fullsized":"2024-04-17T05:33:47.396983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:59:47.655532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:05.385269+0000","last_change":"2024-04-17T05:26:52.204960+0000","last_active":"2024-04-17T05:31:05.385269+0000","last_peered":"2024-04-17T05:31:05.385269+0000","last_clean":"2024-04-17T05:31:05.385269+0000","last_became_active":"2024-04-17T05:26:52.204529+0000","last_became_peered":"2024-04-17T05:26:52.204529+0000","last_unstale":"2024-04-17T05:31:05.385269+0000","last_undegraded":"2024-04-17T05:31:05.385269+0000","last_fullsized":"2024-04-17T05:31:05.385269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:28.440614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:10.386195+0000","last_change":"2024-04-17T05:26:57.300433+0000","last_active":"2024-04-17T05:31:10.386195+0000","last_peered":"2024-04-17T05:31:10.386195+0000","last_clean":"2024-04-17T05:31:10.386195+0000","last_became_active":"2024-04-17T05:26:57.299625+0000","last_became_peered":"2024-04-17T05:26:57.299625+0000","last_unstale":"2024-04-17T05:31:10.386195+0000","last_undegraded":"2024-04-17T05:31:10.386195+0000","last_fullsized":"2024-04-17T05:31:10.386195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:59:51.738314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.382415+0000","last_change":"2024-04-17T05:26:53.221039+0000","last_active":"2024-04-17T05:33:47.382415+0000","last_peered":"2024-04-17T05:33:47.382415+0000","last_clean":"2024-04-17T05:33:47.382415+0000","last_became_active":"2024-04-17T05:26:53.220763+0000","last_became_peered":"2024-04-17T05:26:53.220763+0000","last_unstale":"2024-04-17T05:33:47.382415+0000","last_undegraded":"2024-04-17T05:33:47.382415+0000","last_fullsized":"2024-04-17T05:33:47.382415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:06:06.694765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:05.373798+0000","last_change":"2024-04-17T05:26:52.200059+0000","last_active":"2024-04-17T05:31:05.373798+0000","last_peered":"2024-04-17T05:31:05.373798+0000","last_clean":"2024-04-17T05:31:05.373798+0000","last_became_active":"2024-04-17T05:26:52.199528+0000","last_became_peered":"2024-04-17T05:26:52.199528+0000","last_unstale":"2024-04-17T05:31:05.373798+0000","last_undegraded":"2024-04-17T05:31:05.373798+0000","last_fullsized":"2024-04-17T05:31:05.373798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:39:42.873364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'2","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:39.476676+0000","last_change":"2024-04-17T05:27:39.629806+0000","last_active":"2024-04-17T05:33:39.476676+0000","last_peered":"2024-04-17T05:33:39.476676+0000","last_clean":"2024-04-17T05:33:39.476676+0000","last_became_active":"2024-04-17T05:27:39.628034+0000","last_became_peered":"2024-04-17T05:27:39.628034+0000","last_unstale":"2024-04-17T05:33:39.476676+0000","last_undegraded":"2024-04-17T05:33:39.476676+0000","last_fullsized":"2024-04-17T05:33:39.476676+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:39:30.581787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.372142+0000","last_change":"2024-04-17T05:26:53.225946+0000","last_active":"2024-04-17T05:33:47.372142+0000","last_peered":"2024-04-17T05:33:47.372142+0000","last_clean":"2024-04-17T05:33:47.372142+0000","last_became_active":"2024-04-17T05:26:53.220930+0000","last_became_peered":"2024-04-17T05:26:53.220930+0000","last_unstale":"2024-04-17T05:33:47.372142+0000","last_undegraded":"2024-04-17T05:33:47.372142+0000","last_fullsized":"2024-04-17T05:33:47.372142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:08:41.870139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'42","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:42.901807+0000","last_change":"2024-04-17T05:26:52.200139+0000","last_active":"2024-04-17T05:33:42.901807+0000","last_peered":"2024-04-17T05:33:42.901807+0000","last_clean":"2024-04-17T05:33:42.901807+0000","last_became_active":"2024-04-17T05:26:52.199804+0000","last_became_peered":"2024-04-17T05:26:52.199804+0000","last_unstale":"2024-04-17T05:33:42.901807+0000","last_undegraded":"2024-04-17T05:33:42.901807+0000","last_fullsized":"2024-04-17T05:33:42.901807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:05:28.743450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10823,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":36,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:20.388171+0000","last_change":"2024-04-17T05:26:57.303365+0000","last_active":"2024-04-17T05:31:20.388171+0000","last_peered":"2024-04-17T05:31:20.388171+0000","last_clean":"2024-04-17T05:31:20.388171+0000","last_became_active":"2024-04-17T05:26:57.301101+0000","last_became_peered":"2024-04-17T05:26:57.301101+0000","last_unstale":"2024-04-17T05:31:20.388171+0000","last_undegraded":"2024-04-17T05:31:20.388171+0000","last_fullsized":"2024-04-17T05:31:20.388171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:43:39.199679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.386448+0000","last_change":"2024-04-17T05:26:53.238762+0000","last_active":"2024-04-17T05:33:47.386448+0000","last_peered":"2024-04-17T05:33:47.386448+0000","last_clean":"2024-04-17T05:33:47.386448+0000","last_became_active":"2024-04-17T05:26:53.238488+0000","last_became_peered":"2024-04-17T05:26:53.238488+0000","last_unstale":"2024-04-17T05:33:47.386448+0000","last_undegraded":"2024-04-17T05:33:47.386448+0000","last_fullsized":"2024-04-17T05:33:47.386448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:38.214751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:55.422328+0000","last_change":"2024-04-17T05:26:52.213104+0000","last_active":"2024-04-17T05:30:55.422328+0000","last_peered":"2024-04-17T05:30:55.422328+0000","last_clean":"2024-04-17T05:30:55.422328+0000","last_became_active":"2024-04-17T05:26:52.212838+0000","last_became_peered":"2024-04-17T05:26:52.212838+0000","last_unstale":"2024-04-17T05:30:55.422328+0000","last_undegraded":"2024-04-17T05:30:55.422328+0000","last_fullsized":"2024-04-17T05:30:55.422328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:11:58.913400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:20.382835+0000","last_change":"2024-04-17T05:26:57.342387+0000","last_active":"2024-04-17T05:31:20.382835+0000","last_peered":"2024-04-17T05:31:20.382835+0000","last_clean":"2024-04-17T05:31:20.382835+0000","last_became_active":"2024-04-17T05:26:57.342008+0000","last_became_peered":"2024-04-17T05:26:57.342008+0000","last_unstale":"2024-04-17T05:31:20.382835+0000","last_undegraded":"2024-04-17T05:31:20.382835+0000","last_fullsized":"2024-04-17T05:31:20.382835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:43:39.199679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.393491+0000","last_change":"2024-04-17T05:26:53.243046+0000","last_active":"2024-04-17T05:33:47.393491+0000","last_peered":"2024-04-17T05:33:47.393491+0000","last_clean":"2024-04-17T05:33:47.393491+0000","last_became_active":"2024-04-17T05:26:53.242778+0000","last_became_peered":"2024-04-17T05:26:53.242778+0000","last_unstale":"2024-04-17T05:33:47.393491+0000","last_undegraded":"2024-04-17T05:33:47.393491+0000","last_fullsized":"2024-04-17T05:33:47.393491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:32:25.337967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:05.373837+0000","last_change":"2024-04-17T05:26:52.198125+0000","last_active":"2024-04-17T05:31:05.373837+0000","last_peered":"2024-04-17T05:31:05.373837+0000","last_clean":"2024-04-17T05:31:05.373837+0000","last_became_active":"2024-04-17T05:26:52.197762+0000","last_became_peered":"2024-04-17T05:26:52.197762+0000","last_unstale":"2024-04-17T05:31:05.373837+0000","last_undegraded":"2024-04-17T05:31:05.373837+0000","last_fullsized":"2024-04-17T05:31:05.373837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:28.440614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":185,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:50.421452+0000","last_change":"2024-04-17T05:26:48.072527+0000","last_active":"2024-04-17T05:30:50.421452+0000","last_peered":"2024-04-17T05:30:50.421452+0000","last_clean":"2024-04-17T05:30:50.421452+0000","last_became_active":"2024-04-17T05:26:48.070585+0000","last_became_peered":"2024-04-17T05:26:48.070585+0000","last_unstale":"2024-04-17T05:30:50.421452+0000","last_undegraded":"2024-04-17T05:30:50.421452+0000","last_fullsized":"2024-04-17T05:30:50.421452+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:46.995002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:46.995002+0000","last_clean_scrub_stamp":"2024-04-17T05:26:46.995002+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:48:35.792125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:10.413588+0000","last_change":"2024-04-17T05:26:57.346681+0000","last_active":"2024-04-17T05:31:10.413588+0000","last_peered":"2024-04-17T05:31:10.413588+0000","last_clean":"2024-04-17T05:31:10.413588+0000","last_became_active":"2024-04-17T05:26:57.345320+0000","last_became_peered":"2024-04-17T05:26:57.345320+0000","last_unstale":"2024-04-17T05:31:10.413588+0000","last_undegraded":"2024-04-17T05:31:10.413588+0000","last_fullsized":"2024-04-17T05:31:10.413588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:14:02.473527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'5","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.384494+0000","last_change":"2024-04-17T05:27:39.898572+0000","last_active":"2024-04-17T05:33:47.384494+0000","last_peered":"2024-04-17T05:33:47.384494+0000","last_clean":"2024-04-17T05:33:47.384494+0000","last_became_active":"2024-04-17T05:27:39.897777+0000","last_became_peered":"2024-04-17T05:27:39.897777+0000","last_unstale":"2024-04-17T05:33:47.384494+0000","last_undegraded":"2024-04-17T05:33:47.384494+0000","last_fullsized":"2024-04-17T05:33:47.384494+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:31:02.906556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:40.399880+0000","last_change":"2024-04-17T05:26:52.209276+0000","last_active":"2024-04-17T05:33:40.399880+0000","last_peered":"2024-04-17T05:33:40.399880+0000","last_clean":"2024-04-17T05:33:40.399880+0000","last_became_active":"2024-04-17T05:26:52.208422+0000","last_became_peered":"2024-04-17T05:26:52.208422+0000","last_unstale":"2024-04-17T05:33:40.399880+0000","last_undegraded":"2024-04-17T05:33:40.399880+0000","last_fullsized":"2024-04-17T05:33:40.399880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:39:42.873364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:20.415373+0000","last_change":"2024-04-17T05:26:57.342209+0000","last_active":"2024-04-17T05:31:20.415373+0000","last_peered":"2024-04-17T05:31:20.415373+0000","last_clean":"2024-04-17T05:31:20.415373+0000","last_became_active":"2024-04-17T05:26:57.341658+0000","last_became_peered":"2024-04-17T05:26:57.341658+0000","last_unstale":"2024-04-17T05:31:20.415373+0000","last_undegraded":"2024-04-17T05:31:20.415373+0000","last_fullsized":"2024-04-17T05:31:20.415373+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:49.740852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.392825+0000","last_change":"2024-04-17T05:26:53.239720+0000","last_active":"2024-04-17T05:33:47.392825+0000","last_peered":"2024-04-17T05:33:47.392825+0000","last_clean":"2024-04-17T05:33:47.392825+0000","last_became_active":"2024-04-17T05:26:53.238669+0000","last_became_peered":"2024-04-17T05:26:53.238669+0000","last_unstale":"2024-04-17T05:33:47.392825+0000","last_undegraded":"2024-04-17T05:33:47.392825+0000","last_fullsized":"2024-04-17T05:33:47.392825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:58:59.967200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:25.388997+0000","last_change":"2024-04-17T05:26:52.202596+0000","last_active":"2024-04-17T05:31:25.388997+0000","last_peered":"2024-04-17T05:31:25.388997+0000","last_clean":"2024-04-17T05:31:25.388997+0000","last_became_active":"2024-04-17T05:26:52.202246+0000","last_became_peered":"2024-04-17T05:26:52.202246+0000","last_unstale":"2024-04-17T05:31:25.388997+0000","last_undegraded":"2024-04-17T05:31:25.388997+0000","last_fullsized":"2024-04-17T05:31:25.388997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:30.475514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:30.384580+0000","last_change":"2024-04-17T05:26:57.303069+0000","last_active":"2024-04-17T05:31:30.384580+0000","last_peered":"2024-04-17T05:31:30.384580+0000","last_clean":"2024-04-17T05:31:30.384580+0000","last_became_active":"2024-04-17T05:26:57.302457+0000","last_became_peered":"2024-04-17T05:26:57.302457+0000","last_unstale":"2024-04-17T05:31:30.384580+0000","last_undegraded":"2024-04-17T05:31:30.384580+0000","last_fullsized":"2024-04-17T05:31:30.384580+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:45:07.123915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.391025+0000","last_change":"2024-04-17T05:26:53.255140+0000","last_active":"2024-04-17T05:33:47.391025+0000","last_peered":"2024-04-17T05:33:47.391025+0000","last_clean":"2024-04-17T05:33:47.391025+0000","last_became_active":"2024-04-17T05:26:53.254371+0000","last_became_peered":"2024-04-17T05:26:53.254371+0000","last_unstale":"2024-04-17T05:33:47.391025+0000","last_undegraded":"2024-04-17T05:33:47.391025+0000","last_fullsized":"2024-04-17T05:33:47.391025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:33:12.651636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:25.381608+0000","last_change":"2024-04-17T05:26:52.204598+0000","last_active":"2024-04-17T05:31:25.381608+0000","last_peered":"2024-04-17T05:31:25.381608+0000","last_clean":"2024-04-17T05:31:25.381608+0000","last_became_active":"2024-04-17T05:26:52.204139+0000","last_became_peered":"2024-04-17T05:26:52.204139+0000","last_unstale":"2024-04-17T05:31:25.381608+0000","last_undegraded":"2024-04-17T05:31:25.381608+0000","last_fullsized":"2024-04-17T05:31:25.381608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:11:26.292397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:20.376450+0000","last_change":"2024-04-17T05:26:57.345152+0000","last_active":"2024-04-17T05:31:20.376450+0000","last_peered":"2024-04-17T05:31:20.376450+0000","last_clean":"2024-04-17T05:31:20.376450+0000","last_became_active":"2024-04-17T05:26:57.342006+0000","last_became_peered":"2024-04-17T05:26:57.342006+0000","last_unstale":"2024-04-17T05:31:20.376450+0000","last_undegraded":"2024-04-17T05:31:20.376450+0000","last_fullsized":"2024-04-17T05:31:20.376450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:56:05.345989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.389227+0000","last_change":"2024-04-17T05:26:53.253746+0000","last_active":"2024-04-17T05:33:47.389227+0000","last_peered":"2024-04-17T05:33:47.389227+0000","last_clean":"2024-04-17T05:33:47.389227+0000","last_became_active":"2024-04-17T05:26:53.253395+0000","last_became_peered":"2024-04-17T05:26:53.253395+0000","last_unstale":"2024-04-17T05:33:47.389227+0000","last_undegraded":"2024-04-17T05:33:47.389227+0000","last_fullsized":"2024-04-17T05:33:47.389227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:46:38.091860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:25.378894+0000","last_change":"2024-04-17T05:26:52.199105+0000","last_active":"2024-04-17T05:31:25.378894+0000","last_peered":"2024-04-17T05:31:25.378894+0000","last_clean":"2024-04-17T05:31:25.378894+0000","last_became_active":"2024-04-17T05:26:52.198798+0000","last_became_peered":"2024-04-17T05:26:52.198798+0000","last_unstale":"2024-04-17T05:31:25.378894+0000","last_undegraded":"2024-04-17T05:31:25.378894+0000","last_fullsized":"2024-04-17T05:31:25.378894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:34:06.405382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:20.378107+0000","last_change":"2024-04-17T05:26:57.306130+0000","last_active":"2024-04-17T05:31:20.378107+0000","last_peered":"2024-04-17T05:31:20.378107+0000","last_clean":"2024-04-17T05:31:20.378107+0000","last_became_active":"2024-04-17T05:26:57.305415+0000","last_became_peered":"2024-04-17T05:26:57.305415+0000","last_unstale":"2024-04-17T05:31:20.378107+0000","last_undegraded":"2024-04-17T05:31:20.378107+0000","last_fullsized":"2024-04-17T05:31:20.378107+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:36.214126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"28'7","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.386317+0000","last_change":"2024-04-17T05:27:39.579857+0000","last_active":"2024-04-17T05:33:47.386317+0000","last_peered":"2024-04-17T05:33:47.386317+0000","last_clean":"2024-04-17T05:33:47.386317+0000","last_became_active":"2024-04-17T05:27:39.579096+0000","last_became_peered":"2024-04-17T05:27:39.579096+0000","last_unstale":"2024-04-17T05:33:47.386317+0000","last_undegraded":"2024-04-17T05:33:47.386317+0000","last_fullsized":"2024-04-17T05:33:47.386317+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:52:32.392870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"28'11","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:27.598751+0000","last_change":"2024-04-17T05:26:52.197556+0000","last_active":"2024-04-17T05:30:27.598751+0000","last_peered":"2024-04-17T05:30:27.598751+0000","last_clean":"2024-04-17T05:30:27.598751+0000","last_became_active":"2024-04-17T05:26:52.197250+0000","last_became_peered":"2024-04-17T05:26:52.197250+0000","last_unstale":"2024-04-17T05:30:27.598751+0000","last_undegraded":"2024-04-17T05:30:27.598751+0000","last_fullsized":"2024-04-17T05:30:27.598751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:12:06.528342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:25.364162+0000","last_change":"2024-04-17T05:26:57.296438+0000","last_active":"2024-04-17T05:29:25.364162+0000","last_peered":"2024-04-17T05:29:25.364162+0000","last_clean":"2024-04-17T05:29:25.364162+0000","last_became_active":"2024-04-17T05:26:57.296040+0000","last_became_peered":"2024-04-17T05:26:57.296040+0000","last_unstale":"2024-04-17T05:29:25.364162+0000","last_undegraded":"2024-04-17T05:29:25.364162+0000","last_fullsized":"2024-04-17T05:29:25.364162+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:43:13.615366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'9","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.382356+0000","last_change":"2024-04-17T05:26:53.231338+0000","last_active":"2024-04-17T05:33:47.382356+0000","last_peered":"2024-04-17T05:33:47.382356+0000","last_clean":"2024-04-17T05:33:47.382356+0000","last_became_active":"2024-04-17T05:26:53.230987+0000","last_became_peered":"2024-04-17T05:26:53.230987+0000","last_unstale":"2024-04-17T05:33:47.382356+0000","last_undegraded":"2024-04-17T05:33:47.382356+0000","last_fullsized":"2024-04-17T05:33:47.382356+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:08:10.489719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'3","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:17.583470+0000","last_change":"2024-04-17T05:26:52.207087+0000","last_active":"2024-04-17T05:30:17.583470+0000","last_peered":"2024-04-17T05:30:17.583470+0000","last_clean":"2024-04-17T05:30:17.583470+0000","last_became_active":"2024-04-17T05:26:52.206401+0000","last_became_peered":"2024-04-17T05:26:52.206401+0000","last_unstale":"2024-04-17T05:30:17.583470+0000","last_undegraded":"2024-04-17T05:30:17.583470+0000","last_fullsized":"2024-04-17T05:30:17.583470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:56:53.915549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:25.362846+0000","last_change":"2024-04-17T05:26:57.346955+0000","last_active":"2024-04-17T05:29:25.362846+0000","last_peered":"2024-04-17T05:29:25.362846+0000","last_clean":"2024-04-17T05:29:25.362846+0000","last_became_active":"2024-04-17T05:26:57.346516+0000","last_became_peered":"2024-04-17T05:26:57.346516+0000","last_unstale":"2024-04-17T05:29:25.362846+0000","last_undegraded":"2024-04-17T05:29:25.362846+0000","last_fullsized":"2024-04-17T05:29:25.362846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:00:55.830345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"28'20","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.392299+0000","last_change":"2024-04-17T05:26:53.254195+0000","last_active":"2024-04-17T05:33:47.392299+0000","last_peered":"2024-04-17T05:33:47.392299+0000","last_clean":"2024-04-17T05:33:47.392299+0000","last_became_active":"2024-04-17T05:26:53.253813+0000","last_became_peered":"2024-04-17T05:26:53.253813+0000","last_unstale":"2024-04-17T05:33:47.392299+0000","last_undegraded":"2024-04-17T05:33:47.392299+0000","last_fullsized":"2024-04-17T05:33:47.392299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:18:31.208224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'8","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:27.599886+0000","last_change":"2024-04-17T05:26:52.211664+0000","last_active":"2024-04-17T05:30:27.599886+0000","last_peered":"2024-04-17T05:30:27.599886+0000","last_clean":"2024-04-17T05:30:27.599886+0000","last_became_active":"2024-04-17T05:26:52.210106+0000","last_became_peered":"2024-04-17T05:26:52.210106+0000","last_unstale":"2024-04-17T05:30:27.599886+0000","last_undegraded":"2024-04-17T05:30:27.599886+0000","last_fullsized":"2024-04-17T05:30:27.599886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:11:26.292397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:20.361839+0000","last_change":"2024-04-17T05:26:57.344473+0000","last_active":"2024-04-17T05:29:20.361839+0000","last_peered":"2024-04-17T05:29:20.361839+0000","last_clean":"2024-04-17T05:29:20.361839+0000","last_became_active":"2024-04-17T05:26:57.341999+0000","last_became_peered":"2024-04-17T05:26:57.341999+0000","last_unstale":"2024-04-17T05:29:20.361839+0000","last_undegraded":"2024-04-17T05:29:20.361839+0000","last_fullsized":"2024-04-17T05:29:20.361839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:35:19.879335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.386810+0000","last_change":"2024-04-17T05:26:53.235732+0000","last_active":"2024-04-17T05:33:47.386810+0000","last_peered":"2024-04-17T05:33:47.386810+0000","last_clean":"2024-04-17T05:33:47.386810+0000","last_became_active":"2024-04-17T05:26:53.233202+0000","last_became_peered":"2024-04-17T05:26:53.233202+0000","last_unstale":"2024-04-17T05:33:47.386810+0000","last_undegraded":"2024-04-17T05:33:47.386810+0000","last_fullsized":"2024-04-17T05:33:47.386810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:58:23.088108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'4","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:32.503235+0000","last_change":"2024-04-17T05:26:52.194788+0000","last_active":"2024-04-17T05:29:32.503235+0000","last_peered":"2024-04-17T05:29:32.503235+0000","last_clean":"2024-04-17T05:29:32.503235+0000","last_became_active":"2024-04-17T05:26:52.194504+0000","last_became_peered":"2024-04-17T05:26:52.194504+0000","last_unstale":"2024-04-17T05:29:32.503235+0000","last_undegraded":"2024-04-17T05:29:32.503235+0000","last_fullsized":"2024-04-17T05:29:32.503235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:29:09.631143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:25.357676+0000","last_change":"2024-04-17T05:26:57.344052+0000","last_active":"2024-04-17T05:29:25.357676+0000","last_peered":"2024-04-17T05:29:25.357676+0000","last_clean":"2024-04-17T05:29:25.357676+0000","last_became_active":"2024-04-17T05:26:57.343479+0000","last_became_peered":"2024-04-17T05:26:57.343479+0000","last_unstale":"2024-04-17T05:29:25.357676+0000","last_undegraded":"2024-04-17T05:29:25.357676+0000","last_fullsized":"2024-04-17T05:29:25.357676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:23:44.724644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.384414+0000","last_change":"2024-04-17T05:26:53.250744+0000","last_active":"2024-04-17T05:33:47.384414+0000","last_peered":"2024-04-17T05:33:47.384414+0000","last_clean":"2024-04-17T05:33:47.384414+0000","last_became_active":"2024-04-17T05:26:53.249125+0000","last_became_peered":"2024-04-17T05:26:53.249125+0000","last_unstale":"2024-04-17T05:33:47.384414+0000","last_undegraded":"2024-04-17T05:33:47.384414+0000","last_fullsized":"2024-04-17T05:33:47.384414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:29.313074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'95","reported_seq":123,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.322968+0000","last_change":"2024-04-17T05:26:52.208074+0000","last_active":"2024-04-17T05:33:47.322968+0000","last_peered":"2024-04-17T05:33:47.322968+0000","last_clean":"2024-04-17T05:33:47.322968+0000","last_became_active":"2024-04-17T05:26:52.207696+0000","last_became_peered":"2024-04-17T05:26:52.207696+0000","last_unstale":"2024-04-17T05:33:47.322968+0000","last_undegraded":"2024-04-17T05:33:47.322968+0000","last_fullsized":"2024-04-17T05:33:47.322968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:10:33.072665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":934282,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:20.368982+0000","last_change":"2024-04-17T05:26:57.303649+0000","last_active":"2024-04-17T05:29:20.368982+0000","last_peered":"2024-04-17T05:29:20.368982+0000","last_clean":"2024-04-17T05:29:20.368982+0000","last_became_active":"2024-04-17T05:26:57.303124+0000","last_became_peered":"2024-04-17T05:26:57.303124+0000","last_unstale":"2024-04-17T05:29:20.368982+0000","last_undegraded":"2024-04-17T05:29:20.368982+0000","last_fullsized":"2024-04-17T05:29:20.368982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:59:04.049982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'12","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.391609+0000","last_change":"2024-04-17T05:26:53.232911+0000","last_active":"2024-04-17T05:33:47.391609+0000","last_peered":"2024-04-17T05:33:47.391609+0000","last_clean":"2024-04-17T05:33:47.391609+0000","last_became_active":"2024-04-17T05:26:53.232624+0000","last_became_peered":"2024-04-17T05:26:53.232624+0000","last_unstale":"2024-04-17T05:33:47.391609+0000","last_undegraded":"2024-04-17T05:33:47.391609+0000","last_fullsized":"2024-04-17T05:33:47.391609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:31.494213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'26","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:41.911653+0000","last_change":"2024-04-17T05:26:52.207484+0000","last_active":"2024-04-17T05:33:41.911653+0000","last_peered":"2024-04-17T05:33:41.911653+0000","last_clean":"2024-04-17T05:33:41.911653+0000","last_became_active":"2024-04-17T05:26:52.207181+0000","last_became_peered":"2024-04-17T05:26:52.207181+0000","last_unstale":"2024-04-17T05:33:41.911653+0000","last_undegraded":"2024-04-17T05:33:41.911653+0000","last_fullsized":"2024-04-17T05:33:41.911653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:06:05.676066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:20.359125+0000","last_change":"2024-04-17T05:27:39.629173+0000","last_active":"2024-04-17T05:29:20.359125+0000","last_peered":"2024-04-17T05:29:20.359125+0000","last_clean":"2024-04-17T05:29:20.359125+0000","last_became_active":"2024-04-17T05:27:39.627825+0000","last_became_peered":"2024-04-17T05:27:39.627825+0000","last_unstale":"2024-04-17T05:29:20.359125+0000","last_undegraded":"2024-04-17T05:29:20.359125+0000","last_fullsized":"2024-04-17T05:29:20.359125+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:00:55.830345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"28'9","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.396634+0000","last_change":"2024-04-17T05:26:53.241678+0000","last_active":"2024-04-17T05:33:47.396634+0000","last_peered":"2024-04-17T05:33:47.396634+0000","last_clean":"2024-04-17T05:33:47.396634+0000","last_became_active":"2024-04-17T05:26:53.241388+0000","last_became_peered":"2024-04-17T05:26:53.241388+0000","last_unstale":"2024-04-17T05:33:47.396634+0000","last_undegraded":"2024-04-17T05:33:47.396634+0000","last_fullsized":"2024-04-17T05:33:47.396634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:32:25.337967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'7","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:17.584715+0000","last_change":"2024-04-17T05:26:52.213786+0000","last_active":"2024-04-17T05:30:17.584715+0000","last_peered":"2024-04-17T05:30:17.584715+0000","last_clean":"2024-04-17T05:30:17.584715+0000","last_became_active":"2024-04-17T05:26:52.212440+0000","last_became_peered":"2024-04-17T05:26:52.212440+0000","last_unstale":"2024-04-17T05:30:17.584715+0000","last_undegraded":"2024-04-17T05:30:17.584715+0000","last_fullsized":"2024-04-17T05:30:17.584715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:06:05.676066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:20.361590+0000","last_change":"2024-04-17T05:26:57.300596+0000","last_active":"2024-04-17T05:29:20.361590+0000","last_peered":"2024-04-17T05:29:20.361590+0000","last_clean":"2024-04-17T05:29:20.361590+0000","last_became_active":"2024-04-17T05:26:57.300156+0000","last_became_peered":"2024-04-17T05:26:57.300156+0000","last_unstale":"2024-04-17T05:29:20.361590+0000","last_undegraded":"2024-04-17T05:29:20.361590+0000","last_fullsized":"2024-04-17T05:29:20.361590+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:11:16.497552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.395877+0000","last_change":"2024-04-17T05:26:53.238893+0000","last_active":"2024-04-17T05:33:47.395877+0000","last_peered":"2024-04-17T05:33:47.395877+0000","last_clean":"2024-04-17T05:33:47.395877+0000","last_became_active":"2024-04-17T05:26:53.238566+0000","last_became_peered":"2024-04-17T05:26:53.238566+0000","last_unstale":"2024-04-17T05:33:47.395877+0000","last_undegraded":"2024-04-17T05:33:47.395877+0000","last_fullsized":"2024-04-17T05:33:47.395877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:52:32.392870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"28'5","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:27.602689+0000","last_change":"2024-04-17T05:26:52.215304+0000","last_active":"2024-04-17T05:30:27.602689+0000","last_peered":"2024-04-17T05:30:27.602689+0000","last_clean":"2024-04-17T05:30:27.602689+0000","last_became_active":"2024-04-17T05:26:52.214958+0000","last_became_peered":"2024-04-17T05:26:52.214958+0000","last_unstale":"2024-04-17T05:30:27.602689+0000","last_undegraded":"2024-04-17T05:30:27.602689+0000","last_fullsized":"2024-04-17T05:30:27.602689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:13:25.702517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:20.361720+0000","last_change":"2024-04-17T05:26:57.342083+0000","last_active":"2024-04-17T05:29:20.361720+0000","last_peered":"2024-04-17T05:29:20.361720+0000","last_clean":"2024-04-17T05:29:20.361720+0000","last_became_active":"2024-04-17T05:26:57.341304+0000","last_became_peered":"2024-04-17T05:26:57.341304+0000","last_unstale":"2024-04-17T05:29:20.361720+0000","last_undegraded":"2024-04-17T05:29:20.361720+0000","last_fullsized":"2024-04-17T05:29:20.361720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:56:05.345989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:00.379085+0000","last_change":"2024-04-17T05:26:57.342446+0000","last_active":"2024-04-17T05:31:00.379085+0000","last_peered":"2024-04-17T05:31:00.379085+0000","last_clean":"2024-04-17T05:31:00.379085+0000","last_became_active":"2024-04-17T05:26:57.342076+0000","last_became_peered":"2024-04-17T05:26:57.342076+0000","last_unstale":"2024-04-17T05:31:00.379085+0000","last_undegraded":"2024-04-17T05:31:00.379085+0000","last_fullsized":"2024-04-17T05:31:00.379085+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:59:51.738314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'11","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.374673+0000","last_change":"2024-04-17T05:26:53.228706+0000","last_active":"2024-04-17T05:33:47.374673+0000","last_peered":"2024-04-17T05:33:47.374673+0000","last_clean":"2024-04-17T05:33:47.374673+0000","last_became_active":"2024-04-17T05:26:53.228381+0000","last_became_peered":"2024-04-17T05:26:53.228381+0000","last_unstale":"2024-04-17T05:33:47.374673+0000","last_undegraded":"2024-04-17T05:33:47.374673+0000","last_fullsized":"2024-04-17T05:33:47.374673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:04:57.213834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'5","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:27.602400+0000","last_change":"2024-04-17T05:26:52.195697+0000","last_active":"2024-04-17T05:30:27.602400+0000","last_peered":"2024-04-17T05:30:27.602400+0000","last_clean":"2024-04-17T05:30:27.602400+0000","last_became_active":"2024-04-17T05:26:52.193995+0000","last_became_peered":"2024-04-17T05:26:52.193995+0000","last_unstale":"2024-04-17T05:30:27.602400+0000","last_undegraded":"2024-04-17T05:30:27.602400+0000","last_fullsized":"2024-04-17T05:30:27.602400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:05:28.743450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:10.413660+0000","last_change":"2024-04-17T05:26:57.306563+0000","last_active":"2024-04-17T05:31:10.413660+0000","last_peered":"2024-04-17T05:31:10.413660+0000","last_clean":"2024-04-17T05:31:10.413660+0000","last_became_active":"2024-04-17T05:26:57.305777+0000","last_became_peered":"2024-04-17T05:26:57.305777+0000","last_unstale":"2024-04-17T05:31:10.413660+0000","last_undegraded":"2024-04-17T05:31:10.413660+0000","last_fullsized":"2024-04-17T05:31:10.413660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:33.395856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.376456+0000","last_change":"2024-04-17T05:26:53.229100+0000","last_active":"2024-04-17T05:33:47.376456+0000","last_peered":"2024-04-17T05:33:47.376456+0000","last_clean":"2024-04-17T05:33:47.376456+0000","last_became_active":"2024-04-17T05:26:53.225554+0000","last_became_peered":"2024-04-17T05:26:53.225554+0000","last_unstale":"2024-04-17T05:33:47.376456+0000","last_undegraded":"2024-04-17T05:33:47.376456+0000","last_fullsized":"2024-04-17T05:33:47.376456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:04:57.213834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'2","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:22.591064+0000","last_change":"2024-04-17T05:26:52.205214+0000","last_active":"2024-04-17T05:30:22.591064+0000","last_peered":"2024-04-17T05:30:22.591064+0000","last_clean":"2024-04-17T05:30:22.591064+0000","last_became_active":"2024-04-17T05:26:52.204982+0000","last_became_peered":"2024-04-17T05:26:52.204982+0000","last_unstale":"2024-04-17T05:30:22.591064+0000","last_undegraded":"2024-04-17T05:30:22.591064+0000","last_fullsized":"2024-04-17T05:30:22.591064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:12:06.528342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"28'4","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:02.559734+0000","last_change":"2024-04-17T05:26:52.211538+0000","last_active":"2024-04-17T05:30:02.559734+0000","last_peered":"2024-04-17T05:30:02.559734+0000","last_clean":"2024-04-17T05:30:02.559734+0000","last_became_active":"2024-04-17T05:26:52.211242+0000","last_became_peered":"2024-04-17T05:26:52.211242+0000","last_unstale":"2024-04-17T05:30:02.559734+0000","last_undegraded":"2024-04-17T05:30:02.559734+0000","last_fullsized":"2024-04-17T05:30:02.559734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:30:14.163882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'7","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.391215+0000","last_change":"2024-04-17T05:26:53.239968+0000","last_active":"2024-04-17T05:33:47.391215+0000","last_peered":"2024-04-17T05:33:47.391215+0000","last_clean":"2024-04-17T05:33:47.391215+0000","last_became_active":"2024-04-17T05:26:53.239688+0000","last_became_peered":"2024-04-17T05:26:53.239688+0000","last_unstale":"2024-04-17T05:33:47.391215+0000","last_undegraded":"2024-04-17T05:33:47.391215+0000","last_fullsized":"2024-04-17T05:33:47.391215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:19:17.442103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:30.363424+0000","last_change":"2024-04-17T05:26:57.297209+0000","last_active":"2024-04-17T05:29:30.363424+0000","last_peered":"2024-04-17T05:29:30.363424+0000","last_clean":"2024-04-17T05:29:30.363424+0000","last_became_active":"2024-04-17T05:26:57.295730+0000","last_became_peered":"2024-04-17T05:26:57.295730+0000","last_unstale":"2024-04-17T05:29:30.363424+0000","last_undegraded":"2024-04-17T05:29:30.363424+0000","last_fullsized":"2024-04-17T05:29:30.363424+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:47:55.696215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'3","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:47.532063+0000","last_change":"2024-04-17T05:26:52.214520+0000","last_active":"2024-04-17T05:29:47.532063+0000","last_peered":"2024-04-17T05:29:47.532063+0000","last_clean":"2024-04-17T05:29:47.532063+0000","last_became_active":"2024-04-17T05:26:52.214153+0000","last_became_peered":"2024-04-17T05:26:52.214153+0000","last_unstale":"2024-04-17T05:29:47.532063+0000","last_undegraded":"2024-04-17T05:29:47.532063+0000","last_fullsized":"2024-04-17T05:29:47.532063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:29:09.631143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'7","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.371493+0000","last_change":"2024-04-17T05:26:53.218086+0000","last_active":"2024-04-17T05:33:47.371493+0000","last_peered":"2024-04-17T05:33:47.371493+0000","last_clean":"2024-04-17T05:33:47.371493+0000","last_became_active":"2024-04-17T05:26:53.213566+0000","last_became_peered":"2024-04-17T05:26:53.213566+0000","last_unstale":"2024-04-17T05:33:47.371493+0000","last_undegraded":"2024-04-17T05:33:47.371493+0000","last_fullsized":"2024-04-17T05:33:47.371493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:29.459313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:30.363303+0000","last_change":"2024-04-17T05:26:57.306742+0000","last_active":"2024-04-17T05:29:30.363303+0000","last_peered":"2024-04-17T05:29:30.363303+0000","last_clean":"2024-04-17T05:29:30.363303+0000","last_became_active":"2024-04-17T05:26:57.305115+0000","last_became_peered":"2024-04-17T05:26:57.305115+0000","last_unstale":"2024-04-17T05:29:30.363303+0000","last_undegraded":"2024-04-17T05:29:30.363303+0000","last_fullsized":"2024-04-17T05:29:30.363303+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:48:36.621042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.382150+0000","last_change":"2024-04-17T05:26:53.232255+0000","last_active":"2024-04-17T05:33:47.382150+0000","last_peered":"2024-04-17T05:33:47.382150+0000","last_clean":"2024-04-17T05:33:47.382150+0000","last_became_active":"2024-04-17T05:26:53.231624+0000","last_became_peered":"2024-04-17T05:26:53.231624+0000","last_unstale":"2024-04-17T05:33:47.382150+0000","last_undegraded":"2024-04-17T05:33:47.382150+0000","last_fullsized":"2024-04-17T05:33:47.382150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:27:51.120892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.392969+0000","last_change":"2024-04-17T05:26:53.222619+0000","last_active":"2024-04-17T05:33:47.392969+0000","last_peered":"2024-04-17T05:33:47.392969+0000","last_clean":"2024-04-17T05:33:47.392969+0000","last_became_active":"2024-04-17T05:26:53.222128+0000","last_became_peered":"2024-04-17T05:26:53.222128+0000","last_unstale":"2024-04-17T05:33:47.392969+0000","last_undegraded":"2024-04-17T05:33:47.392969+0000","last_fullsized":"2024-04-17T05:33:47.392969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:31.494213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.396844+0000","last_change":"2024-04-17T05:26:53.234820+0000","last_active":"2024-04-17T05:33:47.396844+0000","last_peered":"2024-04-17T05:33:47.396844+0000","last_clean":"2024-04-17T05:33:47.396844+0000","last_became_active":"2024-04-17T05:26:53.233708+0000","last_became_peered":"2024-04-17T05:26:53.233708+0000","last_unstale":"2024-04-17T05:33:47.396844+0000","last_undegraded":"2024-04-17T05:33:47.396844+0000","last_fullsized":"2024-04-17T05:33:47.396844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:08:16.322998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.372973+0000","last_change":"2024-04-17T05:26:53.234961+0000","last_active":"2024-04-17T05:33:47.372973+0000","last_peered":"2024-04-17T05:33:47.372973+0000","last_clean":"2024-04-17T05:33:47.372973+0000","last_became_active":"2024-04-17T05:26:53.234387+0000","last_became_peered":"2024-04-17T05:26:53.234387+0000","last_unstale":"2024-04-17T05:33:47.372973+0000","last_undegraded":"2024-04-17T05:33:47.372973+0000","last_fullsized":"2024-04-17T05:33:47.372973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:07:47.404346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.392306+0000","last_change":"2024-04-17T05:26:53.242359+0000","last_active":"2024-04-17T05:33:47.392306+0000","last_peered":"2024-04-17T05:33:47.392306+0000","last_clean":"2024-04-17T05:33:47.392306+0000","last_became_active":"2024-04-17T05:26:53.236476+0000","last_became_peered":"2024-04-17T05:26:53.236476+0000","last_unstale":"2024-04-17T05:33:47.392306+0000","last_undegraded":"2024-04-17T05:33:47.392306+0000","last_fullsized":"2024-04-17T05:33:47.392306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:08:16.322998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.374292+0000","last_change":"2024-04-17T05:26:53.231647+0000","last_active":"2024-04-17T05:33:47.374292+0000","last_peered":"2024-04-17T05:33:47.374292+0000","last_clean":"2024-04-17T05:33:47.374292+0000","last_became_active":"2024-04-17T05:26:53.231335+0000","last_became_peered":"2024-04-17T05:26:53.231335+0000","last_unstale":"2024-04-17T05:33:47.374292+0000","last_undegraded":"2024-04-17T05:33:47.374292+0000","last_fullsized":"2024-04-17T05:33:47.374292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:19:17.442103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"28'13","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.393123+0000","last_change":"2024-04-17T05:26:53.234892+0000","last_active":"2024-04-17T05:33:47.393123+0000","last_peered":"2024-04-17T05:33:47.393123+0000","last_clean":"2024-04-17T05:33:47.393123+0000","last_became_active":"2024-04-17T05:26:53.234582+0000","last_became_peered":"2024-04-17T05:26:53.234582+0000","last_unstale":"2024-04-17T05:33:47.393123+0000","last_undegraded":"2024-04-17T05:33:47.393123+0000","last_fullsized":"2024-04-17T05:33:47.393123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:48:56.352270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.391200+0000","last_change":"2024-04-17T05:26:53.245242+0000","last_active":"2024-04-17T05:33:47.391200+0000","last_peered":"2024-04-17T05:33:47.391200+0000","last_clean":"2024-04-17T05:33:47.391200+0000","last_became_active":"2024-04-17T05:26:53.244910+0000","last_became_peered":"2024-04-17T05:26:53.244910+0000","last_unstale":"2024-04-17T05:33:47.391200+0000","last_undegraded":"2024-04-17T05:33:47.391200+0000","last_fullsized":"2024-04-17T05:33:47.391200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:45:55.350158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'9","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.376735+0000","last_change":"2024-04-17T05:27:39.627151+0000","last_active":"2024-04-17T05:33:47.376735+0000","last_peered":"2024-04-17T05:33:47.376735+0000","last_clean":"2024-04-17T05:33:47.376735+0000","last_became_active":"2024-04-17T05:27:39.626252+0000","last_became_peered":"2024-04-17T05:27:39.626252+0000","last_unstale":"2024-04-17T05:33:47.376735+0000","last_undegraded":"2024-04-17T05:33:47.376735+0000","last_fullsized":"2024-04-17T05:33:47.376735+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:02:12.833146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.391575+0000","last_change":"2024-04-17T05:26:53.236750+0000","last_active":"2024-04-17T05:33:47.391575+0000","last_peered":"2024-04-17T05:33:47.391575+0000","last_clean":"2024-04-17T05:33:47.391575+0000","last_became_active":"2024-04-17T05:26:53.236386+0000","last_became_peered":"2024-04-17T05:26:53.236386+0000","last_unstale":"2024-04-17T05:33:47.391575+0000","last_undegraded":"2024-04-17T05:33:47.391575+0000","last_fullsized":"2024-04-17T05:33:47.391575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:19:17.442103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"28'13","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.397229+0000","last_change":"2024-04-17T05:26:53.242520+0000","last_active":"2024-04-17T05:33:47.397229+0000","last_peered":"2024-04-17T05:33:47.397229+0000","last_clean":"2024-04-17T05:33:47.397229+0000","last_became_active":"2024-04-17T05:26:53.242213+0000","last_became_peered":"2024-04-17T05:26:53.242213+0000","last_unstale":"2024-04-17T05:33:47.397229+0000","last_undegraded":"2024-04-17T05:33:47.397229+0000","last_fullsized":"2024-04-17T05:33:47.397229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:32.131344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"28'11","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.387905+0000","last_change":"2024-04-17T05:26:53.230464+0000","last_active":"2024-04-17T05:33:47.387905+0000","last_peered":"2024-04-17T05:33:47.387905+0000","last_clean":"2024-04-17T05:33:47.387905+0000","last_became_active":"2024-04-17T05:26:53.230146+0000","last_became_peered":"2024-04-17T05:26:53.230146+0000","last_unstale":"2024-04-17T05:33:47.387905+0000","last_undegraded":"2024-04-17T05:33:47.387905+0000","last_fullsized":"2024-04-17T05:33:47.387905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:20:19.035658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.388426+0000","last_change":"2024-04-17T05:26:53.252592+0000","last_active":"2024-04-17T05:33:47.388426+0000","last_peered":"2024-04-17T05:33:47.388426+0000","last_clean":"2024-04-17T05:33:47.388426+0000","last_became_active":"2024-04-17T05:26:53.252280+0000","last_became_peered":"2024-04-17T05:26:53.252280+0000","last_unstale":"2024-04-17T05:33:47.388426+0000","last_undegraded":"2024-04-17T05:33:47.388426+0000","last_fullsized":"2024-04-17T05:33:47.388426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:47:18.182576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.387703+0000","last_change":"2024-04-17T05:26:53.242405+0000","last_active":"2024-04-17T05:33:47.387703+0000","last_peered":"2024-04-17T05:33:47.387703+0000","last_clean":"2024-04-17T05:33:47.387703+0000","last_became_active":"2024-04-17T05:26:53.242046+0000","last_became_peered":"2024-04-17T05:26:53.242046+0000","last_unstale":"2024-04-17T05:33:47.387703+0000","last_undegraded":"2024-04-17T05:33:47.387703+0000","last_fullsized":"2024-04-17T05:33:47.387703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:25:09.244149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"28'12","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.381814+0000","last_change":"2024-04-17T05:26:53.228029+0000","last_active":"2024-04-17T05:33:47.381814+0000","last_peered":"2024-04-17T05:33:47.381814+0000","last_clean":"2024-04-17T05:33:47.381814+0000","last_became_active":"2024-04-17T05:26:53.227572+0000","last_became_peered":"2024-04-17T05:26:53.227572+0000","last_unstale":"2024-04-17T05:33:47.381814+0000","last_undegraded":"2024-04-17T05:33:47.381814+0000","last_fullsized":"2024-04-17T05:33:47.381814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:27.032116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.395644+0000","last_change":"2024-04-17T05:26:53.226283+0000","last_active":"2024-04-17T05:33:47.395644+0000","last_peered":"2024-04-17T05:33:47.395644+0000","last_clean":"2024-04-17T05:33:47.395644+0000","last_became_active":"2024-04-17T05:26:53.225983+0000","last_became_peered":"2024-04-17T05:26:53.225983+0000","last_unstale":"2024-04-17T05:33:47.395644+0000","last_undegraded":"2024-04-17T05:33:47.395644+0000","last_fullsized":"2024-04-17T05:33:47.395644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:40:51.044161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"28'11","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.397095+0000","last_change":"2024-04-17T05:26:53.230256+0000","last_active":"2024-04-17T05:33:47.397095+0000","last_peered":"2024-04-17T05:33:47.397095+0000","last_clean":"2024-04-17T05:33:47.397095+0000","last_became_active":"2024-04-17T05:26:53.229888+0000","last_became_peered":"2024-04-17T05:26:53.229888+0000","last_unstale":"2024-04-17T05:33:47.397095+0000","last_undegraded":"2024-04-17T05:33:47.397095+0000","last_fullsized":"2024-04-17T05:33:47.397095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:45:55.350158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.383533+0000","last_change":"2024-04-17T05:26:53.211199+0000","last_active":"2024-04-17T05:33:47.383533+0000","last_peered":"2024-04-17T05:33:47.383533+0000","last_clean":"2024-04-17T05:33:47.383533+0000","last_became_active":"2024-04-17T05:26:53.208394+0000","last_became_peered":"2024-04-17T05:26:53.208394+0000","last_unstale":"2024-04-17T05:33:47.383533+0000","last_undegraded":"2024-04-17T05:33:47.383533+0000","last_fullsized":"2024-04-17T05:33:47.383533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:20:19.035658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"28'5","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.375609+0000","last_change":"2024-04-17T05:26:53.224930+0000","last_active":"2024-04-17T05:33:47.375609+0000","last_peered":"2024-04-17T05:33:47.375609+0000","last_clean":"2024-04-17T05:33:47.375609+0000","last_became_active":"2024-04-17T05:26:53.224314+0000","last_became_peered":"2024-04-17T05:26:53.224314+0000","last_unstale":"2024-04-17T05:33:47.375609+0000","last_undegraded":"2024-04-17T05:33:47.375609+0000","last_fullsized":"2024-04-17T05:33:47.375609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:00:05.875990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"28'10","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.379525+0000","last_change":"2024-04-17T05:26:53.234152+0000","last_active":"2024-04-17T05:33:47.379525+0000","last_peered":"2024-04-17T05:33:47.379525+0000","last_clean":"2024-04-17T05:33:47.379525+0000","last_became_active":"2024-04-17T05:26:53.233885+0000","last_became_peered":"2024-04-17T05:26:53.233885+0000","last_unstale":"2024-04-17T05:33:47.379525+0000","last_undegraded":"2024-04-17T05:33:47.379525+0000","last_fullsized":"2024-04-17T05:33:47.379525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:20:19.035658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.388203+0000","last_change":"2024-04-17T05:26:53.233213+0000","last_active":"2024-04-17T05:33:47.388203+0000","last_peered":"2024-04-17T05:33:47.388203+0000","last_clean":"2024-04-17T05:33:47.388203+0000","last_became_active":"2024-04-17T05:26:53.232809+0000","last_became_peered":"2024-04-17T05:26:53.232809+0000","last_unstale":"2024-04-17T05:33:47.388203+0000","last_undegraded":"2024-04-17T05:33:47.388203+0000","last_fullsized":"2024-04-17T05:33:47.388203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:44.057838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.384785+0000","last_change":"2024-04-17T05:26:53.245453+0000","last_active":"2024-04-17T05:33:47.384785+0000","last_peered":"2024-04-17T05:33:47.384785+0000","last_clean":"2024-04-17T05:33:47.384785+0000","last_became_active":"2024-04-17T05:26:53.245051+0000","last_became_peered":"2024-04-17T05:26:53.245051+0000","last_unstale":"2024-04-17T05:33:47.384785+0000","last_undegraded":"2024-04-17T05:33:47.384785+0000","last_fullsized":"2024-04-17T05:33:47.384785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:44:40.424363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"28'16","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.397336+0000","last_change":"2024-04-17T05:26:53.241934+0000","last_active":"2024-04-17T05:33:47.397336+0000","last_peered":"2024-04-17T05:33:47.397336+0000","last_clean":"2024-04-17T05:33:47.397336+0000","last_became_active":"2024-04-17T05:26:53.241108+0000","last_became_peered":"2024-04-17T05:26:53.241108+0000","last_unstale":"2024-04-17T05:33:47.397336+0000","last_undegraded":"2024-04-17T05:33:47.397336+0000","last_fullsized":"2024-04-17T05:33:47.397336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:53:43.076144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"28'9","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.364950+0000","last_change":"2024-04-17T05:27:39.898458+0000","last_active":"2024-04-17T05:33:47.364950+0000","last_peered":"2024-04-17T05:33:47.364950+0000","last_clean":"2024-04-17T05:33:47.364950+0000","last_became_active":"2024-04-17T05:27:39.897830+0000","last_became_peered":"2024-04-17T05:27:39.897830+0000","last_unstale":"2024-04-17T05:33:47.364950+0000","last_undegraded":"2024-04-17T05:33:47.364950+0000","last_fullsized":"2024-04-17T05:33:47.364950+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:15:26.293817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.394853+0000","last_change":"2024-04-17T05:26:53.244109+0000","last_active":"2024-04-17T05:33:47.394853+0000","last_peered":"2024-04-17T05:33:47.394853+0000","last_clean":"2024-04-17T05:33:47.394853+0000","last_became_active":"2024-04-17T05:26:53.243625+0000","last_became_peered":"2024-04-17T05:26:53.243625+0000","last_unstale":"2024-04-17T05:33:47.394853+0000","last_undegraded":"2024-04-17T05:33:47.394853+0000","last_fullsized":"2024-04-17T05:33:47.394853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:07:47.404346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"28'5","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.383931+0000","last_change":"2024-04-17T05:26:53.246489+0000","last_active":"2024-04-17T05:33:47.383931+0000","last_peered":"2024-04-17T05:33:47.383931+0000","last_clean":"2024-04-17T05:33:47.383931+0000","last_became_active":"2024-04-17T05:26:53.246286+0000","last_became_peered":"2024-04-17T05:26:53.246286+0000","last_unstale":"2024-04-17T05:33:47.383931+0000","last_undegraded":"2024-04-17T05:33:47.383931+0000","last_fullsized":"2024-04-17T05:33:47.383931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:45.658070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'5","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.396608+0000","last_change":"2024-04-17T05:26:53.229115+0000","last_active":"2024-04-17T05:33:47.396608+0000","last_peered":"2024-04-17T05:33:47.396608+0000","last_clean":"2024-04-17T05:33:47.396608+0000","last_became_active":"2024-04-17T05:26:53.228706+0000","last_became_peered":"2024-04-17T05:26:53.228706+0000","last_unstale":"2024-04-17T05:33:47.396608+0000","last_undegraded":"2024-04-17T05:33:47.396608+0000","last_fullsized":"2024-04-17T05:33:47.396608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:19:17.442103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.385791+0000","last_change":"2024-04-17T05:26:53.244961+0000","last_active":"2024-04-17T05:33:47.385791+0000","last_peered":"2024-04-17T05:33:47.385791+0000","last_clean":"2024-04-17T05:33:47.385791+0000","last_became_active":"2024-04-17T05:26:53.244595+0000","last_became_peered":"2024-04-17T05:26:53.244595+0000","last_unstale":"2024-04-17T05:33:47.385791+0000","last_undegraded":"2024-04-17T05:33:47.385791+0000","last_fullsized":"2024-04-17T05:33:47.385791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:13:34.455173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.392806+0000","last_change":"2024-04-17T05:26:53.241645+0000","last_active":"2024-04-17T05:33:47.392806+0000","last_peered":"2024-04-17T05:33:47.392806+0000","last_clean":"2024-04-17T05:33:47.392806+0000","last_became_active":"2024-04-17T05:26:53.241292+0000","last_became_peered":"2024-04-17T05:26:53.241292+0000","last_unstale":"2024-04-17T05:33:47.392806+0000","last_undegraded":"2024-04-17T05:33:47.392806+0000","last_fullsized":"2024-04-17T05:33:47.392806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:31:26.820940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.376112+0000","last_change":"2024-04-17T05:26:53.221256+0000","last_active":"2024-04-17T05:33:47.376112+0000","last_peered":"2024-04-17T05:33:47.376112+0000","last_clean":"2024-04-17T05:33:47.376112+0000","last_became_active":"2024-04-17T05:26:53.220445+0000","last_became_peered":"2024-04-17T05:26:53.220445+0000","last_unstale":"2024-04-17T05:33:47.376112+0000","last_undegraded":"2024-04-17T05:33:47.376112+0000","last_fullsized":"2024-04-17T05:33:47.376112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:08:41.870139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'4","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.375073+0000","last_change":"2024-04-17T05:26:53.214897+0000","last_active":"2024-04-17T05:33:47.375073+0000","last_peered":"2024-04-17T05:33:47.375073+0000","last_clean":"2024-04-17T05:33:47.375073+0000","last_became_active":"2024-04-17T05:26:53.214591+0000","last_became_peered":"2024-04-17T05:26:53.214591+0000","last_unstale":"2024-04-17T05:33:47.375073+0000","last_undegraded":"2024-04-17T05:33:47.375073+0000","last_fullsized":"2024-04-17T05:33:47.375073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:32.131344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"28'10","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.390013+0000","last_change":"2024-04-17T05:26:53.248726+0000","last_active":"2024-04-17T05:33:47.390013+0000","last_peered":"2024-04-17T05:33:47.390013+0000","last_clean":"2024-04-17T05:33:47.390013+0000","last_became_active":"2024-04-17T05:26:53.248143+0000","last_became_peered":"2024-04-17T05:26:53.248143+0000","last_unstale":"2024-04-17T05:33:47.390013+0000","last_undegraded":"2024-04-17T05:33:47.390013+0000","last_fullsized":"2024-04-17T05:33:47.390013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:02:51.306764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":945903,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":397,"num_write_kb":1123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1949696,"data_stored":1891806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":388,"ondisk_log_size":388,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542233,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":897024,"data_stored":713306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542232,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28228,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343612,"statfs":{"total":96636764160,"available":96607858688,"internally_reserved":0,"allocated":1241088,"data_stored":1056638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542233,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":122446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542232,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":122482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542234,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1253376,"data_stored":1067461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542232,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":133179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542233,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":122516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542232,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":905216,"data_stored":713362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":10823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":954368,"data_stored":945105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":942080,"data_stored":934282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T05:33:54.830 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-17T05:33:54.830 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T05:33:55.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.077+0000 7f13e8600640 1 Processor -- start 2024-04-17T05:33:55.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.078+0000 7f13e8600640 1 -- start start 2024-04-17T05:33:55.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.079+0000 7f13e8600640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f13e006dcc0 0x7f13e009c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:55.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.079+0000 7f13e8600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13e014bc60 0x7f13e0152810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:55.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.079+0000 7f13e8600640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e009d740 con 0x7f13e00b5a50 2024-04-17T05:33:55.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.079+0000 7f13e8600640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f13e00b5130 con 0x7f13e006dcc0 2024-04-17T05:33:55.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.079+0000 7f13e8600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f13e009d9b0 con 0x7f13e014bc60 2024-04-17T05:33:55.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.079+0000 7f13e5200640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f13e00b5a50 0x7f13e014b550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59144/0 (socket says 172.21.15.123:59144) 2024-04-17T05:33:55.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.079+0000 7f13e5200640 1 -- 172.21.15.123:0/2192567624 learned_addr learned my addr 172.21.15.123:0/2192567624 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:33:55.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.079+0000 7f13e5c00640 1 --2- 172.21.15.123:0/2192567624 >> v2:172.21.15.164:3300/0 conn(0x7f13e006dcc0 0x7f13e009c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:55.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.080+0000 7f13e6600640 1 --2- 172.21.15.123:0/2192567624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13e014bc60 0x7f13e0152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:55.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.080+0000 7f13dfe00640 1 -- 172.21.15.123:0/2192567624 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1357883878 0 0) 0x7f13e009d740 con 0x7f13e00b5a50 2024-04-17T05:33:55.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.080+0000 7f13dfe00640 1 -- 172.21.15.123:0/2192567624 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13c8003520 con 0x7f13e00b5a50 2024-04-17T05:33:55.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.080+0000 7f13dfe00640 1 -- 172.21.15.123:0/2192567624 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 712924158 0 0) 0x7f13c8003520 con 0x7f13e00b5a50 2024-04-17T05:33:55.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.080+0000 7f13dfe00640 1 -- 172.21.15.123:0/2192567624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13e014bc60 msgr2=0x7f13e0152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:55.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.080+0000 7f13dfe00640 1 --2- 172.21.15.123:0/2192567624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13e014bc60 0x7f13e0152810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:55.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.080+0000 7f13dfe00640 1 -- 172.21.15.123:0/2192567624 >> v2:172.21.15.164:3300/0 conn(0x7f13e006dcc0 msgr2=0x7f13e009c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:55.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.080+0000 7f13dfe00640 1 --2- 172.21.15.123:0/2192567624 >> v2:172.21.15.164:3300/0 conn(0x7f13e006dcc0 0x7f13e009c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:55.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.080+0000 7f13dfe00640 1 -- 172.21.15.123:0/2192567624 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e009e120 con 0x7f13e00b5a50 2024-04-17T05:33:55.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.080+0000 7f13dfe00640 1 -- 172.21.15.123:0/2192567624 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1042962670 0 0) 0x7f13cc001670 con 0x7f13e00b5a50 2024-04-17T05:33:55.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.080+0000 7f13dfe00640 1 -- 172.21.15.123:0/2192567624 >> v1:172.21.15.123:6789/0 conn(0x7f13e00b5a50 legacy=0x7f13e014b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:55.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.080+0000 7f13dfe00640 1 --2- 172.21.15.123:0/2192567624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13e014bc60 0x7f13c80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:55.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.080+0000 7f13dfe00640 1 --2- 172.21.15.123:0/2192567624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13c8003f80 0x7f13c8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:55.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.080+0000 7f13dfe00640 1 --2- 172.21.15.123:0/2192567624 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13c8004d40 0x7f13c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:55.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.080+0000 7f13dfe00640 1 -- 172.21.15.123:0/2192567624 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f13e00b5130 con 0x7f13c8003f80 2024-04-17T05:33:55.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.080+0000 7f13dfe00640 1 -- 172.21.15.123:0/2192567624 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f13e009d9b0 con 0x7f13c8004d40 2024-04-17T05:33:55.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.080+0000 7f13dfe00640 1 -- 172.21.15.123:0/2192567624 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f13c800b9c0 con 0x7f13e014bc60 2024-04-17T05:33:55.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.081+0000 7f13e5200640 1 --2- 172.21.15.123:0/2192567624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13c8003f80 0x7f13c8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:55.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.081+0000 7f13e5c00640 1 --2- 172.21.15.123:0/2192567624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13e014bc60 0x7f13c80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:55.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.081+0000 7f13e6600640 1 --2- 172.21.15.123:0/2192567624 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13c8004d40 0x7f13c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:55.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.081+0000 7f13e5200640 1 -- 172.21.15.123:0/2192567624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13e014bc60 msgr2=0x7f13c80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:55.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.081+0000 7f13e5200640 1 --2- 172.21.15.123:0/2192567624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13e014bc60 0x7f13c80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:55.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.081+0000 7f13e5200640 1 -- 172.21.15.123:0/2192567624 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13c8004d40 msgr2=0x7f13c80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:55.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.081+0000 7f13e5200640 1 --2- 172.21.15.123:0/2192567624 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13c8004d40 0x7f13c80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:55.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.081+0000 7f13e5200640 1 -- 172.21.15.123:0/2192567624 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c8003520 con 0x7f13c8003f80 2024-04-17T05:33:55.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.082+0000 7f13e5200640 1 --2- 172.21.15.123:0/2192567624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13c8003f80 0x7f13c8004800 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f13cc00c190 tx=0x7f13c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11e67c889e5a2cf8 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:55.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.082+0000 7f13dfe00640 1 -- 172.21.15.123:0/2192567624 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13cc007c80 con 0x7f13c8003f80 2024-04-17T05:33:55.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.082+0000 7f13dfe00640 1 -- 172.21.15.123:0/2192567624 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13cc030070 con 0x7f13c8003f80 2024-04-17T05:33:55.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.082+0000 7f13dfe00640 1 -- 172.21.15.123:0/2192567624 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13cc005d70 con 0x7f13c8003f80 2024-04-17T05:33:55.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.083+0000 7f13e8600640 1 -- 172.21.15.123:0/2192567624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13c8003f80 msgr2=0x7f13c8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:55.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.083+0000 7f13e8600640 1 --2- 172.21.15.123:0/2192567624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13c8003f80 0x7f13c8004800 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f13cc00c190 tx=0x7f13c8005830 comp rx=0 tx=0).stop 2024-04-17T05:33:55.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.083+0000 7f13e6600640 1 -- 172.21.15.123:0/2192567624 reap_dead start 2024-04-17T05:33:55.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.083+0000 7f13e8600640 1 -- 172.21.15.123:0/2192567624 shutdown_connections 2024-04-17T05:33:55.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.083+0000 7f13e8600640 1 -- 172.21.15.123:0/2192567624 >> 172.21.15.123:0/2192567624 conn(0x7f13e00b93b0 msgr2=0x7f13e00b97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:55.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.083+0000 7f13e8600640 1 -- 172.21.15.123:0/2192567624 shutdown_connections 2024-04-17T05:33:55.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.083+0000 7f13e8600640 1 -- 172.21.15.123:0/2192567624 wait complete. 2024-04-17T05:33:55.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.085+0000 7f13e8600640 1 Processor -- start 2024-04-17T05:33:55.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.085+0000 7f13e8600640 1 -- start start 2024-04-17T05:33:55.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.086+0000 7f13e8600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13c8003f80 0x7f13e00ae3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:55.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.086+0000 7f13e8600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13e00b84f0 0x7f13e01de270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:55.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.086+0000 7f13e8600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13e0071fd0 0x7f13e0145030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:55.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.086+0000 7f13e8600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f13e009e3c0 con 0x7f13e0071fd0 2024-04-17T05:33:55.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.086+0000 7f13e8600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f13e009dc90 con 0x7f13e00b84f0 2024-04-17T05:33:55.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.086+0000 7f13e8600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f13e00b4dc0 con 0x7f13c8003f80 2024-04-17T05:33:55.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.086+0000 7f13e6600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13e0071fd0 0x7f13e0145030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:55.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.086+0000 7f13e6600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13e0071fd0 0x7f13e0145030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48942/0 (socket says 172.21.15.123:48942) 2024-04-17T05:33:55.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.086+0000 7f13e6600640 1 -- 172.21.15.123:0/2981660704 learned_addr learned my addr 172.21.15.123:0/2981660704 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:55.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.086+0000 7f13e5c00640 1 --2- 172.21.15.123:0/2981660704 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13c8003f80 0x7f13e00ae3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:55.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.086+0000 7f13e5200640 1 --2- 172.21.15.123:0/2981660704 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13e00b84f0 0x7f13e01de270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:55.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.087+0000 7f13e6600640 1 -- 172.21.15.123:0/2981660704 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13c8003f80 msgr2=0x7f13e00ae3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:55.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.087+0000 7f13e6600640 1 --2- 172.21.15.123:0/2981660704 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13c8003f80 0x7f13e00ae3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:55.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.087+0000 7f13e6600640 1 -- 172.21.15.123:0/2981660704 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13e00b84f0 msgr2=0x7f13e01de270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:55.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.087+0000 7f13e6600640 1 --2- 172.21.15.123:0/2981660704 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13e00b84f0 0x7f13e01de270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:55.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.087+0000 7f13e6600640 1 -- 172.21.15.123:0/2981660704 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e01dd7d0 con 0x7f13e0071fd0 2024-04-17T05:33:55.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.087+0000 7f13e5c00640 1 --2- 172.21.15.123:0/2981660704 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13c8003f80 0x7f13e00ae3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:33:55.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.087+0000 7f13e6600640 1 --2- 172.21.15.123:0/2981660704 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13e0071fd0 0x7f13e0145030 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f13d8007d10 tx=0x7f13d80115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:55.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.087+0000 7f13dd600640 1 -- 172.21.15.123:0/2981660704 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d8011e40 con 0x7f13e0071fd0 2024-04-17T05:33:55.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.087+0000 7f13dd600640 1 -- 172.21.15.123:0/2981660704 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d801b070 con 0x7f13e0071fd0 2024-04-17T05:33:55.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.087+0000 7f13dd600640 1 -- 172.21.15.123:0/2981660704 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d8003990 con 0x7f13e0071fd0 2024-04-17T05:33:55.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.087+0000 7f13e8600640 1 -- 172.21.15.123:0/2981660704 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13e00727e0 con 0x7f13e0071fd0 2024-04-17T05:33:55.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.087+0000 7f13e8600640 1 -- 172.21.15.123:0/2981660704 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13e01dda70 con 0x7f13e0071fd0 2024-04-17T05:33:55.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.089+0000 7f13e8600640 1 -- 172.21.15.123:0/2981660704 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13e0068a40 con 0x7f13e0071fd0 2024-04-17T05:33:55.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.089+0000 7f13dd600640 1 -- 172.21.15.123:0/2981660704 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f13d8005d10 con 0x7f13e0071fd0 2024-04-17T05:33:55.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.090+0000 7f13dd600640 1 --2- 172.21.15.123:0/2981660704 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f13c006c920 0x7f13c006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:55.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.090+0000 7f13dd600640 1 -- 172.21.15.123:0/2981660704 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f13d808c390 con 0x7f13e0071fd0 2024-04-17T05:33:55.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.091+0000 7f13e5c00640 1 --2- 172.21.15.123:0/2981660704 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f13c006c920 0x7f13c006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:55.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.092+0000 7f13e5c00640 1 --2- 172.21.15.123:0/2981660704 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f13c006c920 0x7f13c006ede0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f13d4009a00 tx=0x7f13d4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:55.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.095+0000 7f13dd600640 1 -- 172.21.15.123:0/2981660704 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f13d8025020 con 0x7f13e0071fd0 2024-04-17T05:33:55.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.291+0000 7f13e8600640 1 -- 172.21.15.123:0/2981660704 --> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f13e00b88d0 con 0x7f13c006c920 2024-04-17T05:33:55.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.315+0000 7f13dd600640 1 -- 172.21.15.123:0/2981660704 <== mgr.4103 v2:172.21.15.164:6832/4204006015 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332872 (secure 0 0 0) 0x7f13e00b88d0 con 0x7f13c006c920 2024-04-17T05:33:55.319 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:33:55.320 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-04-17T05:33:55.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.321+0000 7f13e8600640 1 -- 172.21.15.123:0/2981660704 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f13c006c920 msgr2=0x7f13c006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:55.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.321+0000 7f13e8600640 1 --2- 172.21.15.123:0/2981660704 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f13c006c920 0x7f13c006ede0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f13d4009a00 tx=0x7f13d4008040 comp rx=0 tx=0).stop 2024-04-17T05:33:55.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.321+0000 7f13e8600640 1 -- 172.21.15.123:0/2981660704 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13e0071fd0 msgr2=0x7f13e0145030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:55.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.321+0000 7f13e8600640 1 --2- 172.21.15.123:0/2981660704 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13e0071fd0 0x7f13e0145030 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f13d8007d10 tx=0x7f13d80115a0 comp rx=0 tx=0).stop 2024-04-17T05:33:55.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.321+0000 7f13e8600640 1 -- 172.21.15.123:0/2981660704 shutdown_connections 2024-04-17T05:33:55.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.321+0000 7f13e8600640 1 --2- 172.21.15.123:0/2981660704 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13e0071fd0 0x7f13e0145030 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:55.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.321+0000 7f13e8600640 1 --2- 172.21.15.123:0/2981660704 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13e00b84f0 0x7f13e01de270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:55.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.321+0000 7f13e8600640 1 --2- 172.21.15.123:0/2981660704 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f13c006c920 0x7f13c006ede0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:55.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.321+0000 7f13e8600640 1 --2- 172.21.15.123:0/2981660704 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13c8003f80 0x7f13e00ae3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:55.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.321+0000 7f13e8600640 1 -- 172.21.15.123:0/2981660704 >> 172.21.15.123:0/2981660704 conn(0x7f13e00b93b0 msgr2=0x7f13e0146d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:55.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.322+0000 7f13e8600640 1 -- 172.21.15.123:0/2981660704 shutdown_connections 2024-04-17T05:33:55.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.322+0000 7f13e8600640 1 -- 172.21.15.123:0/2981660704 wait complete. 2024-04-17T05:33:55.342 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2024-04-17T05:33:54.479992+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1536271,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":152,"num_read_kb":136,"num_write":562,"num_write_kb":3543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1014,"ondisk_log_size":1014,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225688,"kb_used_data":5400,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749032,"statfs":{"total":773094113280,"available":772863008768,"internally_reserved":0,"allocated":5529600,"data_stored":4051390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":83,"apply_latency_ms":83,"commit_latency_ns":83000000,"apply_latency_ns":83000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14151,"num_objects":-1,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":24,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004775"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:05.380186+0000","last_change":"2024-04-17T05:26:52.205802+0000","last_active":"2024-04-17T05:31:05.380186+0000","last_peered":"2024-04-17T05:31:05.380186+0000","last_clean":"2024-04-17T05:31:05.380186+0000","last_became_active":"2024-04-17T05:26:52.205459+0000","last_became_peered":"2024-04-17T05:26:52.205459+0000","last_unstale":"2024-04-17T05:31:05.380186+0000","last_undegraded":"2024-04-17T05:31:05.380186+0000","last_fullsized":"2024-04-17T05:31:05.380186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:12:06.528342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.381240+0000","last_change":"2024-04-17T05:26:53.231441+0000","last_active":"2024-04-17T05:33:47.381240+0000","last_peered":"2024-04-17T05:33:47.381240+0000","last_clean":"2024-04-17T05:33:47.381240+0000","last_became_active":"2024-04-17T05:26:53.231139+0000","last_became_peered":"2024-04-17T05:26:53.231139+0000","last_unstale":"2024-04-17T05:33:47.381240+0000","last_undegraded":"2024-04-17T05:33:47.381240+0000","last_fullsized":"2024-04-17T05:33:47.381240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:38:13.010763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:25.362764+0000","last_change":"2024-04-17T05:26:57.347742+0000","last_active":"2024-04-17T05:29:25.362764+0000","last_peered":"2024-04-17T05:29:25.362764+0000","last_clean":"2024-04-17T05:29:25.362764+0000","last_became_active":"2024-04-17T05:26:57.347333+0000","last_became_peered":"2024-04-17T05:26:57.347333+0000","last_unstale":"2024-04-17T05:29:25.362764+0000","last_undegraded":"2024-04-17T05:29:25.362764+0000","last_fullsized":"2024-04-17T05:29:25.362764+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:23:44.724644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:55.377844+0000","last_change":"2024-04-17T05:26:52.203448+0000","last_active":"2024-04-17T05:30:55.377844+0000","last_peered":"2024-04-17T05:30:55.377844+0000","last_clean":"2024-04-17T05:30:55.377844+0000","last_became_active":"2024-04-17T05:26:52.203161+0000","last_became_peered":"2024-04-17T05:26:52.203161+0000","last_unstale":"2024-04-17T05:30:55.377844+0000","last_undegraded":"2024-04-17T05:30:55.377844+0000","last_fullsized":"2024-04-17T05:30:55.377844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:11:26.292397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.396658+0000","last_change":"2024-04-17T05:26:53.241735+0000","last_active":"2024-04-17T05:33:47.396658+0000","last_peered":"2024-04-17T05:33:47.396658+0000","last_clean":"2024-04-17T05:33:47.396658+0000","last_became_active":"2024-04-17T05:26:53.241460+0000","last_became_peered":"2024-04-17T05:26:53.241460+0000","last_unstale":"2024-04-17T05:33:47.396658+0000","last_undegraded":"2024-04-17T05:33:47.396658+0000","last_fullsized":"2024-04-17T05:33:47.396658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:32.131344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:25.360061+0000","last_change":"2024-04-17T05:26:57.310052+0000","last_active":"2024-04-17T05:29:25.360061+0000","last_peered":"2024-04-17T05:29:25.360061+0000","last_clean":"2024-04-17T05:29:25.360061+0000","last_became_active":"2024-04-17T05:26:57.309057+0000","last_became_peered":"2024-04-17T05:26:57.309057+0000","last_unstale":"2024-04-17T05:29:25.360061+0000","last_undegraded":"2024-04-17T05:29:25.360061+0000","last_fullsized":"2024-04-17T05:29:25.360061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:32:29.420749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'6","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:42.521017+0000","last_change":"2024-04-17T05:26:52.217413+0000","last_active":"2024-04-17T05:29:42.521017+0000","last_peered":"2024-04-17T05:29:42.521017+0000","last_clean":"2024-04-17T05:29:42.521017+0000","last_became_active":"2024-04-17T05:26:52.217101+0000","last_became_peered":"2024-04-17T05:26:52.217101+0000","last_unstale":"2024-04-17T05:29:42.521017+0000","last_undegraded":"2024-04-17T05:29:42.521017+0000","last_fullsized":"2024-04-17T05:29:42.521017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:39:51.930934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'8","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.393645+0000","last_change":"2024-04-17T05:26:53.219012+0000","last_active":"2024-04-17T05:33:47.393645+0000","last_peered":"2024-04-17T05:33:47.393645+0000","last_clean":"2024-04-17T05:33:47.393645+0000","last_became_active":"2024-04-17T05:26:53.216591+0000","last_became_peered":"2024-04-17T05:26:53.216591+0000","last_unstale":"2024-04-17T05:33:47.393645+0000","last_undegraded":"2024-04-17T05:33:47.393645+0000","last_fullsized":"2024-04-17T05:33:47.393645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:02:12.833146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:30.361050+0000","last_change":"2024-04-17T05:26:57.310537+0000","last_active":"2024-04-17T05:29:30.361050+0000","last_peered":"2024-04-17T05:29:30.361050+0000","last_clean":"2024-04-17T05:29:30.361050+0000","last_became_active":"2024-04-17T05:26:57.309381+0000","last_became_peered":"2024-04-17T05:26:57.309381+0000","last_unstale":"2024-04-17T05:29:30.361050+0000","last_undegraded":"2024-04-17T05:29:30.361050+0000","last_fullsized":"2024-04-17T05:29:30.361050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:38:17.093545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'5","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:55.432886+0000","last_change":"2024-04-17T05:26:52.218309+0000","last_active":"2024-04-17T05:31:55.432886+0000","last_peered":"2024-04-17T05:31:55.432886+0000","last_clean":"2024-04-17T05:31:55.432886+0000","last_became_active":"2024-04-17T05:26:52.217898+0000","last_became_peered":"2024-04-17T05:26:52.217898+0000","last_unstale":"2024-04-17T05:31:55.432886+0000","last_undegraded":"2024-04-17T05:31:55.432886+0000","last_fullsized":"2024-04-17T05:31:55.432886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:16:02.152039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'14","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.396662+0000","last_change":"2024-04-17T05:26:53.232546+0000","last_active":"2024-04-17T05:33:47.396662+0000","last_peered":"2024-04-17T05:33:47.396662+0000","last_clean":"2024-04-17T05:33:47.396662+0000","last_became_active":"2024-04-17T05:26:53.232239+0000","last_became_peered":"2024-04-17T05:26:53.232239+0000","last_unstale":"2024-04-17T05:33:47.396662+0000","last_undegraded":"2024-04-17T05:33:47.396662+0000","last_fullsized":"2024-04-17T05:33:47.396662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:38:13.010763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:30.361003+0000","last_change":"2024-04-17T05:26:57.297256+0000","last_active":"2024-04-17T05:29:30.361003+0000","last_peered":"2024-04-17T05:29:30.361003+0000","last_clean":"2024-04-17T05:29:30.361003+0000","last_became_active":"2024-04-17T05:26:57.296757+0000","last_became_peered":"2024-04-17T05:26:57.296757+0000","last_unstale":"2024-04-17T05:29:30.361003+0000","last_undegraded":"2024-04-17T05:29:30.361003+0000","last_fullsized":"2024-04-17T05:29:30.361003+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:45:59.432940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.386895+0000","last_change":"2024-04-17T05:26:53.244539+0000","last_active":"2024-04-17T05:33:47.386895+0000","last_peered":"2024-04-17T05:33:47.386895+0000","last_clean":"2024-04-17T05:33:47.386895+0000","last_became_active":"2024-04-17T05:26:53.244104+0000","last_became_peered":"2024-04-17T05:26:53.244104+0000","last_unstale":"2024-04-17T05:33:47.386895+0000","last_undegraded":"2024-04-17T05:33:47.386895+0000","last_fullsized":"2024-04-17T05:33:47.386895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:41:48.514881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'8","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:25.427323+0000","last_change":"2024-04-17T05:26:52.214434+0000","last_active":"2024-04-17T05:31:25.427323+0000","last_peered":"2024-04-17T05:31:25.427323+0000","last_clean":"2024-04-17T05:31:25.427323+0000","last_became_active":"2024-04-17T05:26:52.214158+0000","last_became_peered":"2024-04-17T05:26:52.214158+0000","last_unstale":"2024-04-17T05:31:25.427323+0000","last_undegraded":"2024-04-17T05:31:25.427323+0000","last_fullsized":"2024-04-17T05:31:25.427323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:36:56.201576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:30.379674+0000","last_change":"2024-04-17T05:26:57.307151+0000","last_active":"2024-04-17T05:31:30.379674+0000","last_peered":"2024-04-17T05:31:30.379674+0000","last_clean":"2024-04-17T05:31:30.379674+0000","last_became_active":"2024-04-17T05:26:57.305676+0000","last_became_peered":"2024-04-17T05:26:57.305676+0000","last_unstale":"2024-04-17T05:31:30.379674+0000","last_undegraded":"2024-04-17T05:31:30.379674+0000","last_fullsized":"2024-04-17T05:31:30.379674+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:40:55.126943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.377372+0000","last_change":"2024-04-17T05:26:53.230514+0000","last_active":"2024-04-17T05:33:47.377372+0000","last_peered":"2024-04-17T05:33:47.377372+0000","last_clean":"2024-04-17T05:33:47.377372+0000","last_became_active":"2024-04-17T05:26:53.230175+0000","last_became_peered":"2024-04-17T05:26:53.230175+0000","last_unstale":"2024-04-17T05:33:47.377372+0000","last_undegraded":"2024-04-17T05:33:47.377372+0000","last_fullsized":"2024-04-17T05:33:47.377372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:32.131344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:15.387164+0000","last_change":"2024-04-17T05:26:52.207664+0000","last_active":"2024-04-17T05:31:15.387164+0000","last_peered":"2024-04-17T05:31:15.387164+0000","last_clean":"2024-04-17T05:31:15.387164+0000","last_became_active":"2024-04-17T05:26:52.207343+0000","last_became_peered":"2024-04-17T05:26:52.207343+0000","last_unstale":"2024-04-17T05:31:15.387164+0000","last_undegraded":"2024-04-17T05:31:15.387164+0000","last_fullsized":"2024-04-17T05:31:15.387164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:05:28.743450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:30.379630+0000","last_change":"2024-04-17T05:26:57.311205+0000","last_active":"2024-04-17T05:31:30.379630+0000","last_peered":"2024-04-17T05:31:30.379630+0000","last_clean":"2024-04-17T05:31:30.379630+0000","last_became_active":"2024-04-17T05:26:57.310038+0000","last_became_peered":"2024-04-17T05:26:57.310038+0000","last_unstale":"2024-04-17T05:31:30.379630+0000","last_undegraded":"2024-04-17T05:31:30.379630+0000","last_fullsized":"2024-04-17T05:31:30.379630+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:02:16.915928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'6","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.369668+0000","last_change":"2024-04-17T05:27:39.897206+0000","last_active":"2024-04-17T05:33:47.369668+0000","last_peered":"2024-04-17T05:33:47.369668+0000","last_clean":"2024-04-17T05:33:47.369668+0000","last_became_active":"2024-04-17T05:27:39.896306+0000","last_became_peered":"2024-04-17T05:27:39.896306+0000","last_unstale":"2024-04-17T05:33:47.369668+0000","last_undegraded":"2024-04-17T05:33:47.369668+0000","last_fullsized":"2024-04-17T05:33:47.369668+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:40:51.044161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:15.387119+0000","last_change":"2024-04-17T05:26:52.207557+0000","last_active":"2024-04-17T05:31:15.387119+0000","last_peered":"2024-04-17T05:31:15.387119+0000","last_clean":"2024-04-17T05:31:15.387119+0000","last_became_active":"2024-04-17T05:26:52.207019+0000","last_became_peered":"2024-04-17T05:26:52.207019+0000","last_unstale":"2024-04-17T05:31:15.387119+0000","last_undegraded":"2024-04-17T05:31:15.387119+0000","last_fullsized":"2024-04-17T05:31:15.387119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:43.039139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:30.389826+0000","last_change":"2024-04-17T05:26:57.345734+0000","last_active":"2024-04-17T05:31:30.389826+0000","last_peered":"2024-04-17T05:31:30.389826+0000","last_clean":"2024-04-17T05:31:30.389826+0000","last_became_active":"2024-04-17T05:26:57.345300+0000","last_became_peered":"2024-04-17T05:26:57.345300+0000","last_unstale":"2024-04-17T05:31:30.389826+0000","last_undegraded":"2024-04-17T05:31:30.389826+0000","last_fullsized":"2024-04-17T05:31:30.389826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:45:07.123915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"28'3","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.385628+0000","last_change":"2024-04-17T05:26:53.218687+0000","last_active":"2024-04-17T05:33:47.385628+0000","last_peered":"2024-04-17T05:33:47.385628+0000","last_clean":"2024-04-17T05:33:47.385628+0000","last_became_active":"2024-04-17T05:26:53.218355+0000","last_became_peered":"2024-04-17T05:26:53.218355+0000","last_unstale":"2024-04-17T05:33:47.385628+0000","last_undegraded":"2024-04-17T05:33:47.385628+0000","last_fullsized":"2024-04-17T05:33:47.385628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:05:29.762149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:15.425628+0000","last_change":"2024-04-17T05:26:52.214868+0000","last_active":"2024-04-17T05:31:15.425628+0000","last_peered":"2024-04-17T05:31:15.425628+0000","last_clean":"2024-04-17T05:31:15.425628+0000","last_became_active":"2024-04-17T05:26:52.214633+0000","last_became_peered":"2024-04-17T05:26:52.214633+0000","last_unstale":"2024-04-17T05:31:15.425628+0000","last_undegraded":"2024-04-17T05:31:15.425628+0000","last_fullsized":"2024-04-17T05:31:15.425628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:10:33.072665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:30.379693+0000","last_change":"2024-04-17T05:26:57.309644+0000","last_active":"2024-04-17T05:31:30.379693+0000","last_peered":"2024-04-17T05:31:30.379693+0000","last_clean":"2024-04-17T05:31:30.379693+0000","last_became_active":"2024-04-17T05:26:57.309175+0000","last_became_peered":"2024-04-17T05:26:57.309175+0000","last_unstale":"2024-04-17T05:31:30.379693+0000","last_undegraded":"2024-04-17T05:31:30.379693+0000","last_fullsized":"2024-04-17T05:31:30.379693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:31:30.903722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.375868+0000","last_change":"2024-04-17T05:26:53.220368+0000","last_active":"2024-04-17T05:33:47.375868+0000","last_peered":"2024-04-17T05:33:47.375868+0000","last_clean":"2024-04-17T05:33:47.375868+0000","last_became_active":"2024-04-17T05:26:53.220068+0000","last_became_peered":"2024-04-17T05:26:53.220068+0000","last_unstale":"2024-04-17T05:33:47.375868+0000","last_undegraded":"2024-04-17T05:33:47.375868+0000","last_fullsized":"2024-04-17T05:33:47.375868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:04:57.213834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:15.414626+0000","last_change":"2024-04-17T05:26:52.215954+0000","last_active":"2024-04-17T05:31:15.414626+0000","last_peered":"2024-04-17T05:31:15.414626+0000","last_clean":"2024-04-17T05:31:15.414626+0000","last_became_active":"2024-04-17T05:26:52.215637+0000","last_became_peered":"2024-04-17T05:26:52.215637+0000","last_unstale":"2024-04-17T05:31:15.414626+0000","last_undegraded":"2024-04-17T05:31:15.414626+0000","last_fullsized":"2024-04-17T05:31:15.414626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:05:12.780620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:10.376588+0000","last_change":"2024-04-17T05:26:57.342654+0000","last_active":"2024-04-17T05:31:10.376588+0000","last_peered":"2024-04-17T05:31:10.376588+0000","last_clean":"2024-04-17T05:31:10.376588+0000","last_became_active":"2024-04-17T05:26:57.342205+0000","last_became_peered":"2024-04-17T05:26:57.342205+0000","last_unstale":"2024-04-17T05:31:10.376588+0000","last_undegraded":"2024-04-17T05:31:10.376588+0000","last_fullsized":"2024-04-17T05:31:10.376588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:08:20.405780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.381614+0000","last_change":"2024-04-17T05:26:53.238192+0000","last_active":"2024-04-17T05:33:47.381614+0000","last_peered":"2024-04-17T05:33:47.381614+0000","last_clean":"2024-04-17T05:33:47.381614+0000","last_became_active":"2024-04-17T05:26:53.237901+0000","last_became_peered":"2024-04-17T05:26:53.237901+0000","last_unstale":"2024-04-17T05:33:47.381614+0000","last_undegraded":"2024-04-17T05:33:47.381614+0000","last_fullsized":"2024-04-17T05:33:47.381614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:31:26.820940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'106","reported_seq":135,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:46.314246+0000","last_change":"2024-04-17T05:26:52.213337+0000","last_active":"2024-04-17T05:33:46.314246+0000","last_peered":"2024-04-17T05:33:46.314246+0000","last_clean":"2024-04-17T05:33:46.314246+0000","last_became_active":"2024-04-17T05:26:52.213091+0000","last_became_peered":"2024-04-17T05:26:52.213091+0000","last_unstale":"2024-04-17T05:33:46.314246+0000","last_undegraded":"2024-04-17T05:33:46.314246+0000","last_fullsized":"2024-04-17T05:33:46.314246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:26.013417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":210,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:00.378550+0000","last_change":"2024-04-17T05:26:57.342025+0000","last_active":"2024-04-17T05:31:00.378550+0000","last_peered":"2024-04-17T05:31:00.378550+0000","last_clean":"2024-04-17T05:31:00.378550+0000","last_became_active":"2024-04-17T05:26:57.341654+0000","last_became_peered":"2024-04-17T05:26:57.341654+0000","last_unstale":"2024-04-17T05:31:00.378550+0000","last_undegraded":"2024-04-17T05:31:00.378550+0000","last_fullsized":"2024-04-17T05:31:00.378550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:43:39.199679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'11","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.364293+0000","last_change":"2024-04-17T05:26:53.220626+0000","last_active":"2024-04-17T05:33:47.364293+0000","last_peered":"2024-04-17T05:33:47.364293+0000","last_clean":"2024-04-17T05:33:47.364293+0000","last_became_active":"2024-04-17T05:26:53.220331+0000","last_became_peered":"2024-04-17T05:26:53.220331+0000","last_unstale":"2024-04-17T05:33:47.364293+0000","last_undegraded":"2024-04-17T05:33:47.364293+0000","last_fullsized":"2024-04-17T05:33:47.364293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:32:25.337967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:05.423944+0000","last_change":"2024-04-17T05:26:52.216060+0000","last_active":"2024-04-17T05:31:05.423944+0000","last_peered":"2024-04-17T05:31:05.423944+0000","last_clean":"2024-04-17T05:31:05.423944+0000","last_became_active":"2024-04-17T05:26:52.215771+0000","last_became_peered":"2024-04-17T05:26:52.215771+0000","last_unstale":"2024-04-17T05:31:05.423944+0000","last_undegraded":"2024-04-17T05:31:05.423944+0000","last_fullsized":"2024-04-17T05:31:05.423944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:14:11.769826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'5","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:32:12.762866+0000","last_change":"2024-04-17T05:27:39.587602+0000","last_active":"2024-04-17T05:32:12.762866+0000","last_peered":"2024-04-17T05:32:12.762866+0000","last_clean":"2024-04-17T05:32:12.762866+0000","last_became_active":"2024-04-17T05:27:39.586593+0000","last_became_peered":"2024-04-17T05:27:39.586593+0000","last_unstale":"2024-04-17T05:32:12.762866+0000","last_undegraded":"2024-04-17T05:32:12.762866+0000","last_fullsized":"2024-04-17T05:32:12.762866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:46:03.707528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.396983+0000","last_change":"2024-04-17T05:26:53.238977+0000","last_active":"2024-04-17T05:33:47.396983+0000","last_peered":"2024-04-17T05:33:47.396983+0000","last_clean":"2024-04-17T05:33:47.396983+0000","last_became_active":"2024-04-17T05:26:53.238516+0000","last_became_peered":"2024-04-17T05:26:53.238516+0000","last_unstale":"2024-04-17T05:33:47.396983+0000","last_undegraded":"2024-04-17T05:33:47.396983+0000","last_fullsized":"2024-04-17T05:33:47.396983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:59:47.655532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:05.385269+0000","last_change":"2024-04-17T05:26:52.204960+0000","last_active":"2024-04-17T05:31:05.385269+0000","last_peered":"2024-04-17T05:31:05.385269+0000","last_clean":"2024-04-17T05:31:05.385269+0000","last_became_active":"2024-04-17T05:26:52.204529+0000","last_became_peered":"2024-04-17T05:26:52.204529+0000","last_unstale":"2024-04-17T05:31:05.385269+0000","last_undegraded":"2024-04-17T05:31:05.385269+0000","last_fullsized":"2024-04-17T05:31:05.385269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:28.440614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:10.386195+0000","last_change":"2024-04-17T05:26:57.300433+0000","last_active":"2024-04-17T05:31:10.386195+0000","last_peered":"2024-04-17T05:31:10.386195+0000","last_clean":"2024-04-17T05:31:10.386195+0000","last_became_active":"2024-04-17T05:26:57.299625+0000","last_became_peered":"2024-04-17T05:26:57.299625+0000","last_unstale":"2024-04-17T05:31:10.386195+0000","last_undegraded":"2024-04-17T05:31:10.386195+0000","last_fullsized":"2024-04-17T05:31:10.386195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:59:51.738314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.382415+0000","last_change":"2024-04-17T05:26:53.221039+0000","last_active":"2024-04-17T05:33:47.382415+0000","last_peered":"2024-04-17T05:33:47.382415+0000","last_clean":"2024-04-17T05:33:47.382415+0000","last_became_active":"2024-04-17T05:26:53.220763+0000","last_became_peered":"2024-04-17T05:26:53.220763+0000","last_unstale":"2024-04-17T05:33:47.382415+0000","last_undegraded":"2024-04-17T05:33:47.382415+0000","last_fullsized":"2024-04-17T05:33:47.382415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:06:06.694765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:05.373798+0000","last_change":"2024-04-17T05:26:52.200059+0000","last_active":"2024-04-17T05:31:05.373798+0000","last_peered":"2024-04-17T05:31:05.373798+0000","last_clean":"2024-04-17T05:31:05.373798+0000","last_became_active":"2024-04-17T05:26:52.199528+0000","last_became_peered":"2024-04-17T05:26:52.199528+0000","last_unstale":"2024-04-17T05:31:05.373798+0000","last_undegraded":"2024-04-17T05:31:05.373798+0000","last_fullsized":"2024-04-17T05:31:05.373798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:39:42.873364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'2","reported_seq":16,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:39.476676+0000","last_change":"2024-04-17T05:27:39.629806+0000","last_active":"2024-04-17T05:33:39.476676+0000","last_peered":"2024-04-17T05:33:39.476676+0000","last_clean":"2024-04-17T05:33:39.476676+0000","last_became_active":"2024-04-17T05:27:39.628034+0000","last_became_peered":"2024-04-17T05:27:39.628034+0000","last_unstale":"2024-04-17T05:33:39.476676+0000","last_undegraded":"2024-04-17T05:33:39.476676+0000","last_fullsized":"2024-04-17T05:33:39.476676+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:39:30.581787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.372142+0000","last_change":"2024-04-17T05:26:53.225946+0000","last_active":"2024-04-17T05:33:47.372142+0000","last_peered":"2024-04-17T05:33:47.372142+0000","last_clean":"2024-04-17T05:33:47.372142+0000","last_became_active":"2024-04-17T05:26:53.220930+0000","last_became_peered":"2024-04-17T05:26:53.220930+0000","last_unstale":"2024-04-17T05:33:47.372142+0000","last_undegraded":"2024-04-17T05:33:47.372142+0000","last_fullsized":"2024-04-17T05:33:47.372142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:08:41.870139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'42","reported_seq":107,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:42.901807+0000","last_change":"2024-04-17T05:26:52.200139+0000","last_active":"2024-04-17T05:33:42.901807+0000","last_peered":"2024-04-17T05:33:42.901807+0000","last_clean":"2024-04-17T05:33:42.901807+0000","last_became_active":"2024-04-17T05:26:52.199804+0000","last_became_peered":"2024-04-17T05:26:52.199804+0000","last_unstale":"2024-04-17T05:33:42.901807+0000","last_undegraded":"2024-04-17T05:33:42.901807+0000","last_fullsized":"2024-04-17T05:33:42.901807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:05:28.743450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10823,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":36,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:20.388171+0000","last_change":"2024-04-17T05:26:57.303365+0000","last_active":"2024-04-17T05:31:20.388171+0000","last_peered":"2024-04-17T05:31:20.388171+0000","last_clean":"2024-04-17T05:31:20.388171+0000","last_became_active":"2024-04-17T05:26:57.301101+0000","last_became_peered":"2024-04-17T05:26:57.301101+0000","last_unstale":"2024-04-17T05:31:20.388171+0000","last_undegraded":"2024-04-17T05:31:20.388171+0000","last_fullsized":"2024-04-17T05:31:20.388171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:43:39.199679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.386448+0000","last_change":"2024-04-17T05:26:53.238762+0000","last_active":"2024-04-17T05:33:47.386448+0000","last_peered":"2024-04-17T05:33:47.386448+0000","last_clean":"2024-04-17T05:33:47.386448+0000","last_became_active":"2024-04-17T05:26:53.238488+0000","last_became_peered":"2024-04-17T05:26:53.238488+0000","last_unstale":"2024-04-17T05:33:47.386448+0000","last_undegraded":"2024-04-17T05:33:47.386448+0000","last_fullsized":"2024-04-17T05:33:47.386448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:42:38.214751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:55.422328+0000","last_change":"2024-04-17T05:26:52.213104+0000","last_active":"2024-04-17T05:30:55.422328+0000","last_peered":"2024-04-17T05:30:55.422328+0000","last_clean":"2024-04-17T05:30:55.422328+0000","last_became_active":"2024-04-17T05:26:52.212838+0000","last_became_peered":"2024-04-17T05:26:52.212838+0000","last_unstale":"2024-04-17T05:30:55.422328+0000","last_undegraded":"2024-04-17T05:30:55.422328+0000","last_fullsized":"2024-04-17T05:30:55.422328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:11:58.913400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:20.382835+0000","last_change":"2024-04-17T05:26:57.342387+0000","last_active":"2024-04-17T05:31:20.382835+0000","last_peered":"2024-04-17T05:31:20.382835+0000","last_clean":"2024-04-17T05:31:20.382835+0000","last_became_active":"2024-04-17T05:26:57.342008+0000","last_became_peered":"2024-04-17T05:26:57.342008+0000","last_unstale":"2024-04-17T05:31:20.382835+0000","last_undegraded":"2024-04-17T05:31:20.382835+0000","last_fullsized":"2024-04-17T05:31:20.382835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:43:39.199679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.393491+0000","last_change":"2024-04-17T05:26:53.243046+0000","last_active":"2024-04-17T05:33:47.393491+0000","last_peered":"2024-04-17T05:33:47.393491+0000","last_clean":"2024-04-17T05:33:47.393491+0000","last_became_active":"2024-04-17T05:26:53.242778+0000","last_became_peered":"2024-04-17T05:26:53.242778+0000","last_unstale":"2024-04-17T05:33:47.393491+0000","last_undegraded":"2024-04-17T05:33:47.393491+0000","last_fullsized":"2024-04-17T05:33:47.393491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:32:25.337967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:05.373837+0000","last_change":"2024-04-17T05:26:52.198125+0000","last_active":"2024-04-17T05:31:05.373837+0000","last_peered":"2024-04-17T05:31:05.373837+0000","last_clean":"2024-04-17T05:31:05.373837+0000","last_became_active":"2024-04-17T05:26:52.197762+0000","last_became_peered":"2024-04-17T05:26:52.197762+0000","last_unstale":"2024-04-17T05:31:05.373837+0000","last_undegraded":"2024-04-17T05:31:05.373837+0000","last_fullsized":"2024-04-17T05:31:05.373837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:28.440614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":185,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:50.421452+0000","last_change":"2024-04-17T05:26:48.072527+0000","last_active":"2024-04-17T05:30:50.421452+0000","last_peered":"2024-04-17T05:30:50.421452+0000","last_clean":"2024-04-17T05:30:50.421452+0000","last_became_active":"2024-04-17T05:26:48.070585+0000","last_became_peered":"2024-04-17T05:26:48.070585+0000","last_unstale":"2024-04-17T05:30:50.421452+0000","last_undegraded":"2024-04-17T05:30:50.421452+0000","last_fullsized":"2024-04-17T05:30:50.421452+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:46.995002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:46.995002+0000","last_clean_scrub_stamp":"2024-04-17T05:26:46.995002+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:48:35.792125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:10.413588+0000","last_change":"2024-04-17T05:26:57.346681+0000","last_active":"2024-04-17T05:31:10.413588+0000","last_peered":"2024-04-17T05:31:10.413588+0000","last_clean":"2024-04-17T05:31:10.413588+0000","last_became_active":"2024-04-17T05:26:57.345320+0000","last_became_peered":"2024-04-17T05:26:57.345320+0000","last_unstale":"2024-04-17T05:31:10.413588+0000","last_undegraded":"2024-04-17T05:31:10.413588+0000","last_fullsized":"2024-04-17T05:31:10.413588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:14:02.473527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'5","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.384494+0000","last_change":"2024-04-17T05:27:39.898572+0000","last_active":"2024-04-17T05:33:47.384494+0000","last_peered":"2024-04-17T05:33:47.384494+0000","last_clean":"2024-04-17T05:33:47.384494+0000","last_became_active":"2024-04-17T05:27:39.897777+0000","last_became_peered":"2024-04-17T05:27:39.897777+0000","last_unstale":"2024-04-17T05:33:47.384494+0000","last_undegraded":"2024-04-17T05:33:47.384494+0000","last_fullsized":"2024-04-17T05:33:47.384494+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:31:02.906556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:40.399880+0000","last_change":"2024-04-17T05:26:52.209276+0000","last_active":"2024-04-17T05:33:40.399880+0000","last_peered":"2024-04-17T05:33:40.399880+0000","last_clean":"2024-04-17T05:33:40.399880+0000","last_became_active":"2024-04-17T05:26:52.208422+0000","last_became_peered":"2024-04-17T05:26:52.208422+0000","last_unstale":"2024-04-17T05:33:40.399880+0000","last_undegraded":"2024-04-17T05:33:40.399880+0000","last_fullsized":"2024-04-17T05:33:40.399880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:39:42.873364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:20.415373+0000","last_change":"2024-04-17T05:26:57.342209+0000","last_active":"2024-04-17T05:31:20.415373+0000","last_peered":"2024-04-17T05:31:20.415373+0000","last_clean":"2024-04-17T05:31:20.415373+0000","last_became_active":"2024-04-17T05:26:57.341658+0000","last_became_peered":"2024-04-17T05:26:57.341658+0000","last_unstale":"2024-04-17T05:31:20.415373+0000","last_undegraded":"2024-04-17T05:31:20.415373+0000","last_fullsized":"2024-04-17T05:31:20.415373+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:49.740852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.392825+0000","last_change":"2024-04-17T05:26:53.239720+0000","last_active":"2024-04-17T05:33:47.392825+0000","last_peered":"2024-04-17T05:33:47.392825+0000","last_clean":"2024-04-17T05:33:47.392825+0000","last_became_active":"2024-04-17T05:26:53.238669+0000","last_became_peered":"2024-04-17T05:26:53.238669+0000","last_unstale":"2024-04-17T05:33:47.392825+0000","last_undegraded":"2024-04-17T05:33:47.392825+0000","last_fullsized":"2024-04-17T05:33:47.392825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:58:59.967200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:25.388997+0000","last_change":"2024-04-17T05:26:52.202596+0000","last_active":"2024-04-17T05:31:25.388997+0000","last_peered":"2024-04-17T05:31:25.388997+0000","last_clean":"2024-04-17T05:31:25.388997+0000","last_became_active":"2024-04-17T05:26:52.202246+0000","last_became_peered":"2024-04-17T05:26:52.202246+0000","last_unstale":"2024-04-17T05:31:25.388997+0000","last_undegraded":"2024-04-17T05:31:25.388997+0000","last_fullsized":"2024-04-17T05:31:25.388997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:30.475514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:30.384580+0000","last_change":"2024-04-17T05:26:57.303069+0000","last_active":"2024-04-17T05:31:30.384580+0000","last_peered":"2024-04-17T05:31:30.384580+0000","last_clean":"2024-04-17T05:31:30.384580+0000","last_became_active":"2024-04-17T05:26:57.302457+0000","last_became_peered":"2024-04-17T05:26:57.302457+0000","last_unstale":"2024-04-17T05:31:30.384580+0000","last_undegraded":"2024-04-17T05:31:30.384580+0000","last_fullsized":"2024-04-17T05:31:30.384580+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:45:07.123915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.391025+0000","last_change":"2024-04-17T05:26:53.255140+0000","last_active":"2024-04-17T05:33:47.391025+0000","last_peered":"2024-04-17T05:33:47.391025+0000","last_clean":"2024-04-17T05:33:47.391025+0000","last_became_active":"2024-04-17T05:26:53.254371+0000","last_became_peered":"2024-04-17T05:26:53.254371+0000","last_unstale":"2024-04-17T05:33:47.391025+0000","last_undegraded":"2024-04-17T05:33:47.391025+0000","last_fullsized":"2024-04-17T05:33:47.391025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:33:12.651636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:25.381608+0000","last_change":"2024-04-17T05:26:52.204598+0000","last_active":"2024-04-17T05:31:25.381608+0000","last_peered":"2024-04-17T05:31:25.381608+0000","last_clean":"2024-04-17T05:31:25.381608+0000","last_became_active":"2024-04-17T05:26:52.204139+0000","last_became_peered":"2024-04-17T05:26:52.204139+0000","last_unstale":"2024-04-17T05:31:25.381608+0000","last_undegraded":"2024-04-17T05:31:25.381608+0000","last_fullsized":"2024-04-17T05:31:25.381608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:11:26.292397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:20.376450+0000","last_change":"2024-04-17T05:26:57.345152+0000","last_active":"2024-04-17T05:31:20.376450+0000","last_peered":"2024-04-17T05:31:20.376450+0000","last_clean":"2024-04-17T05:31:20.376450+0000","last_became_active":"2024-04-17T05:26:57.342006+0000","last_became_peered":"2024-04-17T05:26:57.342006+0000","last_unstale":"2024-04-17T05:31:20.376450+0000","last_undegraded":"2024-04-17T05:31:20.376450+0000","last_fullsized":"2024-04-17T05:31:20.376450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:56:05.345989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.389227+0000","last_change":"2024-04-17T05:26:53.253746+0000","last_active":"2024-04-17T05:33:47.389227+0000","last_peered":"2024-04-17T05:33:47.389227+0000","last_clean":"2024-04-17T05:33:47.389227+0000","last_became_active":"2024-04-17T05:26:53.253395+0000","last_became_peered":"2024-04-17T05:26:53.253395+0000","last_unstale":"2024-04-17T05:33:47.389227+0000","last_undegraded":"2024-04-17T05:33:47.389227+0000","last_fullsized":"2024-04-17T05:33:47.389227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:46:38.091860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:25.378894+0000","last_change":"2024-04-17T05:26:52.199105+0000","last_active":"2024-04-17T05:31:25.378894+0000","last_peered":"2024-04-17T05:31:25.378894+0000","last_clean":"2024-04-17T05:31:25.378894+0000","last_became_active":"2024-04-17T05:26:52.198798+0000","last_became_peered":"2024-04-17T05:26:52.198798+0000","last_unstale":"2024-04-17T05:31:25.378894+0000","last_undegraded":"2024-04-17T05:31:25.378894+0000","last_fullsized":"2024-04-17T05:31:25.378894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:34:06.405382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:20.378107+0000","last_change":"2024-04-17T05:26:57.306130+0000","last_active":"2024-04-17T05:31:20.378107+0000","last_peered":"2024-04-17T05:31:20.378107+0000","last_clean":"2024-04-17T05:31:20.378107+0000","last_became_active":"2024-04-17T05:26:57.305415+0000","last_became_peered":"2024-04-17T05:26:57.305415+0000","last_unstale":"2024-04-17T05:31:20.378107+0000","last_undegraded":"2024-04-17T05:31:20.378107+0000","last_fullsized":"2024-04-17T05:31:20.378107+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:36.214126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"28'7","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.386317+0000","last_change":"2024-04-17T05:27:39.579857+0000","last_active":"2024-04-17T05:33:47.386317+0000","last_peered":"2024-04-17T05:33:47.386317+0000","last_clean":"2024-04-17T05:33:47.386317+0000","last_became_active":"2024-04-17T05:27:39.579096+0000","last_became_peered":"2024-04-17T05:27:39.579096+0000","last_unstale":"2024-04-17T05:33:47.386317+0000","last_undegraded":"2024-04-17T05:33:47.386317+0000","last_fullsized":"2024-04-17T05:33:47.386317+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:52:32.392870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"28'11","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:27.598751+0000","last_change":"2024-04-17T05:26:52.197556+0000","last_active":"2024-04-17T05:30:27.598751+0000","last_peered":"2024-04-17T05:30:27.598751+0000","last_clean":"2024-04-17T05:30:27.598751+0000","last_became_active":"2024-04-17T05:26:52.197250+0000","last_became_peered":"2024-04-17T05:26:52.197250+0000","last_unstale":"2024-04-17T05:30:27.598751+0000","last_undegraded":"2024-04-17T05:30:27.598751+0000","last_fullsized":"2024-04-17T05:30:27.598751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:12:06.528342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:25.364162+0000","last_change":"2024-04-17T05:26:57.296438+0000","last_active":"2024-04-17T05:29:25.364162+0000","last_peered":"2024-04-17T05:29:25.364162+0000","last_clean":"2024-04-17T05:29:25.364162+0000","last_became_active":"2024-04-17T05:26:57.296040+0000","last_became_peered":"2024-04-17T05:26:57.296040+0000","last_unstale":"2024-04-17T05:29:25.364162+0000","last_undegraded":"2024-04-17T05:29:25.364162+0000","last_fullsized":"2024-04-17T05:29:25.364162+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:43:13.615366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'9","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.382356+0000","last_change":"2024-04-17T05:26:53.231338+0000","last_active":"2024-04-17T05:33:47.382356+0000","last_peered":"2024-04-17T05:33:47.382356+0000","last_clean":"2024-04-17T05:33:47.382356+0000","last_became_active":"2024-04-17T05:26:53.230987+0000","last_became_peered":"2024-04-17T05:26:53.230987+0000","last_unstale":"2024-04-17T05:33:47.382356+0000","last_undegraded":"2024-04-17T05:33:47.382356+0000","last_fullsized":"2024-04-17T05:33:47.382356+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:08:10.489719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'3","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:17.583470+0000","last_change":"2024-04-17T05:26:52.207087+0000","last_active":"2024-04-17T05:30:17.583470+0000","last_peered":"2024-04-17T05:30:17.583470+0000","last_clean":"2024-04-17T05:30:17.583470+0000","last_became_active":"2024-04-17T05:26:52.206401+0000","last_became_peered":"2024-04-17T05:26:52.206401+0000","last_unstale":"2024-04-17T05:30:17.583470+0000","last_undegraded":"2024-04-17T05:30:17.583470+0000","last_fullsized":"2024-04-17T05:30:17.583470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:56:53.915549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:25.362846+0000","last_change":"2024-04-17T05:26:57.346955+0000","last_active":"2024-04-17T05:29:25.362846+0000","last_peered":"2024-04-17T05:29:25.362846+0000","last_clean":"2024-04-17T05:29:25.362846+0000","last_became_active":"2024-04-17T05:26:57.346516+0000","last_became_peered":"2024-04-17T05:26:57.346516+0000","last_unstale":"2024-04-17T05:29:25.362846+0000","last_undegraded":"2024-04-17T05:29:25.362846+0000","last_fullsized":"2024-04-17T05:29:25.362846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:00:55.830345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"28'20","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.392299+0000","last_change":"2024-04-17T05:26:53.254195+0000","last_active":"2024-04-17T05:33:47.392299+0000","last_peered":"2024-04-17T05:33:47.392299+0000","last_clean":"2024-04-17T05:33:47.392299+0000","last_became_active":"2024-04-17T05:26:53.253813+0000","last_became_peered":"2024-04-17T05:26:53.253813+0000","last_unstale":"2024-04-17T05:33:47.392299+0000","last_undegraded":"2024-04-17T05:33:47.392299+0000","last_fullsized":"2024-04-17T05:33:47.392299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:18:31.208224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'8","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:27.599886+0000","last_change":"2024-04-17T05:26:52.211664+0000","last_active":"2024-04-17T05:30:27.599886+0000","last_peered":"2024-04-17T05:30:27.599886+0000","last_clean":"2024-04-17T05:30:27.599886+0000","last_became_active":"2024-04-17T05:26:52.210106+0000","last_became_peered":"2024-04-17T05:26:52.210106+0000","last_unstale":"2024-04-17T05:30:27.599886+0000","last_undegraded":"2024-04-17T05:30:27.599886+0000","last_fullsized":"2024-04-17T05:30:27.599886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:11:26.292397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:20.361839+0000","last_change":"2024-04-17T05:26:57.344473+0000","last_active":"2024-04-17T05:29:20.361839+0000","last_peered":"2024-04-17T05:29:20.361839+0000","last_clean":"2024-04-17T05:29:20.361839+0000","last_became_active":"2024-04-17T05:26:57.341999+0000","last_became_peered":"2024-04-17T05:26:57.341999+0000","last_unstale":"2024-04-17T05:29:20.361839+0000","last_undegraded":"2024-04-17T05:29:20.361839+0000","last_fullsized":"2024-04-17T05:29:20.361839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:35:19.879335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.386810+0000","last_change":"2024-04-17T05:26:53.235732+0000","last_active":"2024-04-17T05:33:47.386810+0000","last_peered":"2024-04-17T05:33:47.386810+0000","last_clean":"2024-04-17T05:33:47.386810+0000","last_became_active":"2024-04-17T05:26:53.233202+0000","last_became_peered":"2024-04-17T05:26:53.233202+0000","last_unstale":"2024-04-17T05:33:47.386810+0000","last_undegraded":"2024-04-17T05:33:47.386810+0000","last_fullsized":"2024-04-17T05:33:47.386810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:58:23.088108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'4","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:32.503235+0000","last_change":"2024-04-17T05:26:52.194788+0000","last_active":"2024-04-17T05:29:32.503235+0000","last_peered":"2024-04-17T05:29:32.503235+0000","last_clean":"2024-04-17T05:29:32.503235+0000","last_became_active":"2024-04-17T05:26:52.194504+0000","last_became_peered":"2024-04-17T05:26:52.194504+0000","last_unstale":"2024-04-17T05:29:32.503235+0000","last_undegraded":"2024-04-17T05:29:32.503235+0000","last_fullsized":"2024-04-17T05:29:32.503235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:29:09.631143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:25.357676+0000","last_change":"2024-04-17T05:26:57.344052+0000","last_active":"2024-04-17T05:29:25.357676+0000","last_peered":"2024-04-17T05:29:25.357676+0000","last_clean":"2024-04-17T05:29:25.357676+0000","last_became_active":"2024-04-17T05:26:57.343479+0000","last_became_peered":"2024-04-17T05:26:57.343479+0000","last_unstale":"2024-04-17T05:29:25.357676+0000","last_undegraded":"2024-04-17T05:29:25.357676+0000","last_fullsized":"2024-04-17T05:29:25.357676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:23:44.724644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.384414+0000","last_change":"2024-04-17T05:26:53.250744+0000","last_active":"2024-04-17T05:33:47.384414+0000","last_peered":"2024-04-17T05:33:47.384414+0000","last_clean":"2024-04-17T05:33:47.384414+0000","last_became_active":"2024-04-17T05:26:53.249125+0000","last_became_peered":"2024-04-17T05:26:53.249125+0000","last_unstale":"2024-04-17T05:33:47.384414+0000","last_undegraded":"2024-04-17T05:33:47.384414+0000","last_fullsized":"2024-04-17T05:33:47.384414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:29.313074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'95","reported_seq":123,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.322968+0000","last_change":"2024-04-17T05:26:52.208074+0000","last_active":"2024-04-17T05:33:47.322968+0000","last_peered":"2024-04-17T05:33:47.322968+0000","last_clean":"2024-04-17T05:33:47.322968+0000","last_became_active":"2024-04-17T05:26:52.207696+0000","last_became_peered":"2024-04-17T05:26:52.207696+0000","last_unstale":"2024-04-17T05:33:47.322968+0000","last_undegraded":"2024-04-17T05:33:47.322968+0000","last_fullsized":"2024-04-17T05:33:47.322968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:10:33.072665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":934282,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:20.368982+0000","last_change":"2024-04-17T05:26:57.303649+0000","last_active":"2024-04-17T05:29:20.368982+0000","last_peered":"2024-04-17T05:29:20.368982+0000","last_clean":"2024-04-17T05:29:20.368982+0000","last_became_active":"2024-04-17T05:26:57.303124+0000","last_became_peered":"2024-04-17T05:26:57.303124+0000","last_unstale":"2024-04-17T05:29:20.368982+0000","last_undegraded":"2024-04-17T05:29:20.368982+0000","last_fullsized":"2024-04-17T05:29:20.368982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:59:04.049982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'12","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.391609+0000","last_change":"2024-04-17T05:26:53.232911+0000","last_active":"2024-04-17T05:33:47.391609+0000","last_peered":"2024-04-17T05:33:47.391609+0000","last_clean":"2024-04-17T05:33:47.391609+0000","last_became_active":"2024-04-17T05:26:53.232624+0000","last_became_peered":"2024-04-17T05:26:53.232624+0000","last_unstale":"2024-04-17T05:33:47.391609+0000","last_undegraded":"2024-04-17T05:33:47.391609+0000","last_fullsized":"2024-04-17T05:33:47.391609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:31.494213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'26","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:41.911653+0000","last_change":"2024-04-17T05:26:52.207484+0000","last_active":"2024-04-17T05:33:41.911653+0000","last_peered":"2024-04-17T05:33:41.911653+0000","last_clean":"2024-04-17T05:33:41.911653+0000","last_became_active":"2024-04-17T05:26:52.207181+0000","last_became_peered":"2024-04-17T05:26:52.207181+0000","last_unstale":"2024-04-17T05:33:41.911653+0000","last_undegraded":"2024-04-17T05:33:41.911653+0000","last_fullsized":"2024-04-17T05:33:41.911653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:06:05.676066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:20.359125+0000","last_change":"2024-04-17T05:27:39.629173+0000","last_active":"2024-04-17T05:29:20.359125+0000","last_peered":"2024-04-17T05:29:20.359125+0000","last_clean":"2024-04-17T05:29:20.359125+0000","last_became_active":"2024-04-17T05:27:39.627825+0000","last_became_peered":"2024-04-17T05:27:39.627825+0000","last_unstale":"2024-04-17T05:29:20.359125+0000","last_undegraded":"2024-04-17T05:29:20.359125+0000","last_fullsized":"2024-04-17T05:29:20.359125+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:00:55.830345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"28'9","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.396634+0000","last_change":"2024-04-17T05:26:53.241678+0000","last_active":"2024-04-17T05:33:47.396634+0000","last_peered":"2024-04-17T05:33:47.396634+0000","last_clean":"2024-04-17T05:33:47.396634+0000","last_became_active":"2024-04-17T05:26:53.241388+0000","last_became_peered":"2024-04-17T05:26:53.241388+0000","last_unstale":"2024-04-17T05:33:47.396634+0000","last_undegraded":"2024-04-17T05:33:47.396634+0000","last_fullsized":"2024-04-17T05:33:47.396634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:32:25.337967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'7","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:17.584715+0000","last_change":"2024-04-17T05:26:52.213786+0000","last_active":"2024-04-17T05:30:17.584715+0000","last_peered":"2024-04-17T05:30:17.584715+0000","last_clean":"2024-04-17T05:30:17.584715+0000","last_became_active":"2024-04-17T05:26:52.212440+0000","last_became_peered":"2024-04-17T05:26:52.212440+0000","last_unstale":"2024-04-17T05:30:17.584715+0000","last_undegraded":"2024-04-17T05:30:17.584715+0000","last_fullsized":"2024-04-17T05:30:17.584715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:06:05.676066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:20.361590+0000","last_change":"2024-04-17T05:26:57.300596+0000","last_active":"2024-04-17T05:29:20.361590+0000","last_peered":"2024-04-17T05:29:20.361590+0000","last_clean":"2024-04-17T05:29:20.361590+0000","last_became_active":"2024-04-17T05:26:57.300156+0000","last_became_peered":"2024-04-17T05:26:57.300156+0000","last_unstale":"2024-04-17T05:29:20.361590+0000","last_undegraded":"2024-04-17T05:29:20.361590+0000","last_fullsized":"2024-04-17T05:29:20.361590+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:11:16.497552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.395877+0000","last_change":"2024-04-17T05:26:53.238893+0000","last_active":"2024-04-17T05:33:47.395877+0000","last_peered":"2024-04-17T05:33:47.395877+0000","last_clean":"2024-04-17T05:33:47.395877+0000","last_became_active":"2024-04-17T05:26:53.238566+0000","last_became_peered":"2024-04-17T05:26:53.238566+0000","last_unstale":"2024-04-17T05:33:47.395877+0000","last_undegraded":"2024-04-17T05:33:47.395877+0000","last_fullsized":"2024-04-17T05:33:47.395877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:52:32.392870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"28'5","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:27.602689+0000","last_change":"2024-04-17T05:26:52.215304+0000","last_active":"2024-04-17T05:30:27.602689+0000","last_peered":"2024-04-17T05:30:27.602689+0000","last_clean":"2024-04-17T05:30:27.602689+0000","last_became_active":"2024-04-17T05:26:52.214958+0000","last_became_peered":"2024-04-17T05:26:52.214958+0000","last_unstale":"2024-04-17T05:30:27.602689+0000","last_undegraded":"2024-04-17T05:30:27.602689+0000","last_fullsized":"2024-04-17T05:30:27.602689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:13:25.702517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:20.361720+0000","last_change":"2024-04-17T05:26:57.342083+0000","last_active":"2024-04-17T05:29:20.361720+0000","last_peered":"2024-04-17T05:29:20.361720+0000","last_clean":"2024-04-17T05:29:20.361720+0000","last_became_active":"2024-04-17T05:26:57.341304+0000","last_became_peered":"2024-04-17T05:26:57.341304+0000","last_unstale":"2024-04-17T05:29:20.361720+0000","last_undegraded":"2024-04-17T05:29:20.361720+0000","last_fullsized":"2024-04-17T05:29:20.361720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:56:05.345989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:00.379085+0000","last_change":"2024-04-17T05:26:57.342446+0000","last_active":"2024-04-17T05:31:00.379085+0000","last_peered":"2024-04-17T05:31:00.379085+0000","last_clean":"2024-04-17T05:31:00.379085+0000","last_became_active":"2024-04-17T05:26:57.342076+0000","last_became_peered":"2024-04-17T05:26:57.342076+0000","last_unstale":"2024-04-17T05:31:00.379085+0000","last_undegraded":"2024-04-17T05:31:00.379085+0000","last_fullsized":"2024-04-17T05:31:00.379085+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:59:51.738314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'11","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.374673+0000","last_change":"2024-04-17T05:26:53.228706+0000","last_active":"2024-04-17T05:33:47.374673+0000","last_peered":"2024-04-17T05:33:47.374673+0000","last_clean":"2024-04-17T05:33:47.374673+0000","last_became_active":"2024-04-17T05:26:53.228381+0000","last_became_peered":"2024-04-17T05:26:53.228381+0000","last_unstale":"2024-04-17T05:33:47.374673+0000","last_undegraded":"2024-04-17T05:33:47.374673+0000","last_fullsized":"2024-04-17T05:33:47.374673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:04:57.213834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'5","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:27.602400+0000","last_change":"2024-04-17T05:26:52.195697+0000","last_active":"2024-04-17T05:30:27.602400+0000","last_peered":"2024-04-17T05:30:27.602400+0000","last_clean":"2024-04-17T05:30:27.602400+0000","last_became_active":"2024-04-17T05:26:52.193995+0000","last_became_peered":"2024-04-17T05:26:52.193995+0000","last_unstale":"2024-04-17T05:30:27.602400+0000","last_undegraded":"2024-04-17T05:30:27.602400+0000","last_fullsized":"2024-04-17T05:30:27.602400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:05:28.743450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:10.413660+0000","last_change":"2024-04-17T05:26:57.306563+0000","last_active":"2024-04-17T05:31:10.413660+0000","last_peered":"2024-04-17T05:31:10.413660+0000","last_clean":"2024-04-17T05:31:10.413660+0000","last_became_active":"2024-04-17T05:26:57.305777+0000","last_became_peered":"2024-04-17T05:26:57.305777+0000","last_unstale":"2024-04-17T05:31:10.413660+0000","last_undegraded":"2024-04-17T05:31:10.413660+0000","last_fullsized":"2024-04-17T05:31:10.413660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:33.395856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.376456+0000","last_change":"2024-04-17T05:26:53.229100+0000","last_active":"2024-04-17T05:33:47.376456+0000","last_peered":"2024-04-17T05:33:47.376456+0000","last_clean":"2024-04-17T05:33:47.376456+0000","last_became_active":"2024-04-17T05:26:53.225554+0000","last_became_peered":"2024-04-17T05:26:53.225554+0000","last_unstale":"2024-04-17T05:33:47.376456+0000","last_undegraded":"2024-04-17T05:33:47.376456+0000","last_fullsized":"2024-04-17T05:33:47.376456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:04:57.213834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'2","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:22.591064+0000","last_change":"2024-04-17T05:26:52.205214+0000","last_active":"2024-04-17T05:30:22.591064+0000","last_peered":"2024-04-17T05:30:22.591064+0000","last_clean":"2024-04-17T05:30:22.591064+0000","last_became_active":"2024-04-17T05:26:52.204982+0000","last_became_peered":"2024-04-17T05:26:52.204982+0000","last_unstale":"2024-04-17T05:30:22.591064+0000","last_undegraded":"2024-04-17T05:30:22.591064+0000","last_fullsized":"2024-04-17T05:30:22.591064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:12:06.528342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"28'4","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:02.559734+0000","last_change":"2024-04-17T05:26:52.211538+0000","last_active":"2024-04-17T05:30:02.559734+0000","last_peered":"2024-04-17T05:30:02.559734+0000","last_clean":"2024-04-17T05:30:02.559734+0000","last_became_active":"2024-04-17T05:26:52.211242+0000","last_became_peered":"2024-04-17T05:26:52.211242+0000","last_unstale":"2024-04-17T05:30:02.559734+0000","last_undegraded":"2024-04-17T05:30:02.559734+0000","last_fullsized":"2024-04-17T05:30:02.559734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:30:14.163882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'7","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.391215+0000","last_change":"2024-04-17T05:26:53.239968+0000","last_active":"2024-04-17T05:33:47.391215+0000","last_peered":"2024-04-17T05:33:47.391215+0000","last_clean":"2024-04-17T05:33:47.391215+0000","last_became_active":"2024-04-17T05:26:53.239688+0000","last_became_peered":"2024-04-17T05:26:53.239688+0000","last_unstale":"2024-04-17T05:33:47.391215+0000","last_undegraded":"2024-04-17T05:33:47.391215+0000","last_fullsized":"2024-04-17T05:33:47.391215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:19:17.442103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:30.363424+0000","last_change":"2024-04-17T05:26:57.297209+0000","last_active":"2024-04-17T05:29:30.363424+0000","last_peered":"2024-04-17T05:29:30.363424+0000","last_clean":"2024-04-17T05:29:30.363424+0000","last_became_active":"2024-04-17T05:26:57.295730+0000","last_became_peered":"2024-04-17T05:26:57.295730+0000","last_unstale":"2024-04-17T05:29:30.363424+0000","last_undegraded":"2024-04-17T05:29:30.363424+0000","last_fullsized":"2024-04-17T05:29:30.363424+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:47:55.696215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'3","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:47.532063+0000","last_change":"2024-04-17T05:26:52.214520+0000","last_active":"2024-04-17T05:29:47.532063+0000","last_peered":"2024-04-17T05:29:47.532063+0000","last_clean":"2024-04-17T05:29:47.532063+0000","last_became_active":"2024-04-17T05:26:52.214153+0000","last_became_peered":"2024-04-17T05:26:52.214153+0000","last_unstale":"2024-04-17T05:29:47.532063+0000","last_undegraded":"2024-04-17T05:29:47.532063+0000","last_fullsized":"2024-04-17T05:29:47.532063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:29:09.631143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'7","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.371493+0000","last_change":"2024-04-17T05:26:53.218086+0000","last_active":"2024-04-17T05:33:47.371493+0000","last_peered":"2024-04-17T05:33:47.371493+0000","last_clean":"2024-04-17T05:33:47.371493+0000","last_became_active":"2024-04-17T05:26:53.213566+0000","last_became_peered":"2024-04-17T05:26:53.213566+0000","last_unstale":"2024-04-17T05:33:47.371493+0000","last_undegraded":"2024-04-17T05:33:47.371493+0000","last_fullsized":"2024-04-17T05:33:47.371493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:29.459313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:30.363303+0000","last_change":"2024-04-17T05:26:57.306742+0000","last_active":"2024-04-17T05:29:30.363303+0000","last_peered":"2024-04-17T05:29:30.363303+0000","last_clean":"2024-04-17T05:29:30.363303+0000","last_became_active":"2024-04-17T05:26:57.305115+0000","last_became_peered":"2024-04-17T05:26:57.305115+0000","last_unstale":"2024-04-17T05:29:30.363303+0000","last_undegraded":"2024-04-17T05:29:30.363303+0000","last_fullsized":"2024-04-17T05:29:30.363303+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:48:36.621042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.382150+0000","last_change":"2024-04-17T05:26:53.232255+0000","last_active":"2024-04-17T05:33:47.382150+0000","last_peered":"2024-04-17T05:33:47.382150+0000","last_clean":"2024-04-17T05:33:47.382150+0000","last_became_active":"2024-04-17T05:26:53.231624+0000","last_became_peered":"2024-04-17T05:26:53.231624+0000","last_unstale":"2024-04-17T05:33:47.382150+0000","last_undegraded":"2024-04-17T05:33:47.382150+0000","last_fullsized":"2024-04-17T05:33:47.382150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:27:51.120892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.392969+0000","last_change":"2024-04-17T05:26:53.222619+0000","last_active":"2024-04-17T05:33:47.392969+0000","last_peered":"2024-04-17T05:33:47.392969+0000","last_clean":"2024-04-17T05:33:47.392969+0000","last_became_active":"2024-04-17T05:26:53.222128+0000","last_became_peered":"2024-04-17T05:26:53.222128+0000","last_unstale":"2024-04-17T05:33:47.392969+0000","last_undegraded":"2024-04-17T05:33:47.392969+0000","last_fullsized":"2024-04-17T05:33:47.392969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:31.494213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.396844+0000","last_change":"2024-04-17T05:26:53.234820+0000","last_active":"2024-04-17T05:33:47.396844+0000","last_peered":"2024-04-17T05:33:47.396844+0000","last_clean":"2024-04-17T05:33:47.396844+0000","last_became_active":"2024-04-17T05:26:53.233708+0000","last_became_peered":"2024-04-17T05:26:53.233708+0000","last_unstale":"2024-04-17T05:33:47.396844+0000","last_undegraded":"2024-04-17T05:33:47.396844+0000","last_fullsized":"2024-04-17T05:33:47.396844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:08:16.322998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"28'5","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.372973+0000","last_change":"2024-04-17T05:26:53.234961+0000","last_active":"2024-04-17T05:33:47.372973+0000","last_peered":"2024-04-17T05:33:47.372973+0000","last_clean":"2024-04-17T05:33:47.372973+0000","last_became_active":"2024-04-17T05:26:53.234387+0000","last_became_peered":"2024-04-17T05:26:53.234387+0000","last_unstale":"2024-04-17T05:33:47.372973+0000","last_undegraded":"2024-04-17T05:33:47.372973+0000","last_fullsized":"2024-04-17T05:33:47.372973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:07:47.404346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.392306+0000","last_change":"2024-04-17T05:26:53.242359+0000","last_active":"2024-04-17T05:33:47.392306+0000","last_peered":"2024-04-17T05:33:47.392306+0000","last_clean":"2024-04-17T05:33:47.392306+0000","last_became_active":"2024-04-17T05:26:53.236476+0000","last_became_peered":"2024-04-17T05:26:53.236476+0000","last_unstale":"2024-04-17T05:33:47.392306+0000","last_undegraded":"2024-04-17T05:33:47.392306+0000","last_fullsized":"2024-04-17T05:33:47.392306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:08:16.322998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.374292+0000","last_change":"2024-04-17T05:26:53.231647+0000","last_active":"2024-04-17T05:33:47.374292+0000","last_peered":"2024-04-17T05:33:47.374292+0000","last_clean":"2024-04-17T05:33:47.374292+0000","last_became_active":"2024-04-17T05:26:53.231335+0000","last_became_peered":"2024-04-17T05:26:53.231335+0000","last_unstale":"2024-04-17T05:33:47.374292+0000","last_undegraded":"2024-04-17T05:33:47.374292+0000","last_fullsized":"2024-04-17T05:33:47.374292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:19:17.442103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"28'13","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.393123+0000","last_change":"2024-04-17T05:26:53.234892+0000","last_active":"2024-04-17T05:33:47.393123+0000","last_peered":"2024-04-17T05:33:47.393123+0000","last_clean":"2024-04-17T05:33:47.393123+0000","last_became_active":"2024-04-17T05:26:53.234582+0000","last_became_peered":"2024-04-17T05:26:53.234582+0000","last_unstale":"2024-04-17T05:33:47.393123+0000","last_undegraded":"2024-04-17T05:33:47.393123+0000","last_fullsized":"2024-04-17T05:33:47.393123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:48:56.352270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.391200+0000","last_change":"2024-04-17T05:26:53.245242+0000","last_active":"2024-04-17T05:33:47.391200+0000","last_peered":"2024-04-17T05:33:47.391200+0000","last_clean":"2024-04-17T05:33:47.391200+0000","last_became_active":"2024-04-17T05:26:53.244910+0000","last_became_peered":"2024-04-17T05:26:53.244910+0000","last_unstale":"2024-04-17T05:33:47.391200+0000","last_undegraded":"2024-04-17T05:33:47.391200+0000","last_fullsized":"2024-04-17T05:33:47.391200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:45:55.350158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'9","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.376735+0000","last_change":"2024-04-17T05:27:39.627151+0000","last_active":"2024-04-17T05:33:47.376735+0000","last_peered":"2024-04-17T05:33:47.376735+0000","last_clean":"2024-04-17T05:33:47.376735+0000","last_became_active":"2024-04-17T05:27:39.626252+0000","last_became_peered":"2024-04-17T05:27:39.626252+0000","last_unstale":"2024-04-17T05:33:47.376735+0000","last_undegraded":"2024-04-17T05:33:47.376735+0000","last_fullsized":"2024-04-17T05:33:47.376735+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:02:12.833146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.391575+0000","last_change":"2024-04-17T05:26:53.236750+0000","last_active":"2024-04-17T05:33:47.391575+0000","last_peered":"2024-04-17T05:33:47.391575+0000","last_clean":"2024-04-17T05:33:47.391575+0000","last_became_active":"2024-04-17T05:26:53.236386+0000","last_became_peered":"2024-04-17T05:26:53.236386+0000","last_unstale":"2024-04-17T05:33:47.391575+0000","last_undegraded":"2024-04-17T05:33:47.391575+0000","last_fullsized":"2024-04-17T05:33:47.391575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:19:17.442103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"28'13","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.397229+0000","last_change":"2024-04-17T05:26:53.242520+0000","last_active":"2024-04-17T05:33:47.397229+0000","last_peered":"2024-04-17T05:33:47.397229+0000","last_clean":"2024-04-17T05:33:47.397229+0000","last_became_active":"2024-04-17T05:26:53.242213+0000","last_became_peered":"2024-04-17T05:26:53.242213+0000","last_unstale":"2024-04-17T05:33:47.397229+0000","last_undegraded":"2024-04-17T05:33:47.397229+0000","last_fullsized":"2024-04-17T05:33:47.397229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:32.131344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"28'11","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.387905+0000","last_change":"2024-04-17T05:26:53.230464+0000","last_active":"2024-04-17T05:33:47.387905+0000","last_peered":"2024-04-17T05:33:47.387905+0000","last_clean":"2024-04-17T05:33:47.387905+0000","last_became_active":"2024-04-17T05:26:53.230146+0000","last_became_peered":"2024-04-17T05:26:53.230146+0000","last_unstale":"2024-04-17T05:33:47.387905+0000","last_undegraded":"2024-04-17T05:33:47.387905+0000","last_fullsized":"2024-04-17T05:33:47.387905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:20:19.035658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.388426+0000","last_change":"2024-04-17T05:26:53.252592+0000","last_active":"2024-04-17T05:33:47.388426+0000","last_peered":"2024-04-17T05:33:47.388426+0000","last_clean":"2024-04-17T05:33:47.388426+0000","last_became_active":"2024-04-17T05:26:53.252280+0000","last_became_peered":"2024-04-17T05:26:53.252280+0000","last_unstale":"2024-04-17T05:33:47.388426+0000","last_undegraded":"2024-04-17T05:33:47.388426+0000","last_fullsized":"2024-04-17T05:33:47.388426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:47:18.182576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.387703+0000","last_change":"2024-04-17T05:26:53.242405+0000","last_active":"2024-04-17T05:33:47.387703+0000","last_peered":"2024-04-17T05:33:47.387703+0000","last_clean":"2024-04-17T05:33:47.387703+0000","last_became_active":"2024-04-17T05:26:53.242046+0000","last_became_peered":"2024-04-17T05:26:53.242046+0000","last_unstale":"2024-04-17T05:33:47.387703+0000","last_undegraded":"2024-04-17T05:33:47.387703+0000","last_fullsized":"2024-04-17T05:33:47.387703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:25:09.244149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"28'12","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.381814+0000","last_change":"2024-04-17T05:26:53.228029+0000","last_active":"2024-04-17T05:33:47.381814+0000","last_peered":"2024-04-17T05:33:47.381814+0000","last_clean":"2024-04-17T05:33:47.381814+0000","last_became_active":"2024-04-17T05:26:53.227572+0000","last_became_peered":"2024-04-17T05:26:53.227572+0000","last_unstale":"2024-04-17T05:33:47.381814+0000","last_undegraded":"2024-04-17T05:33:47.381814+0000","last_fullsized":"2024-04-17T05:33:47.381814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:27.032116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.395644+0000","last_change":"2024-04-17T05:26:53.226283+0000","last_active":"2024-04-17T05:33:47.395644+0000","last_peered":"2024-04-17T05:33:47.395644+0000","last_clean":"2024-04-17T05:33:47.395644+0000","last_became_active":"2024-04-17T05:26:53.225983+0000","last_became_peered":"2024-04-17T05:26:53.225983+0000","last_unstale":"2024-04-17T05:33:47.395644+0000","last_undegraded":"2024-04-17T05:33:47.395644+0000","last_fullsized":"2024-04-17T05:33:47.395644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:40:51.044161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"28'11","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.397095+0000","last_change":"2024-04-17T05:26:53.230256+0000","last_active":"2024-04-17T05:33:47.397095+0000","last_peered":"2024-04-17T05:33:47.397095+0000","last_clean":"2024-04-17T05:33:47.397095+0000","last_became_active":"2024-04-17T05:26:53.229888+0000","last_became_peered":"2024-04-17T05:26:53.229888+0000","last_unstale":"2024-04-17T05:33:47.397095+0000","last_undegraded":"2024-04-17T05:33:47.397095+0000","last_fullsized":"2024-04-17T05:33:47.397095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:45:55.350158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.383533+0000","last_change":"2024-04-17T05:26:53.211199+0000","last_active":"2024-04-17T05:33:47.383533+0000","last_peered":"2024-04-17T05:33:47.383533+0000","last_clean":"2024-04-17T05:33:47.383533+0000","last_became_active":"2024-04-17T05:26:53.208394+0000","last_became_peered":"2024-04-17T05:26:53.208394+0000","last_unstale":"2024-04-17T05:33:47.383533+0000","last_undegraded":"2024-04-17T05:33:47.383533+0000","last_fullsized":"2024-04-17T05:33:47.383533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:20:19.035658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"28'5","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.375609+0000","last_change":"2024-04-17T05:26:53.224930+0000","last_active":"2024-04-17T05:33:47.375609+0000","last_peered":"2024-04-17T05:33:47.375609+0000","last_clean":"2024-04-17T05:33:47.375609+0000","last_became_active":"2024-04-17T05:26:53.224314+0000","last_became_peered":"2024-04-17T05:26:53.224314+0000","last_unstale":"2024-04-17T05:33:47.375609+0000","last_undegraded":"2024-04-17T05:33:47.375609+0000","last_fullsized":"2024-04-17T05:33:47.375609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:00:05.875990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"28'10","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.379525+0000","last_change":"2024-04-17T05:26:53.234152+0000","last_active":"2024-04-17T05:33:47.379525+0000","last_peered":"2024-04-17T05:33:47.379525+0000","last_clean":"2024-04-17T05:33:47.379525+0000","last_became_active":"2024-04-17T05:26:53.233885+0000","last_became_peered":"2024-04-17T05:26:53.233885+0000","last_unstale":"2024-04-17T05:33:47.379525+0000","last_undegraded":"2024-04-17T05:33:47.379525+0000","last_fullsized":"2024-04-17T05:33:47.379525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:20:19.035658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.388203+0000","last_change":"2024-04-17T05:26:53.233213+0000","last_active":"2024-04-17T05:33:47.388203+0000","last_peered":"2024-04-17T05:33:47.388203+0000","last_clean":"2024-04-17T05:33:47.388203+0000","last_became_active":"2024-04-17T05:26:53.232809+0000","last_became_peered":"2024-04-17T05:26:53.232809+0000","last_unstale":"2024-04-17T05:33:47.388203+0000","last_undegraded":"2024-04-17T05:33:47.388203+0000","last_fullsized":"2024-04-17T05:33:47.388203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:44.057838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.384785+0000","last_change":"2024-04-17T05:26:53.245453+0000","last_active":"2024-04-17T05:33:47.384785+0000","last_peered":"2024-04-17T05:33:47.384785+0000","last_clean":"2024-04-17T05:33:47.384785+0000","last_became_active":"2024-04-17T05:26:53.245051+0000","last_became_peered":"2024-04-17T05:26:53.245051+0000","last_unstale":"2024-04-17T05:33:47.384785+0000","last_undegraded":"2024-04-17T05:33:47.384785+0000","last_fullsized":"2024-04-17T05:33:47.384785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:44:40.424363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"28'16","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.397336+0000","last_change":"2024-04-17T05:26:53.241934+0000","last_active":"2024-04-17T05:33:47.397336+0000","last_peered":"2024-04-17T05:33:47.397336+0000","last_clean":"2024-04-17T05:33:47.397336+0000","last_became_active":"2024-04-17T05:26:53.241108+0000","last_became_peered":"2024-04-17T05:26:53.241108+0000","last_unstale":"2024-04-17T05:33:47.397336+0000","last_undegraded":"2024-04-17T05:33:47.397336+0000","last_fullsized":"2024-04-17T05:33:47.397336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:53:43.076144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"28'9","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.364950+0000","last_change":"2024-04-17T05:27:39.898458+0000","last_active":"2024-04-17T05:33:47.364950+0000","last_peered":"2024-04-17T05:33:47.364950+0000","last_clean":"2024-04-17T05:33:47.364950+0000","last_became_active":"2024-04-17T05:27:39.897830+0000","last_became_peered":"2024-04-17T05:27:39.897830+0000","last_unstale":"2024-04-17T05:33:47.364950+0000","last_undegraded":"2024-04-17T05:33:47.364950+0000","last_fullsized":"2024-04-17T05:33:47.364950+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:15:26.293817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.394853+0000","last_change":"2024-04-17T05:26:53.244109+0000","last_active":"2024-04-17T05:33:47.394853+0000","last_peered":"2024-04-17T05:33:47.394853+0000","last_clean":"2024-04-17T05:33:47.394853+0000","last_became_active":"2024-04-17T05:26:53.243625+0000","last_became_peered":"2024-04-17T05:26:53.243625+0000","last_unstale":"2024-04-17T05:33:47.394853+0000","last_undegraded":"2024-04-17T05:33:47.394853+0000","last_fullsized":"2024-04-17T05:33:47.394853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:07:47.404346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"28'5","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.383931+0000","last_change":"2024-04-17T05:26:53.246489+0000","last_active":"2024-04-17T05:33:47.383931+0000","last_peered":"2024-04-17T05:33:47.383931+0000","last_clean":"2024-04-17T05:33:47.383931+0000","last_became_active":"2024-04-17T05:26:53.246286+0000","last_became_peered":"2024-04-17T05:26:53.246286+0000","last_unstale":"2024-04-17T05:33:47.383931+0000","last_undegraded":"2024-04-17T05:33:47.383931+0000","last_fullsized":"2024-04-17T05:33:47.383931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:45.658070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'5","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.396608+0000","last_change":"2024-04-17T05:26:53.229115+0000","last_active":"2024-04-17T05:33:47.396608+0000","last_peered":"2024-04-17T05:33:47.396608+0000","last_clean":"2024-04-17T05:33:47.396608+0000","last_became_active":"2024-04-17T05:26:53.228706+0000","last_became_peered":"2024-04-17T05:26:53.228706+0000","last_unstale":"2024-04-17T05:33:47.396608+0000","last_undegraded":"2024-04-17T05:33:47.396608+0000","last_fullsized":"2024-04-17T05:33:47.396608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:19:17.442103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.385791+0000","last_change":"2024-04-17T05:26:53.244961+0000","last_active":"2024-04-17T05:33:47.385791+0000","last_peered":"2024-04-17T05:33:47.385791+0000","last_clean":"2024-04-17T05:33:47.385791+0000","last_became_active":"2024-04-17T05:26:53.244595+0000","last_became_peered":"2024-04-17T05:26:53.244595+0000","last_unstale":"2024-04-17T05:33:47.385791+0000","last_undegraded":"2024-04-17T05:33:47.385791+0000","last_fullsized":"2024-04-17T05:33:47.385791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:13:34.455173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.392806+0000","last_change":"2024-04-17T05:26:53.241645+0000","last_active":"2024-04-17T05:33:47.392806+0000","last_peered":"2024-04-17T05:33:47.392806+0000","last_clean":"2024-04-17T05:33:47.392806+0000","last_became_active":"2024-04-17T05:26:53.241292+0000","last_became_peered":"2024-04-17T05:26:53.241292+0000","last_unstale":"2024-04-17T05:33:47.392806+0000","last_undegraded":"2024-04-17T05:33:47.392806+0000","last_fullsized":"2024-04-17T05:33:47.392806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:31:26.820940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.376112+0000","last_change":"2024-04-17T05:26:53.221256+0000","last_active":"2024-04-17T05:33:47.376112+0000","last_peered":"2024-04-17T05:33:47.376112+0000","last_clean":"2024-04-17T05:33:47.376112+0000","last_became_active":"2024-04-17T05:26:53.220445+0000","last_became_peered":"2024-04-17T05:26:53.220445+0000","last_unstale":"2024-04-17T05:33:47.376112+0000","last_undegraded":"2024-04-17T05:33:47.376112+0000","last_fullsized":"2024-04-17T05:33:47.376112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:08:41.870139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'4","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.375073+0000","last_change":"2024-04-17T05:26:53.214897+0000","last_active":"2024-04-17T05:33:47.375073+0000","last_peered":"2024-04-17T05:33:47.375073+0000","last_clean":"2024-04-17T05:33:47.375073+0000","last_became_active":"2024-04-17T05:26:53.214591+0000","last_became_peered":"2024-04-17T05:26:53.214591+0000","last_unstale":"2024-04-17T05:33:47.375073+0000","last_undegraded":"2024-04-17T05:33:47.375073+0000","last_fullsized":"2024-04-17T05:33:47.375073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:32.131344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"28'10","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.390013+0000","last_change":"2024-04-17T05:26:53.248726+0000","last_active":"2024-04-17T05:33:47.390013+0000","last_peered":"2024-04-17T05:33:47.390013+0000","last_clean":"2024-04-17T05:33:47.390013+0000","last_became_active":"2024-04-17T05:26:53.248143+0000","last_became_peered":"2024-04-17T05:26:53.248143+0000","last_unstale":"2024-04-17T05:33:47.390013+0000","last_undegraded":"2024-04-17T05:33:47.390013+0000","last_fullsized":"2024-04-17T05:33:47.390013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:02:51.306764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":945903,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":397,"num_write_kb":1123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1949696,"data_stored":1891806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":388,"ondisk_log_size":388,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542233,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":897024,"data_stored":713306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542232,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28228,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343612,"statfs":{"total":96636764160,"available":96607858688,"internally_reserved":0,"allocated":1241088,"data_stored":1056638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542233,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":122446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542232,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":122482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542234,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1253376,"data_stored":1067461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542232,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":133179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542233,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":122516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542232,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":905216,"data_stored":713362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":10823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":954368,"data_stored":945105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":942080,"data_stored":934282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T05:33:55.346 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T05:33:55.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.593+0000 7f9e8de00640 1 Processor -- start 2024-04-17T05:33:55.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.594+0000 7f9e8de00640 1 -- start start 2024-04-17T05:33:55.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.594+0000 7f9e8de00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9e880b58b0 0x7f9e880b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:55.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.594+0000 7f9e8de00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9e880b7e90 0x7f9e881486a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:55.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.595+0000 7f9e8de00640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e880b5c90 con 0x7f9e8814b1d0 2024-04-17T05:33:55.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.595+0000 7f9e8de00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f9e88148210 con 0x7f9e880b7e90 2024-04-17T05:33:55.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.595+0000 7f9e8de00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f9e880b67a0 con 0x7f9e880b58b0 2024-04-17T05:33:55.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.595+0000 7f9e86000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9e880b7e90 0x7f9e881486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:55.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.595+0000 7f9e86000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9e880b7e90 0x7f9e881486a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48946/0 (socket says 172.21.15.123:48946) 2024-04-17T05:33:55.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.595+0000 7f9e86000640 1 -- 172.21.15.123:0/3320746339 learned_addr learned my addr 172.21.15.123:0/3320746339 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:55.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.595+0000 7f9e86a00640 1 --2- 172.21.15.123:0/3320746339 >> v2:172.21.15.164:3300/0 conn(0x7f9e880b58b0 0x7f9e880b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:55.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.595+0000 7f9e86000640 1 -- 172.21.15.123:0/3320746339 >> v2:172.21.15.164:3300/0 conn(0x7f9e880b58b0 msgr2=0x7f9e880b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:55.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.595+0000 7f9e86000640 1 --2- 172.21.15.123:0/3320746339 >> v2:172.21.15.164:3300/0 conn(0x7f9e880b58b0 0x7f9e880b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:55.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.595+0000 7f9e86000640 1 -- 172.21.15.123:0/3320746339 >> v1:172.21.15.164:6789/0 conn(0x7f9e8814b1d0 legacy=0x7f9e8814b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:55.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.595+0000 7f9e86000640 1 -- 172.21.15.123:0/3320746339 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e88147be0 con 0x7f9e880b7e90 2024-04-17T05:33:55.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.595+0000 7f9e86a00640 1 --2- 172.21.15.123:0/3320746339 >> v2:172.21.15.164:3300/0 conn(0x7f9e880b58b0 0x7f9e880b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:33:55.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.596+0000 7f9e86000640 1 --2- 172.21.15.123:0/3320746339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e880b7e90 0x7f9e881486a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9e88068370 tx=0x7f9e7002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82dfc084d433c596 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:55.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.597+0000 7f9e85600640 1 -- 172.21.15.123:0/3320746339 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7002e070 con 0x7f9e880b7e90 2024-04-17T05:33:55.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.597+0000 7f9e85600640 1 -- 172.21.15.123:0/3320746339 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e70037070 con 0x7f9e880b7e90 2024-04-17T05:33:55.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.597+0000 7f9e85600640 1 -- 172.21.15.123:0/3320746339 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e70031a00 con 0x7f9e880b7e90 2024-04-17T05:33:55.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.597+0000 7f9e8de00640 1 -- 172.21.15.123:0/3320746339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e880b7e90 msgr2=0x7f9e881486a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:55.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.597+0000 7f9e8de00640 1 --2- 172.21.15.123:0/3320746339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e880b7e90 0x7f9e881486a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9e88068370 tx=0x7f9e7002b880 comp rx=0 tx=0).stop 2024-04-17T05:33:55.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.597+0000 7f9e8de00640 1 -- 172.21.15.123:0/3320746339 shutdown_connections 2024-04-17T05:33:55.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.597+0000 7f9e8de00640 1 --2- 172.21.15.123:0/3320746339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e880b7e90 0x7f9e881486a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:55.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.597+0000 7f9e8de00640 1 --2- 172.21.15.123:0/3320746339 >> v2:172.21.15.164:3300/0 conn(0x7f9e880b58b0 0x7f9e880b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:55.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.597+0000 7f9e8de00640 1 -- 172.21.15.123:0/3320746339 >> 172.21.15.123:0/3320746339 conn(0x7f9e880bd6f0 msgr2=0x7f9e880bdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:55.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.598+0000 7f9e8de00640 1 -- 172.21.15.123:0/3320746339 shutdown_connections 2024-04-17T05:33:55.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.598+0000 7f9e8de00640 1 -- 172.21.15.123:0/3320746339 wait complete. 2024-04-17T05:33:55.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.599+0000 7f9e8de00640 1 Processor -- start 2024-04-17T05:33:55.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.599+0000 7f9e8de00640 1 -- start start 2024-04-17T05:33:55.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.600+0000 7f9e8de00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e880b58b0 0x7f9e8813fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:55.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.600+0000 7f9e8de00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e880b7e90 0x7f9e880bbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:55.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.600+0000 7f9e8de00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e8814b1d0 0x7f9e88137df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:55.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.600+0000 7f9e8de00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9e88148be0 con 0x7f9e8814b1d0 2024-04-17T05:33:55.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.600+0000 7f9e8de00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9e880b76b0 con 0x7f9e880b7e90 2024-04-17T05:33:55.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.600+0000 7f9e8de00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f9e88147ea0 con 0x7f9e880b58b0 2024-04-17T05:33:55.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.600+0000 7f9e87400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e8814b1d0 0x7f9e88137df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:55.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.600+0000 7f9e87400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e8814b1d0 0x7f9e88137df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48958/0 (socket says 172.21.15.123:48958) 2024-04-17T05:33:55.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.600+0000 7f9e87400640 1 -- 172.21.15.123:0/2402679396 learned_addr learned my addr 172.21.15.123:0/2402679396 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:55.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.601+0000 7f9e86000640 1 --2- 172.21.15.123:0/2402679396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e880b7e90 0x7f9e880bbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:55.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.601+0000 7f9e86a00640 1 --2- 172.21.15.123:0/2402679396 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e880b58b0 0x7f9e8813fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:55.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.601+0000 7f9e87400640 1 -- 172.21.15.123:0/2402679396 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e880b58b0 msgr2=0x7f9e8813fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:55.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.601+0000 7f9e87400640 1 --2- 172.21.15.123:0/2402679396 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e880b58b0 0x7f9e8813fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:55.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.601+0000 7f9e87400640 1 -- 172.21.15.123:0/2402679396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e880b7e90 msgr2=0x7f9e880bbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:55.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.601+0000 7f9e87400640 1 --2- 172.21.15.123:0/2402679396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e880b7e90 0x7f9e880bbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:55.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.601+0000 7f9e87400640 1 -- 172.21.15.123:0/2402679396 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e88139970 con 0x7f9e8814b1d0 2024-04-17T05:33:55.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.601+0000 7f9e87400640 1 --2- 172.21.15.123:0/2402679396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e8814b1d0 0x7f9e88137df0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9e8000b490 tx=0x7f9e8000b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:55.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.601+0000 7f9e7f400640 1 -- 172.21.15.123:0/2402679396 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e80015020 con 0x7f9e8814b1d0 2024-04-17T05:33:55.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.602+0000 7f9e7f400640 1 -- 172.21.15.123:0/2402679396 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e80011850 con 0x7f9e8814b1d0 2024-04-17T05:33:55.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.602+0000 7f9e8de00640 1 -- 172.21.15.123:0/2402679396 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e880bb720 con 0x7f9e8814b1d0 2024-04-17T05:33:55.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.602+0000 7f9e7f400640 1 -- 172.21.15.123:0/2402679396 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e80011c40 con 0x7f9e8814b1d0 2024-04-17T05:33:55.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.602+0000 7f9e8de00640 1 -- 172.21.15.123:0/2402679396 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e880bd240 con 0x7f9e8814b1d0 2024-04-17T05:33:55.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.603+0000 7f9e8de00640 1 -- 172.21.15.123:0/2402679396 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e88068a40 con 0x7f9e8814b1d0 2024-04-17T05:33:55.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.604+0000 7f9e7f400640 1 -- 172.21.15.123:0/2402679396 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9e80018020 con 0x7f9e8814b1d0 2024-04-17T05:33:55.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.605+0000 7f9e7f400640 1 --2- 172.21.15.123:0/2402679396 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f9e6406c8f0 0x7f9e6406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:55.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.605+0000 7f9e7f400640 1 -- 172.21.15.123:0/2402679396 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f9e8008be40 con 0x7f9e8814b1d0 2024-04-17T05:33:55.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.606+0000 7f9e86a00640 1 --2- 172.21.15.123:0/2402679396 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f9e6406c8f0 0x7f9e6406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:55.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.607+0000 7f9e86a00640 1 --2- 172.21.15.123:0/2402679396 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f9e6406c8f0 0x7f9e6406edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9e780075b0 tx=0x7f9e78007540 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:55.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.609+0000 7f9e7f400640 1 -- 172.21.15.123:0/2402679396 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f9e8001f020 con 0x7f9e8814b1d0 2024-04-17T05:33:55.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.814+0000 7f9e8de00640 1 -- 172.21.15.123:0/2402679396 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e88148740 con 0x7f9e8814b1d0 2024-04-17T05:33:55.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.815+0000 7f9e7f400640 1 -- 172.21.15.123:0/2402679396 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18960 (secure 0 0 0) 0x7f9e880bb720 con 0x7f9e8814b1d0 2024-04-17T05:33:55.815 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:33:55.815 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":28,"fsid":"0787c5c0-e77a-4102-a899-30db48b19c68","created":"2024-04-17T05:26:33.031507+0000","modified":"2024-04-17T05:27:39.558127+0000","last_up_change":"2024-04-17T05:26:44.988433+0000","last_in_change":"2024-04-17T05:26:36.682131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T05:26:46.329778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T05:26:50.600195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T05:26:51.626498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T05:26:55.264044+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15c87cdb-9415-45a6-a2a6-ea6bec9daece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6801","nonce":840753170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6803","nonce":840753170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6807","nonce":840753170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6805","nonce":840753170}]},"public_addr":"172.21.15.123:6801/840753170","cluster_addr":"172.21.15.123:6803/840753170","heartbeat_back_addr":"172.21.15.123:6807/840753170","heartbeat_front_addr":"172.21.15.123:6805/840753170","state":["exists","up"]},{"osd":1,"uuid":"281751b5-486d-4845-b4aa-b308bf7cec62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6822","nonce":2231878927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6827","nonce":2231878927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6831","nonce":2231878927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6829","nonce":2231878927}]},"public_addr":"172.21.15.123:6822/2231878927","cluster_addr":"172.21.15.123:6827/2231878927","heartbeat_back_addr":"172.21.15.123:6831/2231878927","heartbeat_front_addr":"172.21.15.123:6829/2231878927","state":["exists","up"]},{"osd":2,"uuid":"b42257d3-bd20-4db5-aa37-1bf5c512d0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6817","nonce":754360844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6820","nonce":754360844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6825","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6826","nonce":754360844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6823","nonce":754360844}]},"public_addr":"172.21.15.123:6817/754360844","cluster_addr":"172.21.15.123:6820/754360844","heartbeat_back_addr":"172.21.15.123:6826/754360844","heartbeat_front_addr":"172.21.15.123:6823/754360844","state":["exists","up"]},{"osd":3,"uuid":"0f26b891-bbe6-478e-8dee-78e69bb48cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6809","nonce":2898088574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6811","nonce":2898088574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6815","nonce":2898088574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6813","nonce":2898088574}]},"public_addr":"172.21.15.123:6809/2898088574","cluster_addr":"172.21.15.123:6811/2898088574","heartbeat_back_addr":"172.21.15.123:6815/2898088574","heartbeat_front_addr":"172.21.15.123:6813/2898088574","state":["exists","up"]},{"osd":4,"uuid":"43e59318-2740-4625-9d64-eec1fd43c322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6801","nonce":606484349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6804","nonce":606484349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6812","nonce":606484349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6808","nonce":606484349}]},"public_addr":"172.21.15.164:6801/606484349","cluster_addr":"172.21.15.164:6804/606484349","heartbeat_back_addr":"172.21.15.164:6812/606484349","heartbeat_front_addr":"172.21.15.164:6808/606484349","state":["exists","up"]},{"osd":5,"uuid":"aaa3acf4-4adc-4337-aba3-363851d35310","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6805","nonce":1376989593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6809","nonce":1376989593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6815","nonce":1376989593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6813","nonce":1376989593}]},"public_addr":"172.21.15.164:6805/1376989593","cluster_addr":"172.21.15.164:6809/1376989593","heartbeat_back_addr":"172.21.15.164:6815/1376989593","heartbeat_front_addr":"172.21.15.164:6813/1376989593","state":["exists","up"]},{"osd":6,"uuid":"6f765b27-7377-4d81-9192-23a965651145","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6817","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6821","nonce":1594306924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6823","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6826","nonce":1594306924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6831","nonce":1594306924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6829","nonce":1594306924}]},"public_addr":"172.21.15.164:6821/1594306924","cluster_addr":"172.21.15.164:6826/1594306924","heartbeat_back_addr":"172.21.15.164:6831/1594306924","heartbeat_front_addr":"172.21.15.164:6829/1594306924","state":["exists","up"]},{"osd":7,"uuid":"5547394b-ec2f-4311-846d-369af4b1acf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6818","nonce":295402697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6819","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6820","nonce":295402697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6825","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6827","nonce":295402697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6824","nonce":295402697}]},"public_addr":"172.21.15.164:6818/295402697","cluster_addr":"172.21.15.164:6820/295402697","heartbeat_back_addr":"172.21.15.164:6827/295402697","heartbeat_front_addr":"172.21.15.164:6824/295402697","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.034807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.022201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.751897+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.850533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.083608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.047524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.314753+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.413586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T05:33:55.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.818+0000 7f9e8de00640 1 -- 172.21.15.123:0/2402679396 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f9e6406c8f0 msgr2=0x7f9e6406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:55.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.818+0000 7f9e8de00640 1 --2- 172.21.15.123:0/2402679396 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f9e6406c8f0 0x7f9e6406edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9e780075b0 tx=0x7f9e78007540 comp rx=0 tx=0).stop 2024-04-17T05:33:55.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.818+0000 7f9e8de00640 1 -- 172.21.15.123:0/2402679396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e8814b1d0 msgr2=0x7f9e88137df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:55.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.818+0000 7f9e8de00640 1 --2- 172.21.15.123:0/2402679396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e8814b1d0 0x7f9e88137df0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9e8000b490 tx=0x7f9e8000b950 comp rx=0 tx=0).stop 2024-04-17T05:33:55.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.818+0000 7f9e8de00640 1 -- 172.21.15.123:0/2402679396 shutdown_connections 2024-04-17T05:33:55.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.818+0000 7f9e8de00640 1 --2- 172.21.15.123:0/2402679396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e8814b1d0 0x7f9e88137df0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:55.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.818+0000 7f9e8de00640 1 --2- 172.21.15.123:0/2402679396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e880b7e90 0x7f9e880bbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:55.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.818+0000 7f9e8de00640 1 --2- 172.21.15.123:0/2402679396 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f9e6406c8f0 0x7f9e6406edb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:55.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.818+0000 7f9e8de00640 1 --2- 172.21.15.123:0/2402679396 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e880b58b0 0x7f9e8813fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:55.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.818+0000 7f9e8de00640 1 -- 172.21.15.123:0/2402679396 >> 172.21.15.123:0/2402679396 conn(0x7f9e880bd6f0 msgr2=0x7f9e880b8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:55.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.818+0000 7f9e8de00640 1 -- 172.21.15.123:0/2402679396 shutdown_connections 2024-04-17T05:33:55.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:55.819+0000 7f9e8de00640 1 -- 172.21.15.123:0/2402679396 wait complete. 2024-04-17T05:33:56.839 INFO:tasks.ceph:Scrubbing osd.0 2024-04-17T05:33:56.839 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-17T05:33:57.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.060+0000 7f89f0400640 1 Processor -- start 2024-04-17T05:33:57.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.060+0000 7f89f0400640 1 -- start start 2024-04-17T05:33:57.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.062+0000 7f89f0400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89e80b62d0 0x7f89e8148550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:57.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.062+0000 7f89f0400640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f89e81417e0 0x7f89e8141c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:57.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.062+0000 7f89f0400640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89e80b5c60 con 0x7f89e80b7e10 2024-04-17T05:33:57.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.062+0000 7f89f0400640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f89e81480c0 con 0x7f89e81417e0 2024-04-17T05:33:57.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.062+0000 7f89f0400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f89e80b4b00 con 0x7f89e80b62d0 2024-04-17T05:33:57.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.063+0000 7f89eda00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89e80b62d0 0x7f89e8148550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:57.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.063+0000 7f89ee400640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f89e81417e0 0x7f89e8141c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:57.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.063+0000 7f89eda00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89e80b62d0 0x7f89e8148550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.123:44540/0 (socket says 172.21.15.123:44540) 2024-04-17T05:33:57.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.063+0000 7f89eda00640 1 -- 172.21.15.123:0/1436793911 learned_addr learned my addr 172.21.15.123:0/1436793911 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:57.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.063+0000 7f89eda00640 1 -- 172.21.15.123:0/1436793911 >> v2:172.21.15.164:3300/0 conn(0x7f89e81417e0 msgr2=0x7f89e8141c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:57.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.063+0000 7f89eda00640 1 --2- 172.21.15.123:0/1436793911 >> v2:172.21.15.164:3300/0 conn(0x7f89e81417e0 0x7f89e8141c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:57.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.063+0000 7f89eda00640 1 -- 172.21.15.123:0/1436793911 >> v1:172.21.15.164:6789/0 conn(0x7f89e80b7e10 legacy=0x7f89e80b5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:57.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.063+0000 7f89eda00640 1 -- 172.21.15.123:0/1436793911 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e80b66b0 con 0x7f89e80b62d0 2024-04-17T05:33:57.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.065+0000 7f89eda00640 1 --2- 172.21.15.123:0/1436793911 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89e80b62d0 0x7f89e8148550 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f89dc009870 tx=0x7f89dc02b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61fd84360df1865e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:57.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.065+0000 7f89e7e00640 1 -- 172.21.15.123:0/1436793911 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89dc0317c0 con 0x7f89e80b62d0 2024-04-17T05:33:57.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.065+0000 7f89e7e00640 1 -- 172.21.15.123:0/1436793911 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89dc037070 con 0x7f89e80b62d0 2024-04-17T05:33:57.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.065+0000 7f89e7e00640 1 -- 172.21.15.123:0/1436793911 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89dc031b80 con 0x7f89e80b62d0 2024-04-17T05:33:57.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.066+0000 7f89f0400640 1 -- 172.21.15.123:0/1436793911 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89e80b62d0 msgr2=0x7f89e8148550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:57.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.066+0000 7f89f0400640 1 --2- 172.21.15.123:0/1436793911 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89e80b62d0 0x7f89e8148550 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f89dc009870 tx=0x7f89dc02b860 comp rx=0 tx=0).stop 2024-04-17T05:33:57.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.066+0000 7f89f0400640 1 -- 172.21.15.123:0/1436793911 shutdown_connections 2024-04-17T05:33:57.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.066+0000 7f89f0400640 1 --2- 172.21.15.123:0/1436793911 >> v2:172.21.15.164:3300/0 conn(0x7f89e81417e0 0x7f89e8141c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:57.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.066+0000 7f89f0400640 1 --2- 172.21.15.123:0/1436793911 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89e80b62d0 0x7f89e8148550 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:57.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.066+0000 7f89f0400640 1 -- 172.21.15.123:0/1436793911 >> 172.21.15.123:0/1436793911 conn(0x7f89e806c200 msgr2=0x7f89e80bd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:57.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.066+0000 7f89f0400640 1 -- 172.21.15.123:0/1436793911 shutdown_connections 2024-04-17T05:33:57.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.066+0000 7f89f0400640 1 -- 172.21.15.123:0/1436793911 wait complete. 2024-04-17T05:33:57.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.068+0000 7f89f0400640 1 Processor -- start 2024-04-17T05:33:57.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.068+0000 7f89f0400640 1 -- start start 2024-04-17T05:33:57.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.069+0000 7f89f0400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89e80b62d0 0x7f89e81d48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:57.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.069+0000 7f89f0400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89e80b7e10 0x7f89e81e0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:57.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.069+0000 7f89f0400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89e81417e0 0x7f89e81d12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:57.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.069+0000 7f89f0400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f89e81421d0 con 0x7f89e80b62d0 2024-04-17T05:33:57.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.069+0000 7f89f0400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f89e8148a90 con 0x7f89e81417e0 2024-04-17T05:33:57.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.069+0000 7f89f0400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f89e8142350 con 0x7f89e80b7e10 2024-04-17T05:33:57.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.069+0000 7f89eda00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89e80b62d0 0x7f89e81d48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:57.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.069+0000 7f89eda00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89e80b62d0 0x7f89e81d48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48960/0 (socket says 172.21.15.123:48960) 2024-04-17T05:33:57.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.069+0000 7f89eda00640 1 -- 172.21.15.123:0/1349825892 learned_addr learned my addr 172.21.15.123:0/1349825892 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:57.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.069+0000 7f89ed000640 1 --2- 172.21.15.123:0/1349825892 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89e80b7e10 0x7f89e81e0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:57.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.069+0000 7f89ee400640 1 --2- 172.21.15.123:0/1349825892 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89e81417e0 0x7f89e81d12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:57.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.069+0000 7f89eda00640 1 -- 172.21.15.123:0/1349825892 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89e80b7e10 msgr2=0x7f89e81e0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:57.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.069+0000 7f89eda00640 1 --2- 172.21.15.123:0/1349825892 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89e80b7e10 0x7f89e81e0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:57.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.070+0000 7f89eda00640 1 -- 172.21.15.123:0/1349825892 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89e81417e0 msgr2=0x7f89e81d12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:57.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.070+0000 7f89eda00640 1 --2- 172.21.15.123:0/1349825892 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89e81417e0 0x7f89e81d12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:57.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.070+0000 7f89eda00640 1 -- 172.21.15.123:0/1349825892 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e81d2ba0 con 0x7f89e80b62d0 2024-04-17T05:33:57.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.070+0000 7f89eda00640 1 --2- 172.21.15.123:0/1349825892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89e80b62d0 0x7f89e81d48c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f89dc02b8a0 tx=0x7f89dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:57.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.070+0000 7f89e5600640 1 -- 172.21.15.123:0/1349825892 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89dc032650 con 0x7f89e80b62d0 2024-04-17T05:33:57.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.070+0000 7f89e5600640 1 -- 172.21.15.123:0/1349825892 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89dc0327f0 con 0x7f89e80b62d0 2024-04-17T05:33:57.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.070+0000 7f89e5600640 1 -- 172.21.15.123:0/1349825892 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89dc032be0 con 0x7f89e80b62d0 2024-04-17T05:33:57.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.070+0000 7f89f0400640 1 -- 172.21.15.123:0/1349825892 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89e81d30a0 con 0x7f89e80b62d0 2024-04-17T05:33:57.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.070+0000 7f89f0400640 1 -- 172.21.15.123:0/1349825892 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89e81d4130 con 0x7f89e80b62d0 2024-04-17T05:33:57.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.071+0000 7f89f0400640 1 -- 172.21.15.123:0/1349825892 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f89e8068a40 con 0x7f89e80b62d0 2024-04-17T05:33:57.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.073+0000 7f89e5600640 1 -- 172.21.15.123:0/1349825892 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f89dc04c060 con 0x7f89e80b62d0 2024-04-17T05:33:57.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.074+0000 7f89e5600640 1 --2- 172.21.15.123:0/1349825892 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f89c806c8f0 0x7f89c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:57.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.074+0000 7f89e5600640 1 -- 172.21.15.123:0/1349825892 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f89dc0add50 con 0x7f89e80b62d0 2024-04-17T05:33:57.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.074+0000 7f89e5600640 1 --2- 172.21.15.123:0/1349825892 >> [v2:172.21.15.123:6800/840753170,v1:172.21.15.123:6801/840753170] conn(0x7f89c8076300 0x7f89c80787a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:57.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.074+0000 7f89e5600640 1 -- 172.21.15.123:0/1349825892 --> [v2:172.21.15.123:6800/840753170,v1:172.21.15.123:6801/840753170] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f89dc046e50 con 0x7f89c8076300 2024-04-17T05:33:57.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.074+0000 7f89e5600640 1 -- 172.21.15.123:0/1349825892 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f89dc077990 con 0x7f89e80b62d0 2024-04-17T05:33:57.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.074+0000 7f89ee400640 1 --2- 172.21.15.123:0/1349825892 >> [v2:172.21.15.123:6800/840753170,v1:172.21.15.123:6801/840753170] conn(0x7f89c8076300 0x7f89c80787a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:57.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.074+0000 7f89ed000640 1 --2- 172.21.15.123:0/1349825892 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f89c806c8f0 0x7f89c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:57.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.075+0000 7f89ee400640 1 --2- 172.21.15.123:0/1349825892 >> [v2:172.21.15.123:6800/840753170,v1:172.21.15.123:6801/840753170] conn(0x7f89c8076300 0x7f89c80787a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:57.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.076+0000 7f89ed000640 1 --2- 172.21.15.123:0/1349825892 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f89c806c8f0 0x7f89c806edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f89e81d1230 tx=0x7f89d4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:57.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.076+0000 7f89e5600640 1 -- 172.21.15.123:0/1349825892 <== osd.0 v2:172.21.15.123:6800/840753170 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f89dc046e50 con 0x7f89c8076300 2024-04-17T05:33:57.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.091+0000 7f89f0400640 1 -- 172.21.15.123:0/1349825892 --> [v2:172.21.15.123:6800/840753170,v1:172.21.15.123:6801/840753170] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f89e80b3f90 con 0x7f89c8076300 2024-04-17T05:33:57.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.092+0000 7f89e5600640 1 -- 172.21.15.123:0/1349825892 <== osd.0 v2:172.21.15.123:6800/840753170 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f89e80b3f90 con 0x7f89c8076300 2024-04-17T05:33:57.091 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-04-17T05:33:57.091 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T05:33:57.091 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-04-17T05:33:57.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.092+0000 7f89f0400640 1 -- 172.21.15.123:0/1349825892 >> [v2:172.21.15.123:6800/840753170,v1:172.21.15.123:6801/840753170] conn(0x7f89c8076300 msgr2=0x7f89c80787a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:57.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.092+0000 7f89f0400640 1 --2- 172.21.15.123:0/1349825892 >> [v2:172.21.15.123:6800/840753170,v1:172.21.15.123:6801/840753170] conn(0x7f89c8076300 0x7f89c80787a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:57.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.093+0000 7f89f0400640 1 -- 172.21.15.123:0/1349825892 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f89c806c8f0 msgr2=0x7f89c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:57.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.093+0000 7f89f0400640 1 --2- 172.21.15.123:0/1349825892 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f89c806c8f0 0x7f89c806edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f89e81d1230 tx=0x7f89d4009040 comp rx=0 tx=0).stop 2024-04-17T05:33:57.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.093+0000 7f89f0400640 1 -- 172.21.15.123:0/1349825892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89e80b62d0 msgr2=0x7f89e81d48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:57.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.093+0000 7f89f0400640 1 --2- 172.21.15.123:0/1349825892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89e80b62d0 0x7f89e81d48c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f89dc02b8a0 tx=0x7f89dc0046c0 comp rx=0 tx=0).stop 2024-04-17T05:33:57.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.093+0000 7f89ee400640 1 -- 172.21.15.123:0/1349825892 reap_dead start 2024-04-17T05:33:57.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.093+0000 7f89f0400640 1 -- 172.21.15.123:0/1349825892 shutdown_connections 2024-04-17T05:33:57.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.093+0000 7f89f0400640 1 -- 172.21.15.123:0/1349825892 >> 172.21.15.123:0/1349825892 conn(0x7f89e806c200 msgr2=0x7f89e8145f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:57.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.093+0000 7f89f0400640 1 -- 172.21.15.123:0/1349825892 shutdown_connections 2024-04-17T05:33:57.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.093+0000 7f89f0400640 1 -- 172.21.15.123:0/1349825892 wait complete. 2024-04-17T05:33:57.110 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-17T05:33:57.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.305+0000 7f09e3400640 1 Processor -- start 2024-04-17T05:33:57.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.305+0000 7f09e3400640 1 -- start start 2024-04-17T05:33:57.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.306+0000 7f09e3400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09dc09d630 0x7f09dc09da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:57.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.306+0000 7f09e3400640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f09dc142b30 0x7f09dc142fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:57.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.306+0000 7f09e3400640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09dc09cc30 con 0x7f09dc1492e0 2024-04-17T05:33:57.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.306+0000 7f09e3400640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f09dc09bcf0 con 0x7f09dc142b30 2024-04-17T05:33:57.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.306+0000 7f09e3400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f09dc09cea0 con 0x7f09dc09d630 2024-04-17T05:33:57.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.307+0000 7f09e1400640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f09dc142b30 0x7f09dc142fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:57.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.307+0000 7f09e0a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09dc09d630 0x7f09dc09da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:57.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.307+0000 7f09e0a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09dc09d630 0x7f09dc09da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.123:44556/0 (socket says 172.21.15.123:44556) 2024-04-17T05:33:57.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.307+0000 7f09e0a00640 1 -- 172.21.15.123:0/1875737373 learned_addr learned my addr 172.21.15.123:0/1875737373 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:57.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.307+0000 7f09e1400640 1 -- 172.21.15.123:0/1875737373 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09dc09d630 msgr2=0x7f09dc09da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:57.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.307+0000 7f09e1400640 1 --2- 172.21.15.123:0/1875737373 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09dc09d630 0x7f09dc09da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:57.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.308+0000 7f09e1400640 1 -- 172.21.15.123:0/1875737373 >> v1:172.21.15.164:6789/0 conn(0x7f09dc1492e0 legacy=0x7f09dc149740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:57.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.308+0000 7f09e1400640 1 -- 172.21.15.123:0/1875737373 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09dc09b3c0 con 0x7f09dc142b30 2024-04-17T05:33:57.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.309+0000 7f09e1400640 1 --2- 172.21.15.123:0/1875737373 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09dc142b30 0x7f09dc142fc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f09d4009d90 tx=0x7f09d402be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e815e81dcc1ff139 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:57.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.309+0000 7f09db400640 1 -- 172.21.15.123:0/1875737373 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d4039070 con 0x7f09dc142b30 2024-04-17T05:33:57.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.309+0000 7f09db400640 1 -- 172.21.15.123:0/1875737373 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09d402cbd0 con 0x7f09dc142b30 2024-04-17T05:33:57.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.309+0000 7f09db400640 1 -- 172.21.15.123:0/1875737373 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d4034440 con 0x7f09dc142b30 2024-04-17T05:33:57.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.310+0000 7f09e3400640 1 -- 172.21.15.123:0/1875737373 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09dc142b30 msgr2=0x7f09dc142fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:57.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.310+0000 7f09e3400640 1 --2- 172.21.15.123:0/1875737373 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09dc142b30 0x7f09dc142fc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f09d4009d90 tx=0x7f09d402be20 comp rx=0 tx=0).stop 2024-04-17T05:33:57.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.310+0000 7f09e3400640 1 -- 172.21.15.123:0/1875737373 shutdown_connections 2024-04-17T05:33:57.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.310+0000 7f09e3400640 1 --2- 172.21.15.123:0/1875737373 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09dc142b30 0x7f09dc142fc0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:57.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.310+0000 7f09e3400640 1 --2- 172.21.15.123:0/1875737373 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09dc09d630 0x7f09dc09da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:57.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.310+0000 7f09e3400640 1 -- 172.21.15.123:0/1875737373 >> 172.21.15.123:0/1875737373 conn(0x7f09dc0b93b0 msgr2=0x7f09dc0b97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:57.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.310+0000 7f09e3400640 1 -- 172.21.15.123:0/1875737373 shutdown_connections 2024-04-17T05:33:57.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.310+0000 7f09e3400640 1 -- 172.21.15.123:0/1875737373 wait complete. 2024-04-17T05:33:57.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.312+0000 7f09e3400640 1 Processor -- start 2024-04-17T05:33:57.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.312+0000 7f09e3400640 1 -- start start 2024-04-17T05:33:57.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.313+0000 7f09e3400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09dc09d630 0x7f09dc1e0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:57.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.313+0000 7f09e3400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09dc142b30 0x7f09dc1e1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:57.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.313+0000 7f09e3400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09dc1492e0 0x7f09dc143d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:57.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.313+0000 7f09e3400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f09dc0b5b10 con 0x7f09dc1492e0 2024-04-17T05:33:57.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.313+0000 7f09e3400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f09dc09b720 con 0x7f09dc09d630 2024-04-17T05:33:57.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.313+0000 7f09e3400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f09dc0b5c90 con 0x7f09dc142b30 2024-04-17T05:33:57.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.313+0000 7f09e1400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09dc1492e0 0x7f09dc143d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:57.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.313+0000 7f09e1400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09dc1492e0 0x7f09dc143d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48966/0 (socket says 172.21.15.123:48966) 2024-04-17T05:33:57.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.313+0000 7f09e1400640 1 -- 172.21.15.123:0/3318502805 learned_addr learned my addr 172.21.15.123:0/3318502805 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:57.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.313+0000 7f09e0a00640 1 --2- 172.21.15.123:0/3318502805 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09dc09d630 0x7f09dc1e0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:57.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.313+0000 7f09dbe00640 1 --2- 172.21.15.123:0/3318502805 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09dc142b30 0x7f09dc1e1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:57.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.314+0000 7f09e1400640 1 -- 172.21.15.123:0/3318502805 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09dc142b30 msgr2=0x7f09dc1e1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:57.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.314+0000 7f09e1400640 1 --2- 172.21.15.123:0/3318502805 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09dc142b30 0x7f09dc1e1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:57.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.314+0000 7f09e1400640 1 -- 172.21.15.123:0/3318502805 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09dc09d630 msgr2=0x7f09dc1e0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:57.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.314+0000 7f09e1400640 1 --2- 172.21.15.123:0/3318502805 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09dc09d630 0x7f09dc1e0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:57.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.314+0000 7f09e1400640 1 -- 172.21.15.123:0/3318502805 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09dc145660 con 0x7f09dc1492e0 2024-04-17T05:33:57.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.314+0000 7f09e1400640 1 --2- 172.21.15.123:0/3318502805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09dc1492e0 0x7f09dc143d00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f09d4009d90 tx=0x7f09d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:57.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.314+0000 7f09d8c00640 1 -- 172.21.15.123:0/3318502805 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d4039050 con 0x7f09dc1492e0 2024-04-17T05:33:57.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.314+0000 7f09d8c00640 1 -- 172.21.15.123:0/3318502805 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09d4045070 con 0x7f09dc1492e0 2024-04-17T05:33:57.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.314+0000 7f09e3400640 1 -- 172.21.15.123:0/3318502805 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09dc1e1790 con 0x7f09dc1492e0 2024-04-17T05:33:57.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.314+0000 7f09d8c00640 1 -- 172.21.15.123:0/3318502805 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d403e830 con 0x7f09dc1492e0 2024-04-17T05:33:57.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.315+0000 7f09e3400640 1 -- 172.21.15.123:0/3318502805 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09dc145900 con 0x7f09dc1492e0 2024-04-17T05:33:57.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.316+0000 7f09e3400640 1 -- 172.21.15.123:0/3318502805 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09dc068a40 con 0x7f09dc1492e0 2024-04-17T05:33:57.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.317+0000 7f09d8c00640 1 -- 172.21.15.123:0/3318502805 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f09d403e9d0 con 0x7f09dc1492e0 2024-04-17T05:33:57.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.318+0000 7f09d8c00640 1 --2- 172.21.15.123:0/3318502805 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f09bc06c8f0 0x7f09bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:57.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.318+0000 7f09d8c00640 1 -- 172.21.15.123:0/3318502805 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f09d40aec50 con 0x7f09dc1492e0 2024-04-17T05:33:57.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.318+0000 7f09e0a00640 1 --2- 172.21.15.123:0/3318502805 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f09bc06c8f0 0x7f09bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:57.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.319+0000 7f09e0a00640 1 --2- 172.21.15.123:0/3318502805 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f09bc06c8f0 0x7f09bc06edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f09d0009bd0 tx=0x7f09d0009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:57.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.322+0000 7f09d8c00640 1 -- 172.21.15.123:0/3318502805 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f09d40b4020 con 0x7f09dc1492e0 2024-04-17T05:33:57.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.525+0000 7f09e3400640 1 -- 172.21.15.123:0/3318502805 --> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f09dc145ad0 con 0x7f09bc06c8f0 2024-04-17T05:33:57.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.526+0000 7f09d8c00640 1 -- 172.21.15.123:0/3318502805 <== mgr.4103 v2:172.21.15.164:6832/4204006015 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f09dc145ad0 con 0x7f09bc06c8f0 2024-04-17T05:33:57.525 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 0 to deep-scrub 2024-04-17T05:33:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.530+0000 7f09e3400640 1 -- 172.21.15.123:0/3318502805 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f09bc06c8f0 msgr2=0x7f09bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.530+0000 7f09e3400640 1 --2- 172.21.15.123:0/3318502805 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f09bc06c8f0 0x7f09bc06edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f09d0009bd0 tx=0x7f09d0009240 comp rx=0 tx=0).stop 2024-04-17T05:33:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.530+0000 7f09e3400640 1 -- 172.21.15.123:0/3318502805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09dc1492e0 msgr2=0x7f09dc143d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.530+0000 7f09e3400640 1 --2- 172.21.15.123:0/3318502805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09dc1492e0 0x7f09dc143d00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f09d4009d90 tx=0x7f09d4004a40 comp rx=0 tx=0).stop 2024-04-17T05:33:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.530+0000 7f09e3400640 1 -- 172.21.15.123:0/3318502805 shutdown_connections 2024-04-17T05:33:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.530+0000 7f09e3400640 1 --2- 172.21.15.123:0/3318502805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09dc1492e0 0x7f09dc143d00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.530+0000 7f09e3400640 1 --2- 172.21.15.123:0/3318502805 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f09bc06c8f0 0x7f09bc06edb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.530+0000 7f09e3400640 1 --2- 172.21.15.123:0/3318502805 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f09dc142b30 0x7f09dc1e1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.530+0000 7f09e3400640 1 --2- 172.21.15.123:0/3318502805 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f09dc09d630 0x7f09dc1e0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:57.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.530+0000 7f09e3400640 1 -- 172.21.15.123:0/3318502805 >> 172.21.15.123:0/3318502805 conn(0x7f09dc0b93b0 msgr2=0x7f09dc0b3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:57.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.530+0000 7f09e3400640 1 -- 172.21.15.123:0/3318502805 shutdown_connections 2024-04-17T05:33:57.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.530+0000 7f09e3400640 1 -- 172.21.15.123:0/3318502805 wait complete. 2024-04-17T05:33:57.546 INFO:tasks.ceph:Scrubbing osd.1 2024-04-17T05:33:57.546 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-17T05:33:57.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.740+0000 7f1627000640 1 Processor -- start 2024-04-17T05:33:57.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.740+0000 7f1627000640 1 -- start start 2024-04-17T05:33:57.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.741+0000 7f1627000640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f1620070e60 0x7f162013f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:57.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.741+0000 7f1627000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f16200b50a0 0x7f162013fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:57.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.742+0000 7f1627000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f162013ff80 con 0x7f16200b2ce0 2024-04-17T05:33:57.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.742+0000 7f1627000640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f16200b5bd0 con 0x7f16200b50a0 2024-04-17T05:33:57.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.742+0000 7f1627000640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f1620071dd0 con 0x7f1620070e60 2024-04-17T05:33:57.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.742+0000 7f161fe00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f16200b2ce0 0x7f1620149050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59146/0 (socket says 172.21.15.123:59146) 2024-04-17T05:33:57.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.742+0000 7f161fe00640 1 -- 172.21.15.123:0/1666078380 learned_addr learned my addr 172.21.15.123:0/1666078380 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:33:57.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.742+0000 7f1625000640 1 --2- 172.21.15.123:0/1666078380 >> v2:172.21.15.123:3300/0 conn(0x7f16200b50a0 0x7f162013fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:57.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.742+0000 7f1617e00640 1 --2- 172.21.15.123:0/1666078380 >> v2:172.21.15.164:3300/0 conn(0x7f1620070e60 0x7f162013f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:57.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.742+0000 7f161f400640 1 -- 172.21.15.123:0/1666078380 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3511977924 0 0) 0x7f162013ff80 con 0x7f16200b2ce0 2024-04-17T05:33:57.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.742+0000 7f161f400640 1 -- 172.21.15.123:0/1666078380 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1604003520 con 0x7f16200b2ce0 2024-04-17T05:33:57.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.743+0000 7f1625000640 1 -- 172.21.15.123:0/1666078380 >> v2:172.21.15.164:3300/0 conn(0x7f1620070e60 msgr2=0x7f162013f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:57.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.743+0000 7f1625000640 1 --2- 172.21.15.123:0/1666078380 >> v2:172.21.15.164:3300/0 conn(0x7f1620070e60 0x7f162013f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:57.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.743+0000 7f1625000640 1 -- 172.21.15.123:0/1666078380 >> v1:172.21.15.123:6789/0 conn(0x7f16200b2ce0 legacy=0x7f1620149050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:57.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.743+0000 7f161f400640 1 -- 172.21.15.123:0/1666078380 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4221795222 0 0) 0x7f1604003520 con 0x7f16200b2ce0 2024-04-17T05:33:57.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.743+0000 7f1625000640 1 -- 172.21.15.123:0/1666078380 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16200b30c0 con 0x7f16200b50a0 2024-04-17T05:33:57.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.744+0000 7f1625000640 1 --2- 172.21.15.123:0/1666078380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16200b50a0 0x7f162013fa40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f16200713e0 tx=0x7f161802bd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7096d07038434c1b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:57.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.744+0000 7f161f400640 1 -- 172.21.15.123:0/1666078380 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1618039070 con 0x7f16200b50a0 2024-04-17T05:33:57.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.744+0000 7f161f400640 1 -- 172.21.15.123:0/1666078380 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f161802c830 con 0x7f16200b50a0 2024-04-17T05:33:57.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.744+0000 7f161f400640 1 -- 172.21.15.123:0/1666078380 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1610001670 con 0x7f16200b50a0 2024-04-17T05:33:57.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.745+0000 7f1627000640 1 -- 172.21.15.123:0/1666078380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16200b50a0 msgr2=0x7f162013fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:57.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.745+0000 7f1627000640 1 --2- 172.21.15.123:0/1666078380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16200b50a0 0x7f162013fa40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f16200713e0 tx=0x7f161802bd00 comp rx=0 tx=0).stop 2024-04-17T05:33:57.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.745+0000 7f1627000640 1 -- 172.21.15.123:0/1666078380 shutdown_connections 2024-04-17T05:33:57.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.745+0000 7f1627000640 1 --2- 172.21.15.123:0/1666078380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16200b50a0 0x7f162013fa40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:57.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.745+0000 7f1627000640 1 --2- 172.21.15.123:0/1666078380 >> v2:172.21.15.164:3300/0 conn(0x7f1620070e60 0x7f162013f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:57.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.745+0000 7f1627000640 1 -- 172.21.15.123:0/1666078380 >> 172.21.15.123:0/1666078380 conn(0x7f16200b9360 msgr2=0x7f16200b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:57.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.745+0000 7f1627000640 1 -- 172.21.15.123:0/1666078380 shutdown_connections 2024-04-17T05:33:57.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.745+0000 7f1627000640 1 -- 172.21.15.123:0/1666078380 wait complete. 2024-04-17T05:33:57.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.747+0000 7f1627000640 1 Processor -- start 2024-04-17T05:33:57.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.747+0000 7f1627000640 1 -- start start 2024-04-17T05:33:57.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.748+0000 7f1627000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16200b2ce0 0x7f16200b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:57.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.748+0000 7f1627000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16200b50a0 0x7f16201dd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:57.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.748+0000 7f1627000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16201ddd80 0x7f162013cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:57.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.748+0000 7f1627000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f16200b5860 con 0x7f16200b50a0 2024-04-17T05:33:57.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.748+0000 7f1627000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f16200b5580 con 0x7f16200b2ce0 2024-04-17T05:33:57.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.748+0000 7f1627000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f1620149760 con 0x7f16201ddd80 2024-04-17T05:33:57.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.748+0000 7f1617e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16200b50a0 0x7f16201dd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:57.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.748+0000 7f1617e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16200b50a0 0x7f16201dd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48990/0 (socket says 172.21.15.123:48990) 2024-04-17T05:33:57.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.748+0000 7f1617e00640 1 -- 172.21.15.123:0/642548190 learned_addr learned my addr 172.21.15.123:0/642548190 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:57.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.748+0000 7f161fe00640 1 --2- 172.21.15.123:0/642548190 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16200b2ce0 0x7f16200b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:57.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.748+0000 7f1625000640 1 --2- 172.21.15.123:0/642548190 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16201ddd80 0x7f162013cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:57.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.748+0000 7f1617e00640 1 -- 172.21.15.123:0/642548190 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16201ddd80 msgr2=0x7f162013cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:57.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.748+0000 7f1617e00640 1 --2- 172.21.15.123:0/642548190 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16201ddd80 0x7f162013cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:57.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.748+0000 7f1617e00640 1 -- 172.21.15.123:0/642548190 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16200b2ce0 msgr2=0x7f16200b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:57.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.748+0000 7f1617e00640 1 --2- 172.21.15.123:0/642548190 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f16200b2ce0 0x7f16200b1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:57.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.748+0000 7f1617e00640 1 -- 172.21.15.123:0/642548190 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1620140280 con 0x7f16200b50a0 2024-04-17T05:33:57.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.749+0000 7f1617e00640 1 --2- 172.21.15.123:0/642548190 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16200b50a0 0x7f16201dd840 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f160800e9b0 tx=0x7f160800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:57.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.749+0000 7f161cc00640 1 -- 172.21.15.123:0/642548190 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1608017070 con 0x7f16200b50a0 2024-04-17T05:33:57.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.749+0000 7f161cc00640 1 -- 172.21.15.123:0/642548190 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f160800c9a0 con 0x7f16200b50a0 2024-04-17T05:33:57.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.749+0000 7f1627000640 1 -- 172.21.15.123:0/642548190 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1620141480 con 0x7f16200b50a0 2024-04-17T05:33:57.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.749+0000 7f161cc00640 1 -- 172.21.15.123:0/642548190 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160800cd90 con 0x7f16200b50a0 2024-04-17T05:33:57.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.749+0000 7f1627000640 1 -- 172.21.15.123:0/642548190 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16200b2500 con 0x7f16200b50a0 2024-04-17T05:33:57.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.750+0000 7f1627000640 1 -- 172.21.15.123:0/642548190 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1620141230 con 0x7f16200b50a0 2024-04-17T05:33:57.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.751+0000 7f161cc00640 1 -- 172.21.15.123:0/642548190 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f160801a070 con 0x7f16200b50a0 2024-04-17T05:33:57.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.752+0000 7f161cc00640 1 --2- 172.21.15.123:0/642548190 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f15fc06c8f0 0x7f15fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:57.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.752+0000 7f161cc00640 1 -- 172.21.15.123:0/642548190 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f160808bef0 con 0x7f16200b50a0 2024-04-17T05:33:57.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.753+0000 7f161cc00640 1 --2- 172.21.15.123:0/642548190 >> [v2:172.21.15.123:6819/2231878927,v1:172.21.15.123:6822/2231878927] conn(0x7f15fc076380 0x7f15fc078820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:57.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.753+0000 7f161cc00640 1 -- 172.21.15.123:0/642548190 --> [v2:172.21.15.123:6819/2231878927,v1:172.21.15.123:6822/2231878927] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f15fc078ef0 con 0x7f15fc076380 2024-04-17T05:33:57.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.753+0000 7f161cc00640 1 -- 172.21.15.123:0/642548190 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f160808e5f0 con 0x7f16200b50a0 2024-04-17T05:33:57.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.753+0000 7f161fe00640 1 --2- 172.21.15.123:0/642548190 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f15fc06c8f0 0x7f15fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:57.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.753+0000 7f1625000640 1 --2- 172.21.15.123:0/642548190 >> [v2:172.21.15.123:6819/2231878927,v1:172.21.15.123:6822/2231878927] conn(0x7f15fc076380 0x7f15fc078820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:57.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.754+0000 7f1625000640 1 --2- 172.21.15.123:0/642548190 >> [v2:172.21.15.123:6819/2231878927,v1:172.21.15.123:6822/2231878927] conn(0x7f15fc076380 0x7f15fc078820 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:57.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.754+0000 7f161fe00640 1 --2- 172.21.15.123:0/642548190 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f15fc06c8f0 0x7f15fc06edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f16100011e0 tx=0x7f1610009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:57.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.754+0000 7f161cc00640 1 -- 172.21.15.123:0/642548190 <== osd.1 v2:172.21.15.123:6819/2231878927 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f15fc078ef0 con 0x7f15fc076380 2024-04-17T05:33:57.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.769+0000 7f1627000640 1 -- 172.21.15.123:0/642548190 --> [v2:172.21.15.123:6819/2231878927,v1:172.21.15.123:6822/2231878927] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1620068a40 con 0x7f15fc076380 2024-04-17T05:33:57.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.770+0000 7f161cc00640 1 -- 172.21.15.123:0/642548190 <== osd.1 v2:172.21.15.123:6819/2231878927 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1620068a40 con 0x7f15fc076380 2024-04-17T05:33:57.769 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-04-17T05:33:57.769 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T05:33:57.769 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-04-17T05:33:57.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.770+0000 7f1627000640 1 -- 172.21.15.123:0/642548190 >> [v2:172.21.15.123:6819/2231878927,v1:172.21.15.123:6822/2231878927] conn(0x7f15fc076380 msgr2=0x7f15fc078820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:57.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.770+0000 7f1627000640 1 --2- 172.21.15.123:0/642548190 >> [v2:172.21.15.123:6819/2231878927,v1:172.21.15.123:6822/2231878927] conn(0x7f15fc076380 0x7f15fc078820 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:57.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.770+0000 7f1627000640 1 -- 172.21.15.123:0/642548190 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f15fc06c8f0 msgr2=0x7f15fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:57.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.770+0000 7f1627000640 1 --2- 172.21.15.123:0/642548190 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f15fc06c8f0 0x7f15fc06edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f16100011e0 tx=0x7f1610009040 comp rx=0 tx=0).stop 2024-04-17T05:33:57.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.770+0000 7f1627000640 1 -- 172.21.15.123:0/642548190 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16200b50a0 msgr2=0x7f16201dd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:57.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.770+0000 7f1627000640 1 --2- 172.21.15.123:0/642548190 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16200b50a0 0x7f16201dd840 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f160800e9b0 tx=0x7f160800ee70 comp rx=0 tx=0).stop 2024-04-17T05:33:57.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.770+0000 7f1625000640 1 -- 172.21.15.123:0/642548190 reap_dead start 2024-04-17T05:33:57.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.770+0000 7f1627000640 1 -- 172.21.15.123:0/642548190 shutdown_connections 2024-04-17T05:33:57.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.770+0000 7f1627000640 1 -- 172.21.15.123:0/642548190 >> 172.21.15.123:0/642548190 conn(0x7f16200b9360 msgr2=0x7f162013e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:57.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.770+0000 7f1627000640 1 -- 172.21.15.123:0/642548190 shutdown_connections 2024-04-17T05:33:57.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.770+0000 7f1627000640 1 -- 172.21.15.123:0/642548190 wait complete. 2024-04-17T05:33:57.786 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-17T05:33:57.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.993+0000 7fbdf6800640 1 Processor -- start 2024-04-17T05:33:57.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.993+0000 7fbdf6800640 1 -- start start 2024-04-17T05:33:57.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.995+0000 7fbdf6800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbdf006d040 0x7fbdf009c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:57.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.995+0000 7fbdf6800640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fbdf00ae7b0 0x7fbdf009ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:57.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.995+0000 7fbdf6800640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdf006d420 con 0x7fbdf009d3d0 2024-04-17T05:33:57.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.995+0000 7fbdf6800640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fbdf00afe90 con 0x7fbdf006d040 2024-04-17T05:33:57.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.995+0000 7fbdf6800640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7fbdf00b03a0 con 0x7fbdf00ae7b0 2024-04-17T05:33:57.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.995+0000 7fbdf5400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbdf006d040 0x7fbdf009c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:57.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.995+0000 7fbdf5400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbdf006d040 0x7fbdf009c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49000/0 (socket says 172.21.15.123:49000) 2024-04-17T05:33:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.995+0000 7fbdf5400640 1 -- 172.21.15.123:0/2428173285 learned_addr learned my addr 172.21.15.123:0/2428173285 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.995+0000 7fbdf4a00640 1 --2- 172.21.15.123:0/2428173285 >> v2:172.21.15.164:3300/0 conn(0x7fbdf00ae7b0 0x7fbdf009ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.995+0000 7fbdf5400640 1 -- 172.21.15.123:0/2428173285 >> v2:172.21.15.164:3300/0 conn(0x7fbdf00ae7b0 msgr2=0x7fbdf009ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.995+0000 7fbdf5400640 1 --2- 172.21.15.123:0/2428173285 >> v2:172.21.15.164:3300/0 conn(0x7fbdf00ae7b0 0x7fbdf009ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.995+0000 7fbdf5400640 1 -- 172.21.15.123:0/2428173285 >> v1:172.21.15.164:6789/0 conn(0x7fbdf009d3d0 legacy=0x7fbdf0148090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.995+0000 7fbdf5400640 1 -- 172.21.15.123:0/2428173285 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdf00af720 con 0x7fbdf006d040 2024-04-17T05:33:57.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.996+0000 7fbdf5400640 1 --2- 172.21.15.123:0/2428173285 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdf006d040 0x7fbdf009c2f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0149150 tx=0x7fbde402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebca5bd1357e4169 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:57.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.997+0000 7fbdefe00640 1 -- 172.21.15.123:0/2428173285 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde402e070 con 0x7fbdf006d040 2024-04-17T05:33:57.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.997+0000 7fbdefe00640 1 -- 172.21.15.123:0/2428173285 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbde4037070 con 0x7fbdf006d040 2024-04-17T05:33:57.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.997+0000 7fbdefe00640 1 -- 172.21.15.123:0/2428173285 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde4031a00 con 0x7fbdf006d040 2024-04-17T05:33:57.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.997+0000 7fbdf6800640 1 -- 172.21.15.123:0/2428173285 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdf006d040 msgr2=0x7fbdf009c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:57.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.997+0000 7fbdf6800640 1 --2- 172.21.15.123:0/2428173285 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdf006d040 0x7fbdf009c2f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0149150 tx=0x7fbde402b880 comp rx=0 tx=0).stop 2024-04-17T05:33:57.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.998+0000 7fbdf6800640 1 -- 172.21.15.123:0/2428173285 shutdown_connections 2024-04-17T05:33:57.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.998+0000 7fbdf6800640 1 --2- 172.21.15.123:0/2428173285 >> v2:172.21.15.164:3300/0 conn(0x7fbdf00ae7b0 0x7fbdf009ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:57.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.998+0000 7fbdf6800640 1 --2- 172.21.15.123:0/2428173285 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdf006d040 0x7fbdf009c2f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:57.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.998+0000 7fbdf6800640 1 -- 172.21.15.123:0/2428173285 >> 172.21.15.123:0/2428173285 conn(0x7fbdf006c430 msgr2=0x7fbdf00b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:57.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.998+0000 7fbdf6800640 1 -- 172.21.15.123:0/2428173285 shutdown_connections 2024-04-17T05:33:57.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.998+0000 7fbdf6800640 1 -- 172.21.15.123:0/2428173285 wait complete. 2024-04-17T05:33:58.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.999+0000 7fbdf6800640 1 Processor -- start 2024-04-17T05:33:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:57.999+0000 7fbdf6800640 1 -- start start 2024-04-17T05:33:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.000+0000 7fbdf6800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbdf006d040 0x7fbdf0072940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.000+0000 7fbdf6800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbdf009d3d0 0x7fbdf00716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.000+0000 7fbdf6800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdf0070580 0x7fbdf0070a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.000+0000 7fbdf6800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf009c830 con 0x7fbdf0070580 2024-04-17T05:33:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.000+0000 7fbdf6800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf00ae290 con 0x7fbdf009d3d0 2024-04-17T05:33:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.000+0000 7fbdf6800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fbdf00b3270 con 0x7fbdf006d040 2024-04-17T05:33:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.000+0000 7fbdf5e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdf0070580 0x7fbdf0070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.000+0000 7fbdf5e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdf0070580 0x7fbdf0070a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49014/0 (socket says 172.21.15.123:49014) 2024-04-17T05:33:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.001+0000 7fbdf5e00640 1 -- 172.21.15.123:0/147231456 learned_addr learned my addr 172.21.15.123:0/147231456 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.001+0000 7fbdf5400640 1 --2- 172.21.15.123:0/147231456 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbdf006d040 0x7fbdf0072940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.001+0000 7fbdf4a00640 1 --2- 172.21.15.123:0/147231456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbdf009d3d0 0x7fbdf00716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.001+0000 7fbdf5e00640 1 -- 172.21.15.123:0/147231456 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbdf006d040 msgr2=0x7fbdf0072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:58.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.001+0000 7fbdf5e00640 1 --2- 172.21.15.123:0/147231456 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbdf006d040 0x7fbdf0072940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:58.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.001+0000 7fbdf5e00640 1 -- 172.21.15.123:0/147231456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbdf009d3d0 msgr2=0x7fbdf00716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:58.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.001+0000 7fbdf5e00640 1 --2- 172.21.15.123:0/147231456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbdf009d3d0 0x7fbdf00716a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:58.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.001+0000 7fbdf5e00640 1 -- 172.21.15.123:0/147231456 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdf0071ed0 con 0x7fbdf0070580 2024-04-17T05:33:58.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.001+0000 7fbdf4a00640 1 --2- 172.21.15.123:0/147231456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbdf009d3d0 0x7fbdf00716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:33:58.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.001+0000 7fbdf5e00640 1 --2- 172.21.15.123:0/147231456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdf0070580 0x7fbdf0070a00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbde800c780 tx=0x7fbde800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:58.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.001+0000 7fbded600640 1 -- 172.21.15.123:0/147231456 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde8017070 con 0x7fbdf0070580 2024-04-17T05:33:58.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.001+0000 7fbded600640 1 -- 172.21.15.123:0/147231456 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbde8003da0 con 0x7fbdf0070580 2024-04-17T05:33:58.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.001+0000 7fbded600640 1 -- 172.21.15.123:0/147231456 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde80052b0 con 0x7fbdf0070580 2024-04-17T05:33:58.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.002+0000 7fbdf6800640 1 -- 172.21.15.123:0/147231456 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdf0071be0 con 0x7fbdf0070580 2024-04-17T05:33:58.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.002+0000 7fbdf6800640 1 -- 172.21.15.123:0/147231456 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdf01e0930 con 0x7fbdf0070580 2024-04-17T05:33:58.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.003+0000 7fbdf6800640 1 -- 172.21.15.123:0/147231456 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdf0075b30 con 0x7fbdf0070580 2024-04-17T05:33:58.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.004+0000 7fbded600640 1 -- 172.21.15.123:0/147231456 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbde8005450 con 0x7fbdf0070580 2024-04-17T05:33:58.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.005+0000 7fbded600640 1 --2- 172.21.15.123:0/147231456 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fbdd006c920 0x7fbdd006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:58.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.005+0000 7fbded600640 1 -- 172.21.15.123:0/147231456 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fbde808b440 con 0x7fbdf0070580 2024-04-17T05:33:58.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.005+0000 7fbdf5400640 1 --2- 172.21.15.123:0/147231456 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fbdd006c920 0x7fbdd006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:58.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.007+0000 7fbdf5400640 1 --2- 172.21.15.123:0/147231456 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fbdd006c920 0x7fbdd006ede0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbde4036000 tx=0x7fbde403d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:58.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.010+0000 7fbded600640 1 -- 172.21.15.123:0/147231456 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fbde8059440 con 0x7fbdf0070580 2024-04-17T05:33:58.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.212+0000 7fbdf6800640 1 -- 172.21.15.123:0/147231456 --> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fbdf00b36e0 con 0x7fbdd006c920 2024-04-17T05:33:58.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.213+0000 7fbded600640 1 -- 172.21.15.123:0/147231456 <== mgr.4103 v2:172.21.15.164:6832/4204006015 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbdf00b36e0 con 0x7fbdd006c920 2024-04-17T05:33:58.212 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 1 to deep-scrub 2024-04-17T05:33:58.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.216+0000 7fbdf6800640 1 -- 172.21.15.123:0/147231456 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fbdd006c920 msgr2=0x7fbdd006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:58.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.216+0000 7fbdf6800640 1 --2- 172.21.15.123:0/147231456 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fbdd006c920 0x7fbdd006ede0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbde4036000 tx=0x7fbde403d040 comp rx=0 tx=0).stop 2024-04-17T05:33:58.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.216+0000 7fbdf6800640 1 -- 172.21.15.123:0/147231456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdf0070580 msgr2=0x7fbdf0070a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:58.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.216+0000 7fbdf6800640 1 --2- 172.21.15.123:0/147231456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdf0070580 0x7fbdf0070a00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbde800c780 tx=0x7fbde800cc40 comp rx=0 tx=0).stop 2024-04-17T05:33:58.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.216+0000 7fbdf6800640 1 -- 172.21.15.123:0/147231456 shutdown_connections 2024-04-17T05:33:58.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.216+0000 7fbdf6800640 1 --2- 172.21.15.123:0/147231456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdf0070580 0x7fbdf0070a00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:58.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.216+0000 7fbdf6800640 1 --2- 172.21.15.123:0/147231456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbdf009d3d0 0x7fbdf00716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:58.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.216+0000 7fbdf6800640 1 --2- 172.21.15.123:0/147231456 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fbdd006c920 0x7fbdd006ede0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:58.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.216+0000 7fbdf6800640 1 --2- 172.21.15.123:0/147231456 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbdf006d040 0x7fbdf0072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:58.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.216+0000 7fbdf6800640 1 -- 172.21.15.123:0/147231456 >> 172.21.15.123:0/147231456 conn(0x7fbdf006c430 msgr2=0x7fbdf00b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:58.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.217+0000 7fbdf6800640 1 -- 172.21.15.123:0/147231456 shutdown_connections 2024-04-17T05:33:58.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.217+0000 7fbdf6800640 1 -- 172.21.15.123:0/147231456 wait complete. 2024-04-17T05:33:58.233 INFO:tasks.ceph:Scrubbing osd.2 2024-04-17T05:33:58.233 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-17T05:33:58.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.429+0000 7fc557a00640 1 Processor -- start 2024-04-17T05:33:58.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.429+0000 7fc557a00640 1 -- start start 2024-04-17T05:33:58.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.430+0000 7fc557a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc550070e60 0x7fc55013f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:58.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.430+0000 7fc557a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5500b50a0 0x7fc55013fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:58.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.430+0000 7fc557a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc55013ff80 con 0x7fc5500b2ce0 2024-04-17T05:33:58.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.430+0000 7fc557a00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc5500b5bd0 con 0x7fc550070e60 2024-04-17T05:33:58.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.430+0000 7fc557a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fc550071dd0 con 0x7fc5500b50a0 2024-04-17T05:33:58.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.431+0000 7fc54fe00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc550070e60 0x7fc55013f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:58.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.431+0000 7fc555000640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc5500b2ce0 0x7fc550149050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59148/0 (socket says 172.21.15.123:59148) 2024-04-17T05:33:58.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.431+0000 7fc555000640 1 -- 172.21.15.123:0/2642258261 learned_addr learned my addr 172.21.15.123:0/2642258261 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:33:58.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.431+0000 7fc555a00640 1 --2- 172.21.15.123:0/2642258261 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5500b50a0 0x7fc55013fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:58.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.431+0000 7fc54fe00640 1 -- 172.21.15.123:0/2642258261 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5500b50a0 msgr2=0x7fc55013fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:58.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.431+0000 7fc54fe00640 1 --2- 172.21.15.123:0/2642258261 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5500b50a0 0x7fc55013fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:58.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.431+0000 7fc54fe00640 1 -- 172.21.15.123:0/2642258261 >> v1:172.21.15.123:6789/0 conn(0x7fc5500b2ce0 legacy=0x7fc550149050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:58.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.431+0000 7fc54fe00640 1 -- 172.21.15.123:0/2642258261 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5500b30c0 con 0x7fc550070e60 2024-04-17T05:33:58.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.431+0000 7fc54f400640 1 -- 172.21.15.123:0/2642258261 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1601491895 0 0) 0x7fc55013ff80 con 0x7fc5500b2ce0 2024-04-17T05:33:58.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.433+0000 7fc54fe00640 1 --2- 172.21.15.123:0/2642258261 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc550070e60 0x7fc55013f500 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc53c0097a0 tx=0x7fc53c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29afbd497aaa01ce server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:58.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.433+0000 7fc54f400640 1 -- 172.21.15.123:0/2642258261 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c0315a0 con 0x7fc550070e60 2024-04-17T05:33:58.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.433+0000 7fc54f400640 1 -- 172.21.15.123:0/2642258261 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc53c037070 con 0x7fc550070e60 2024-04-17T05:33:58.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.433+0000 7fc54f400640 1 -- 172.21.15.123:0/2642258261 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c031960 con 0x7fc550070e60 2024-04-17T05:33:58.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.433+0000 7fc557a00640 1 -- 172.21.15.123:0/2642258261 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc550070e60 msgr2=0x7fc55013f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:58.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.433+0000 7fc557a00640 1 --2- 172.21.15.123:0/2642258261 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc550070e60 0x7fc55013f500 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc53c0097a0 tx=0x7fc53c02b840 comp rx=0 tx=0).stop 2024-04-17T05:33:58.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.434+0000 7fc557a00640 1 -- 172.21.15.123:0/2642258261 shutdown_connections 2024-04-17T05:33:58.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.434+0000 7fc557a00640 1 --2- 172.21.15.123:0/2642258261 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5500b50a0 0x7fc55013fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:58.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.434+0000 7fc557a00640 1 --2- 172.21.15.123:0/2642258261 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc550070e60 0x7fc55013f500 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:58.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.434+0000 7fc557a00640 1 -- 172.21.15.123:0/2642258261 >> 172.21.15.123:0/2642258261 conn(0x7fc5500b9360 msgr2=0x7fc5500b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:58.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.434+0000 7fc557a00640 1 -- 172.21.15.123:0/2642258261 shutdown_connections 2024-04-17T05:33:58.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.434+0000 7fc557a00640 1 -- 172.21.15.123:0/2642258261 wait complete. 2024-04-17T05:33:58.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.435+0000 7fc557a00640 1 Processor -- start 2024-04-17T05:33:58.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.435+0000 7fc557a00640 1 -- start start 2024-04-17T05:33:58.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.436+0000 7fc557a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5500b2ce0 0x7fc5500b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:58.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.436+0000 7fc557a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5500b50a0 0x7fc5500ae300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:58.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.436+0000 7fc557a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5500ae840 0x7fc5501dd650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:58.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.436+0000 7fc557a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc5500b5860 con 0x7fc5500ae840 2024-04-17T05:33:58.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.436+0000 7fc557a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc5500b5580 con 0x7fc5500b50a0 2024-04-17T05:33:58.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.436+0000 7fc557a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fc550149760 con 0x7fc5500b2ce0 2024-04-17T05:33:58.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.436+0000 7fc555a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5500ae840 0x7fc5501dd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:58.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.436+0000 7fc555a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5500ae840 0x7fc5501dd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49026/0 (socket says 172.21.15.123:49026) 2024-04-17T05:33:58.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.436+0000 7fc555a00640 1 -- 172.21.15.123:0/2773074337 learned_addr learned my addr 172.21.15.123:0/2773074337 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:58.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.437+0000 7fc555000640 1 --2- 172.21.15.123:0/2773074337 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5500b2ce0 0x7fc5500b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:58.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.437+0000 7fc54fe00640 1 --2- 172.21.15.123:0/2773074337 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5500b50a0 0x7fc5500ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:58.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.437+0000 7fc555a00640 1 -- 172.21.15.123:0/2773074337 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5500b2ce0 msgr2=0x7fc5500b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:58.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.437+0000 7fc555a00640 1 --2- 172.21.15.123:0/2773074337 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc5500b2ce0 0x7fc5500b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:58.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.437+0000 7fc555a00640 1 -- 172.21.15.123:0/2773074337 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5500b50a0 msgr2=0x7fc5500ae300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:58.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.437+0000 7fc555a00640 1 --2- 172.21.15.123:0/2773074337 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc5500b50a0 0x7fc5500ae300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:58.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.437+0000 7fc555a00640 1 -- 172.21.15.123:0/2773074337 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5500aed30 con 0x7fc5500ae840 2024-04-17T05:33:58.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.437+0000 7fc555a00640 1 --2- 172.21.15.123:0/2773074337 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5500ae840 0x7fc5501dd650 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc548009fd0 tx=0x7fc54800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:58.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.437+0000 7fc54cc00640 1 -- 172.21.15.123:0/2773074337 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc548014420 con 0x7fc5500ae840 2024-04-17T05:33:58.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.437+0000 7fc54cc00640 1 -- 172.21.15.123:0/2773074337 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc548019070 con 0x7fc5500ae840 2024-04-17T05:33:58.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.438+0000 7fc54cc00640 1 -- 172.21.15.123:0/2773074337 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc548014800 con 0x7fc5500ae840 2024-04-17T05:33:58.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.438+0000 7fc557a00640 1 -- 172.21.15.123:0/2773074337 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5500add30 con 0x7fc5500ae840 2024-04-17T05:33:58.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.438+0000 7fc557a00640 1 -- 172.21.15.123:0/2773074337 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5500b1e80 con 0x7fc5500ae840 2024-04-17T05:33:58.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.439+0000 7fc557a00640 1 -- 172.21.15.123:0/2773074337 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc550068a40 con 0x7fc5500ae840 2024-04-17T05:33:58.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.440+0000 7fc54cc00640 1 -- 172.21.15.123:0/2773074337 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc5480149a0 con 0x7fc5500ae840 2024-04-17T05:33:58.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.441+0000 7fc54cc00640 1 --2- 172.21.15.123:0/2773074337 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc53006c8f0 0x7fc53006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:58.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.441+0000 7fc54cc00640 1 -- 172.21.15.123:0/2773074337 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fc54808c7a0 con 0x7fc5500ae840 2024-04-17T05:33:58.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.441+0000 7fc54cc00640 1 --2- 172.21.15.123:0/2773074337 >> [v2:172.21.15.123:6816/754360844,v1:172.21.15.123:6817/754360844] conn(0x7fc530076390 0x7fc530078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:58.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.441+0000 7fc54cc00640 1 -- 172.21.15.123:0/2773074337 --> [v2:172.21.15.123:6816/754360844,v1:172.21.15.123:6817/754360844] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc548006b90 con 0x7fc530076390 2024-04-17T05:33:58.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.441+0000 7fc54cc00640 1 -- 172.21.15.123:0/2773074337 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc548093050 con 0x7fc5500ae840 2024-04-17T05:33:58.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.441+0000 7fc555000640 1 --2- 172.21.15.123:0/2773074337 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc53006c8f0 0x7fc53006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:58.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.441+0000 7fc54fe00640 1 --2- 172.21.15.123:0/2773074337 >> [v2:172.21.15.123:6816/754360844,v1:172.21.15.123:6817/754360844] conn(0x7fc530076390 0x7fc530078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:58.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.442+0000 7fc54fe00640 1 --2- 172.21.15.123:0/2773074337 >> [v2:172.21.15.123:6816/754360844,v1:172.21.15.123:6817/754360844] conn(0x7fc530076390 0x7fc530078830 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:58.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.442+0000 7fc555000640 1 --2- 172.21.15.123:0/2773074337 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc53006c8f0 0x7fc53006edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc544000f60 tx=0x7fc544007b50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:58.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.443+0000 7fc54cc00640 1 -- 172.21.15.123:0/2773074337 <== osd.2 v2:172.21.15.123:6816/754360844 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc548006b90 con 0x7fc530076390 2024-04-17T05:33:58.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.457+0000 7fc557a00640 1 -- 172.21.15.123:0/2773074337 --> [v2:172.21.15.123:6816/754360844,v1:172.21.15.123:6817/754360844] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc55013ff30 con 0x7fc530076390 2024-04-17T05:33:58.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.458+0000 7fc54cc00640 1 -- 172.21.15.123:0/2773074337 <== osd.2 v2:172.21.15.123:6816/754360844 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc55013ff30 con 0x7fc530076390 2024-04-17T05:33:58.457 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-04-17T05:33:58.457 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T05:33:58.457 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-04-17T05:33:58.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.458+0000 7fc557a00640 1 -- 172.21.15.123:0/2773074337 >> [v2:172.21.15.123:6816/754360844,v1:172.21.15.123:6817/754360844] conn(0x7fc530076390 msgr2=0x7fc530078830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:58.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.458+0000 7fc557a00640 1 --2- 172.21.15.123:0/2773074337 >> [v2:172.21.15.123:6816/754360844,v1:172.21.15.123:6817/754360844] conn(0x7fc530076390 0x7fc530078830 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:58.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.458+0000 7fc557a00640 1 -- 172.21.15.123:0/2773074337 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc53006c8f0 msgr2=0x7fc53006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:58.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.458+0000 7fc557a00640 1 --2- 172.21.15.123:0/2773074337 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc53006c8f0 0x7fc53006edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc544000f60 tx=0x7fc544007b50 comp rx=0 tx=0).stop 2024-04-17T05:33:58.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.458+0000 7fc557a00640 1 -- 172.21.15.123:0/2773074337 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5500ae840 msgr2=0x7fc5501dd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:58.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.458+0000 7fc557a00640 1 --2- 172.21.15.123:0/2773074337 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5500ae840 0x7fc5501dd650 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc548009fd0 tx=0x7fc54800e4b0 comp rx=0 tx=0).stop 2024-04-17T05:33:58.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.458+0000 7fc555a00640 1 -- 172.21.15.123:0/2773074337 reap_dead start 2024-04-17T05:33:58.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.458+0000 7fc557a00640 1 -- 172.21.15.123:0/2773074337 shutdown_connections 2024-04-17T05:33:58.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.458+0000 7fc557a00640 1 -- 172.21.15.123:0/2773074337 >> 172.21.15.123:0/2773074337 conn(0x7fc5500b9360 msgr2=0x7fc5500b5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:58.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.459+0000 7fc557a00640 1 -- 172.21.15.123:0/2773074337 shutdown_connections 2024-04-17T05:33:58.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.459+0000 7fc557a00640 1 -- 172.21.15.123:0/2773074337 wait complete. 2024-04-17T05:33:58.474 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-17T05:33:58.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.666+0000 7f87ba800640 1 Processor -- start 2024-04-17T05:33:58.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.666+0000 7f87ba800640 1 -- start start 2024-04-17T05:33:58.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.667+0000 7f87ba800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f87b40b6260 0x7f87b41486a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:58.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.667+0000 7f87ba800640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87b414bff0 con 0x7f87b40b58b0 2024-04-17T05:33:58.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.667+0000 7f87ba800640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87b40b5c90 con 0x7f87b40b7e90 2024-04-17T05:33:58.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.667+0000 7f87ba800640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f87b4148210 con 0x7f87b40b6260 2024-04-17T05:33:58.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.667+0000 7f87b3e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f87b40b6260 0x7f87b41486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:58.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.667+0000 7f87b3e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f87b40b6260 0x7f87b41486a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49040/0 (socket says 172.21.15.123:49040) 2024-04-17T05:33:58.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.668+0000 7f87b3e00640 1 -- 172.21.15.123:0/1725464981 learned_addr learned my addr 172.21.15.123:0/1725464981 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:58.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.667+0000 7f87b3400640 1 --1- 172.21.15.123:0/1725464981 >> v1:172.21.15.123:6789/0 conn(0x7f87b40b58b0 0x7f87b414b1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59162/0 (socket says 172.21.15.123:59162) 2024-04-17T05:33:58.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.668+0000 7f87b3e00640 1 -- 172.21.15.123:0/1725464981 >> v1:172.21.15.164:6789/0 conn(0x7f87b40b7e90 legacy=0x7f87b414b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:58.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.668+0000 7f87b3e00640 1 -- 172.21.15.123:0/1725464981 >> v1:172.21.15.123:6789/0 conn(0x7f87b40b58b0 legacy=0x7f87b414b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:58.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.668+0000 7f87b2a00640 1 -- 172.21.15.123:0/1725464981 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1598785997 0 0) 0x7f87b414bff0 con 0x7f87b40b58b0 2024-04-17T05:33:58.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.668+0000 7f87b3e00640 1 -- 172.21.15.123:0/1725464981 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b4147be0 con 0x7f87b40b6260 2024-04-17T05:33:58.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.669+0000 7f87b3e00640 1 --2- 172.21.15.123:0/1725464981 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b40b6260 0x7f87b41486a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f87ac009e50 tx=0x7f87ac02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fecb09750c8bb3f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:58.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.669+0000 7f87b2a00640 1 -- 172.21.15.123:0/1725464981 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ac02ca80 con 0x7f87b40b6260 2024-04-17T05:33:58.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.669+0000 7f87b2a00640 1 -- 172.21.15.123:0/1725464981 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87ac02cc20 con 0x7f87b40b6260 2024-04-17T05:33:58.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.669+0000 7f87b2a00640 1 -- 172.21.15.123:0/1725464981 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ac0343f0 con 0x7f87b40b6260 2024-04-17T05:33:58.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.670+0000 7f87ba800640 1 -- 172.21.15.123:0/1725464981 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b40b6260 msgr2=0x7f87b41486a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:58.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.670+0000 7f87ba800640 1 --2- 172.21.15.123:0/1725464981 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b40b6260 0x7f87b41486a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f87ac009e50 tx=0x7f87ac02bee0 comp rx=0 tx=0).stop 2024-04-17T05:33:58.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.670+0000 7f87ba800640 1 -- 172.21.15.123:0/1725464981 shutdown_connections 2024-04-17T05:33:58.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.670+0000 7f87ba800640 1 --2- 172.21.15.123:0/1725464981 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b40b6260 0x7f87b41486a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:58.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.670+0000 7f87ba800640 1 -- 172.21.15.123:0/1725464981 >> 172.21.15.123:0/1725464981 conn(0x7f87b40bd6f0 msgr2=0x7f87b40bdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:58.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.670+0000 7f87ba800640 1 -- 172.21.15.123:0/1725464981 shutdown_connections 2024-04-17T05:33:58.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.670+0000 7f87ba800640 1 -- 172.21.15.123:0/1725464981 wait complete. 2024-04-17T05:33:58.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.672+0000 7f87ba800640 1 Processor -- start 2024-04-17T05:33:58.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.672+0000 7f87ba800640 1 -- start start 2024-04-17T05:33:58.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.673+0000 7f87ba800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b40b58b0 0x7f87b41451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:58.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.673+0000 7f87ba800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87b40b6260 0x7f87b413bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:58.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.673+0000 7f87ba800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87b40b7e90 0x7f87b413c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:58.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.673+0000 7f87ba800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f87b4148be0 con 0x7f87b40b58b0 2024-04-17T05:33:58.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.673+0000 7f87ba800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f87b40b76b0 con 0x7f87b40b6260 2024-04-17T05:33:58.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.673+0000 7f87ba800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f87b4147ea0 con 0x7f87b40b7e90 2024-04-17T05:33:58.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.673+0000 7f87b3400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b40b58b0 0x7f87b41451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:58.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.673+0000 7f87b3400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b40b58b0 0x7f87b41451b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49044/0 (socket says 172.21.15.123:49044) 2024-04-17T05:33:58.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.673+0000 7f87b3400640 1 -- 172.21.15.123:0/1321807609 learned_addr learned my addr 172.21.15.123:0/1321807609 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:58.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.674+0000 7f87abe00640 1 --2- 172.21.15.123:0/1321807609 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87b40b6260 0x7f87b413bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:58.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.674+0000 7f87b3400640 1 -- 172.21.15.123:0/1321807609 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87b40b7e90 msgr2=0x7f87b413c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:58.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.674+0000 7f87b3e00640 1 --2- 172.21.15.123:0/1321807609 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87b40b7e90 0x7f87b413c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:58.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.674+0000 7f87b3400640 1 --2- 172.21.15.123:0/1321807609 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87b40b7e90 0x7f87b413c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:58.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.674+0000 7f87b3400640 1 -- 172.21.15.123:0/1321807609 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87b40b6260 msgr2=0x7f87b413bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:58.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.674+0000 7f87b3400640 1 --2- 172.21.15.123:0/1321807609 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87b40b6260 0x7f87b413bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:58.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.674+0000 7f87b3400640 1 -- 172.21.15.123:0/1321807609 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b414ac70 con 0x7f87b40b58b0 2024-04-17T05:33:58.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.674+0000 7f87abe00640 1 --2- 172.21.15.123:0/1321807609 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87b40b6260 0x7f87b413bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:33:58.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.674+0000 7f87b3400640 1 --2- 172.21.15.123:0/1321807609 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b40b58b0 0x7f87b41451b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f87a400c500 tx=0x7f87a400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:58.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.674+0000 7f87ab400640 1 -- 172.21.15.123:0/1321807609 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a4018070 con 0x7f87b40b58b0 2024-04-17T05:33:58.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.674+0000 7f87ab400640 1 -- 172.21.15.123:0/1321807609 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a4007580 con 0x7f87b40b58b0 2024-04-17T05:33:58.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.674+0000 7f87ab400640 1 -- 172.21.15.123:0/1321807609 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a4004a20 con 0x7f87b40b58b0 2024-04-17T05:33:58.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.674+0000 7f87ba800640 1 -- 172.21.15.123:0/1321807609 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87b414af50 con 0x7f87b40b58b0 2024-04-17T05:33:58.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.675+0000 7f87ba800640 1 -- 172.21.15.123:0/1321807609 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87b41d1df0 con 0x7f87b40b58b0 2024-04-17T05:33:58.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.676+0000 7f87ba800640 1 -- 172.21.15.123:0/1321807609 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87b4068a40 con 0x7f87b40b58b0 2024-04-17T05:33:58.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.677+0000 7f87ab400640 1 -- 172.21.15.123:0/1321807609 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f87a4004bc0 con 0x7f87b40b58b0 2024-04-17T05:33:58.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.678+0000 7f87ab400640 1 --2- 172.21.15.123:0/1321807609 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f879006c8f0 0x7f879006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:58.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.678+0000 7f87ab400640 1 -- 172.21.15.123:0/1321807609 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f87a408b1f0 con 0x7f87b40b58b0 2024-04-17T05:33:58.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.678+0000 7f87abe00640 1 --2- 172.21.15.123:0/1321807609 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f879006c8f0 0x7f879006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:58.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.679+0000 7f87abe00640 1 --2- 172.21.15.123:0/1321807609 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f879006c8f0 0x7f879006edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f87b414b340 tx=0x7f879c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:58.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.682+0000 7f87ab400640 1 -- 172.21.15.123:0/1321807609 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f87a4059290 con 0x7f87b40b58b0 2024-04-17T05:33:58.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.884+0000 7f87ba800640 1 -- 172.21.15.123:0/1321807609 --> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f87b40b70f0 con 0x7f879006c8f0 2024-04-17T05:33:58.884 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 2 to deep-scrub 2024-04-17T05:33:58.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.885+0000 7f87ab400640 1 -- 172.21.15.123:0/1321807609 <== mgr.4103 v2:172.21.15.164:6832/4204006015 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f87b40b70f0 con 0x7f879006c8f0 2024-04-17T05:33:58.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.888+0000 7f87ba800640 1 -- 172.21.15.123:0/1321807609 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f879006c8f0 msgr2=0x7f879006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:58.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.888+0000 7f87ba800640 1 --2- 172.21.15.123:0/1321807609 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f879006c8f0 0x7f879006edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f87b414b340 tx=0x7f879c008040 comp rx=0 tx=0).stop 2024-04-17T05:33:58.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.888+0000 7f87ba800640 1 -- 172.21.15.123:0/1321807609 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b40b58b0 msgr2=0x7f87b41451b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:58.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.888+0000 7f87ba800640 1 --2- 172.21.15.123:0/1321807609 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b40b58b0 0x7f87b41451b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f87a400c500 tx=0x7f87a400c9c0 comp rx=0 tx=0).stop 2024-04-17T05:33:58.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.888+0000 7f87ba800640 1 -- 172.21.15.123:0/1321807609 shutdown_connections 2024-04-17T05:33:58.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.888+0000 7f87ba800640 1 --2- 172.21.15.123:0/1321807609 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f879006c8f0 0x7f879006edb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:58.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.888+0000 7f87ba800640 1 --2- 172.21.15.123:0/1321807609 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f87b40b7e90 0x7f87b413c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:58.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.888+0000 7f87ba800640 1 --2- 172.21.15.123:0/1321807609 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87b40b6260 0x7f87b413bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:58.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.888+0000 7f87ba800640 1 --2- 172.21.15.123:0/1321807609 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b40b58b0 0x7f87b41451b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:58.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.888+0000 7f87ba800640 1 -- 172.21.15.123:0/1321807609 >> 172.21.15.123:0/1321807609 conn(0x7f87b40bd6f0 msgr2=0x7f87b40b9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:58.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.888+0000 7f87ba800640 1 -- 172.21.15.123:0/1321807609 shutdown_connections 2024-04-17T05:33:58.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:58.888+0000 7f87ba800640 1 -- 172.21.15.123:0/1321807609 wait complete. 2024-04-17T05:33:58.905 INFO:tasks.ceph:Scrubbing osd.3 2024-04-17T05:33:58.905 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-17T05:33:59.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.096+0000 7fe5c7400640 1 Processor -- start 2024-04-17T05:33:59.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.096+0000 7fe5c7400640 1 -- start start 2024-04-17T05:33:59.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.097+0000 7fe5c7400640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe5c01419b0 0x7fe5c0141e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:59.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.097+0000 7fe5c7400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe5c014b3b0 0x7fe5c014b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:59.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.097+0000 7fe5c7400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5c00badb0 con 0x7fe5c00ba9d0 2024-04-17T05:33:59.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.097+0000 7fe5c7400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe5c00b76c0 con 0x7fe5c014b3b0 2024-04-17T05:33:59.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.097+0000 7fe5c7400640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7fe5c014bd20 con 0x7fe5c01419b0 2024-04-17T05:33:59.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.098+0000 7fe5c4a00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe5c00ba9d0 0x7fe5c00b5ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59178/0 (socket says 172.21.15.123:59178) 2024-04-17T05:33:59.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.098+0000 7fe5c4a00640 1 -- 172.21.15.123:0/3901534208 learned_addr learned my addr 172.21.15.123:0/3901534208 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:33:59.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.098+0000 7fe5c5400640 1 --2- 172.21.15.123:0/3901534208 >> v2:172.21.15.123:3300/0 conn(0x7fe5c014b3b0 0x7fe5c014b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:59.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.098+0000 7fe5b7e00640 1 --2- 172.21.15.123:0/3901534208 >> v2:172.21.15.164:3300/0 conn(0x7fe5c01419b0 0x7fe5c0141e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:59.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.098+0000 7fe5bfe00640 1 -- 172.21.15.123:0/3901534208 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3505589331 0 0) 0x7fe5c00badb0 con 0x7fe5c00ba9d0 2024-04-17T05:33:59.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.098+0000 7fe5c5400640 1 -- 172.21.15.123:0/3901534208 >> v2:172.21.15.164:3300/0 conn(0x7fe5c01419b0 msgr2=0x7fe5c0141e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:59.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.098+0000 7fe5c5400640 1 --2- 172.21.15.123:0/3901534208 >> v2:172.21.15.164:3300/0 conn(0x7fe5c01419b0 0x7fe5c0141e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:59.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.098+0000 7fe5c5400640 1 -- 172.21.15.123:0/3901534208 >> v1:172.21.15.123:6789/0 conn(0x7fe5c00ba9d0 legacy=0x7fe5c00b5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:59.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.098+0000 7fe5c5400640 1 -- 172.21.15.123:0/3901534208 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c00b55b0 con 0x7fe5c014b3b0 2024-04-17T05:33:59.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.099+0000 7fe5c5400640 1 --2- 172.21.15.123:0/3901534208 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5c014b3b0 0x7fe5c014b7e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe5c00b91c0 tx=0x7fe5b802b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91205e6e03aff634 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:59.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.099+0000 7fe5bfe00640 1 -- 172.21.15.123:0/3901534208 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8038070 con 0x7fe5c014b3b0 2024-04-17T05:33:59.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.099+0000 7fe5bfe00640 1 -- 172.21.15.123:0/3901534208 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5b8031710 con 0x7fe5c014b3b0 2024-04-17T05:33:59.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.099+0000 7fe5bfe00640 1 -- 172.21.15.123:0/3901534208 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8031ae0 con 0x7fe5c014b3b0 2024-04-17T05:33:59.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.100+0000 7fe5c7400640 1 -- 172.21.15.123:0/3901534208 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5c014b3b0 msgr2=0x7fe5c014b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:59.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.100+0000 7fe5c7400640 1 --2- 172.21.15.123:0/3901534208 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5c014b3b0 0x7fe5c014b7e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe5c00b91c0 tx=0x7fe5b802b7b0 comp rx=0 tx=0).stop 2024-04-17T05:33:59.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.100+0000 7fe5c7400640 1 -- 172.21.15.123:0/3901534208 shutdown_connections 2024-04-17T05:33:59.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.100+0000 7fe5c7400640 1 --2- 172.21.15.123:0/3901534208 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5c014b3b0 0x7fe5c014b7e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:59.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.100+0000 7fe5c7400640 1 --2- 172.21.15.123:0/3901534208 >> v2:172.21.15.164:3300/0 conn(0x7fe5c01419b0 0x7fe5c0141e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:59.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.100+0000 7fe5c7400640 1 -- 172.21.15.123:0/3901534208 >> 172.21.15.123:0/3901534208 conn(0x7fe5c00bdf10 msgr2=0x7fe5c00b9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:59.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.100+0000 7fe5c7400640 1 -- 172.21.15.123:0/3901534208 shutdown_connections 2024-04-17T05:33:59.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.100+0000 7fe5c7400640 1 -- 172.21.15.123:0/3901534208 wait complete. 2024-04-17T05:33:59.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.102+0000 7fe5c7400640 1 Processor -- start 2024-04-17T05:33:59.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.102+0000 7fe5c7400640 1 -- start start 2024-04-17T05:33:59.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.103+0000 7fe5c7400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5c00ba9d0 0x7fe5c0136ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:59.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.103+0000 7fe5c7400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5c01419b0 0x7fe5c0148d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:59.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.103+0000 7fe5c7400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5c014b3b0 0x7fe5c0149280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:59.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.103+0000 7fe5c7400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c0152500 con 0x7fe5c014b3b0 2024-04-17T05:33:59.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.103+0000 7fe5c7400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c00b6700 con 0x7fe5c00ba9d0 2024-04-17T05:33:59.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.103+0000 7fe5c7400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fe5c0152680 con 0x7fe5c01419b0 2024-04-17T05:33:59.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.104+0000 7fe5c5400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5c014b3b0 0x7fe5c0149280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:59.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.104+0000 7fe5c5400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5c014b3b0 0x7fe5c0149280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49064/0 (socket says 172.21.15.123:49064) 2024-04-17T05:33:59.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.104+0000 7fe5c5400640 1 -- 172.21.15.123:0/51470497 learned_addr learned my addr 172.21.15.123:0/51470497 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:59.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.104+0000 7fe5c4a00640 1 --2- 172.21.15.123:0/51470497 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5c00ba9d0 0x7fe5c0136ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:59.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.104+0000 7fe5b7e00640 1 --2- 172.21.15.123:0/51470497 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5c01419b0 0x7fe5c0148d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:59.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.104+0000 7fe5c5400640 1 -- 172.21.15.123:0/51470497 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5c01419b0 msgr2=0x7fe5c0148d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:59.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.104+0000 7fe5c5400640 1 --2- 172.21.15.123:0/51470497 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5c01419b0 0x7fe5c0148d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:59.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.104+0000 7fe5c5400640 1 -- 172.21.15.123:0/51470497 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5c00ba9d0 msgr2=0x7fe5c0136ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:59.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.104+0000 7fe5c5400640 1 --2- 172.21.15.123:0/51470497 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5c00ba9d0 0x7fe5c0136ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:59.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.104+0000 7fe5c5400640 1 -- 172.21.15.123:0/51470497 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c01374b0 con 0x7fe5c014b3b0 2024-04-17T05:33:59.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.104+0000 7fe5c5400640 1 --2- 172.21.15.123:0/51470497 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5c014b3b0 0x7fe5c0149280 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe5b802b7f0 tx=0x7fe5b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:59.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.105+0000 7fe5bd600640 1 -- 172.21.15.123:0/51470497 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8042070 con 0x7fe5c014b3b0 2024-04-17T05:33:59.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.105+0000 7fe5bd600640 1 -- 172.21.15.123:0/51470497 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5b80339c0 con 0x7fe5c014b3b0 2024-04-17T05:33:59.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.105+0000 7fe5bd600640 1 -- 172.21.15.123:0/51470497 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8038040 con 0x7fe5c014b3b0 2024-04-17T05:33:59.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.105+0000 7fe5c7400640 1 -- 172.21.15.123:0/51470497 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5c01360e0 con 0x7fe5c014b3b0 2024-04-17T05:33:59.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.105+0000 7fe5c7400640 1 -- 172.21.15.123:0/51470497 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5c0137f70 con 0x7fe5c014b3b0 2024-04-17T05:33:59.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.106+0000 7fe5c7400640 1 -- 172.21.15.123:0/51470497 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe5c0068a40 con 0x7fe5c014b3b0 2024-04-17T05:33:59.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.107+0000 7fe5bd600640 1 -- 172.21.15.123:0/51470497 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe5b803b070 con 0x7fe5c014b3b0 2024-04-17T05:33:59.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.108+0000 7fe5bd600640 1 --2- 172.21.15.123:0/51470497 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe59c06c8f0 0x7fe59c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:59.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.108+0000 7fe5bd600640 1 -- 172.21.15.123:0/51470497 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fe5b80ad690 con 0x7fe5c014b3b0 2024-04-17T05:33:59.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.108+0000 7fe5bd600640 1 --2- 172.21.15.123:0/51470497 >> [v2:172.21.15.123:6808/2898088574,v1:172.21.15.123:6809/2898088574] conn(0x7fe59c076380 0x7fe59c078820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:59.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.108+0000 7fe5bd600640 1 -- 172.21.15.123:0/51470497 --> [v2:172.21.15.123:6808/2898088574,v1:172.21.15.123:6809/2898088574] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe5b8031710 con 0x7fe59c076380 2024-04-17T05:33:59.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.108+0000 7fe5bd600640 1 -- 172.21.15.123:0/51470497 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe5b80b4050 con 0x7fe5c014b3b0 2024-04-17T05:33:59.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.108+0000 7fe5c4a00640 1 --2- 172.21.15.123:0/51470497 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe59c06c8f0 0x7fe59c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.108+0000 7fe5b7e00640 1 --2- 172.21.15.123:0/51470497 >> [v2:172.21.15.123:6808/2898088574,v1:172.21.15.123:6809/2898088574] conn(0x7fe59c076380 0x7fe59c078820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.109+0000 7fe5b7e00640 1 --2- 172.21.15.123:0/51470497 >> [v2:172.21.15.123:6808/2898088574,v1:172.21.15.123:6809/2898088574] conn(0x7fe59c076380 0x7fe59c078820 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:59.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.109+0000 7fe5c4a00640 1 --2- 172.21.15.123:0/51470497 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe59c06c8f0 0x7fe59c06edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0007ed0 tx=0x7fe5b0007e60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:59.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.110+0000 7fe5bd600640 1 -- 172.21.15.123:0/51470497 <== osd.3 v2:172.21.15.123:6808/2898088574 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe5b8031710 con 0x7fe59c076380 2024-04-17T05:33:59.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.124+0000 7fe5c7400640 1 -- 172.21.15.123:0/51470497 --> [v2:172.21.15.123:6808/2898088574,v1:172.21.15.123:6809/2898088574] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe5c01455a0 con 0x7fe59c076380 2024-04-17T05:33:59.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.124+0000 7fe5bd600640 1 -- 172.21.15.123:0/51470497 <== osd.3 v2:172.21.15.123:6808/2898088574 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe5c01455a0 con 0x7fe59c076380 2024-04-17T05:33:59.123 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-04-17T05:33:59.123 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T05:33:59.123 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-04-17T05:33:59.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.125+0000 7fe5c7400640 1 -- 172.21.15.123:0/51470497 >> [v2:172.21.15.123:6808/2898088574,v1:172.21.15.123:6809/2898088574] conn(0x7fe59c076380 msgr2=0x7fe59c078820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:59.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.125+0000 7fe5c7400640 1 --2- 172.21.15.123:0/51470497 >> [v2:172.21.15.123:6808/2898088574,v1:172.21.15.123:6809/2898088574] conn(0x7fe59c076380 0x7fe59c078820 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:59.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.125+0000 7fe5c7400640 1 -- 172.21.15.123:0/51470497 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe59c06c8f0 msgr2=0x7fe59c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:59.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.125+0000 7fe5c7400640 1 --2- 172.21.15.123:0/51470497 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe59c06c8f0 0x7fe59c06edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0007ed0 tx=0x7fe5b0007e60 comp rx=0 tx=0).stop 2024-04-17T05:33:59.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.125+0000 7fe5c7400640 1 -- 172.21.15.123:0/51470497 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5c014b3b0 msgr2=0x7fe5c0149280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:59.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.125+0000 7fe5c7400640 1 --2- 172.21.15.123:0/51470497 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5c014b3b0 0x7fe5c0149280 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe5b802b7f0 tx=0x7fe5b80046c0 comp rx=0 tx=0).stop 2024-04-17T05:33:59.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.125+0000 7fe5c5400640 1 -- 172.21.15.123:0/51470497 reap_dead start 2024-04-17T05:33:59.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.125+0000 7fe5c7400640 1 -- 172.21.15.123:0/51470497 shutdown_connections 2024-04-17T05:33:59.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.125+0000 7fe5c7400640 1 -- 172.21.15.123:0/51470497 >> 172.21.15.123:0/51470497 conn(0x7fe5c00bdf10 msgr2=0x7fe5c00676c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:59.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.125+0000 7fe5c7400640 1 -- 172.21.15.123:0/51470497 shutdown_connections 2024-04-17T05:33:59.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.125+0000 7fe5c7400640 1 -- 172.21.15.123:0/51470497 wait complete. 2024-04-17T05:33:59.139 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-17T05:33:59.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.330+0000 7faf0fc00640 1 Processor -- start 2024-04-17T05:33:59.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.330+0000 7faf0fc00640 1 -- start start 2024-04-17T05:33:59.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.331+0000 7faf0fc00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf080b7e70 0x7faf080b5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:59.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.331+0000 7faf0fc00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf080b7330 con 0x7faf08141e50 2024-04-17T05:33:59.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.331+0000 7faf0fc00640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf08147c80 con 0x7faf080b61f0 2024-04-17T05:33:59.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.331+0000 7faf0fc00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7faf081422e0 con 0x7faf080b7e70 2024-04-17T05:33:59.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.332+0000 7faf0dc00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7faf08141e50 0x7faf081524f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59188/0 (socket says 172.21.15.123:59188) 2024-04-17T05:33:59.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.332+0000 7faf0dc00640 1 -- 172.21.15.123:0/249661092 learned_addr learned my addr 172.21.15.123:0/249661092 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:33:59.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.332+0000 7faf07e00640 1 --2- 172.21.15.123:0/249661092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf080b7e70 0x7faf080b5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:59.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.332+0000 7faf07400640 1 -- 172.21.15.123:0/249661092 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2292205035 0 0) 0x7faf080b7330 con 0x7faf08141e50 2024-04-17T05:33:59.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.332+0000 7faf07400640 1 -- 172.21.15.123:0/249661092 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faef0003520 con 0x7faf08141e50 2024-04-17T05:33:59.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.333+0000 7faf07400640 1 -- 172.21.15.123:0/249661092 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1151667908 0 0) 0x7faef0003520 con 0x7faf08141e50 2024-04-17T05:33:59.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.333+0000 7faf07400640 1 -- 172.21.15.123:0/249661092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf080b7e70 msgr2=0x7faf080b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:59.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.333+0000 7faf07400640 1 --2- 172.21.15.123:0/249661092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf080b7e70 0x7faf080b5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:59.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.333+0000 7faf07400640 1 -- 172.21.15.123:0/249661092 >> v1:172.21.15.164:6789/0 conn(0x7faf080b61f0 legacy=0x7faf08141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:59.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.333+0000 7faf07400640 1 -- 172.21.15.123:0/249661092 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf080b65d0 con 0x7faf08141e50 2024-04-17T05:33:59.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.333+0000 7faf07400640 1 -- 172.21.15.123:0/249661092 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1042962670 0 0) 0x7faf000019f0 con 0x7faf08141e50 2024-04-17T05:33:59.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.333+0000 7faf07400640 1 -- 172.21.15.123:0/249661092 >> v1:172.21.15.123:6789/0 conn(0x7faf08141e50 legacy=0x7faf081524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:59.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.333+0000 7faf07400640 1 --2- 172.21.15.123:0/249661092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faef00039e0 0x7faef0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:59.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.333+0000 7faf07400640 1 --2- 172.21.15.123:0/249661092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf080b7e70 0x7faef0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:59.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.333+0000 7faf07400640 1 --2- 172.21.15.123:0/249661092 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faef0004d40 0x7faef00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:59.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.333+0000 7faf07400640 1 -- 172.21.15.123:0/249661092 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7faf081422e0 con 0x7faef00039e0 2024-04-17T05:33:59.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.333+0000 7faf07400640 1 -- 172.21.15.123:0/249661092 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7faef000baa0 con 0x7faef0004d40 2024-04-17T05:33:59.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.333+0000 7faf07400640 1 -- 172.21.15.123:0/249661092 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7faef000bca0 con 0x7faf080b7e70 2024-04-17T05:33:59.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.333+0000 7faf0d200640 1 --2- 172.21.15.123:0/249661092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faef00039e0 0x7faef0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:59.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.333+0000 7faf0dc00640 1 --2- 172.21.15.123:0/249661092 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faef0004d40 0x7faef00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:59.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.334+0000 7faf07e00640 1 --2- 172.21.15.123:0/249661092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf080b7e70 0x7faef0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:59.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.334+0000 7faf0d200640 1 -- 172.21.15.123:0/249661092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf080b7e70 msgr2=0x7faef0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:59.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.334+0000 7faf0d200640 1 --2- 172.21.15.123:0/249661092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf080b7e70 0x7faef0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:59.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.334+0000 7faf0d200640 1 -- 172.21.15.123:0/249661092 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faef0004d40 msgr2=0x7faef00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:59.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.334+0000 7faf0d200640 1 --2- 172.21.15.123:0/249661092 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faef0004d40 0x7faef00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:59.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.334+0000 7faf0d200640 1 -- 172.21.15.123:0/249661092 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faef0003520 con 0x7faef00039e0 2024-04-17T05:33:59.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.334+0000 7faf07e00640 1 --2- 172.21.15.123:0/249661092 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf080b7e70 0x7faef0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:33:59.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.335+0000 7faf0d200640 1 --2- 172.21.15.123:0/249661092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faef00039e0 0x7faef0003dc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7faefc001860 tx=0x7faef0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d607949a3f3f7031 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:59.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.335+0000 7faf07400640 1 -- 172.21.15.123:0/249661092 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faefc02f050 con 0x7faef00039e0 2024-04-17T05:33:59.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.335+0000 7faf07400640 1 -- 172.21.15.123:0/249661092 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faefc033650 con 0x7faef00039e0 2024-04-17T05:33:59.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.335+0000 7faf07400640 1 -- 172.21.15.123:0/249661092 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faefc001430 con 0x7faef00039e0 2024-04-17T05:33:59.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.336+0000 7faf0fc00640 1 -- 172.21.15.123:0/249661092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faef00039e0 msgr2=0x7faef0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:59.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.336+0000 7faf0fc00640 1 --2- 172.21.15.123:0/249661092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faef00039e0 0x7faef0003dc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7faefc001860 tx=0x7faef0005830 comp rx=0 tx=0).stop 2024-04-17T05:33:59.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.336+0000 7faf0dc00640 1 -- 172.21.15.123:0/249661092 reap_dead start 2024-04-17T05:33:59.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.336+0000 7faf0fc00640 1 -- 172.21.15.123:0/249661092 shutdown_connections 2024-04-17T05:33:59.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.336+0000 7faf0fc00640 1 -- 172.21.15.123:0/249661092 >> 172.21.15.123:0/249661092 conn(0x7faf080bd4f0 msgr2=0x7faf080bd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:59.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.336+0000 7faf0fc00640 1 -- 172.21.15.123:0/249661092 shutdown_connections 2024-04-17T05:33:59.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.336+0000 7faf0fc00640 1 -- 172.21.15.123:0/249661092 wait complete. 2024-04-17T05:33:59.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.338+0000 7faf0fc00640 1 Processor -- start 2024-04-17T05:33:59.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.338+0000 7faf0fc00640 1 -- start start 2024-04-17T05:33:59.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.339+0000 7faf0fc00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faef00039e0 0x7faf08144f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:59.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.339+0000 7faf0fc00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf081cf800 0x7faf081cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:59.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.339+0000 7faf0fc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf081ce510 0x7faf081e0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:59.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.339+0000 7faf0fc00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7faf080b75a0 con 0x7faef00039e0 2024-04-17T05:33:59.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.339+0000 7faf0fc00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7faf08148260 con 0x7faf081ce510 2024-04-17T05:33:59.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.339+0000 7faf0fc00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7faf080b4dc0 con 0x7faf081cf800 2024-04-17T05:33:59.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.340+0000 7faf0d200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faef00039e0 0x7faf08144f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:59.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.340+0000 7faf0d200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faef00039e0 0x7faf08144f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49076/0 (socket says 172.21.15.123:49076) 2024-04-17T05:33:59.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.340+0000 7faf0d200640 1 -- 172.21.15.123:0/3898550624 learned_addr learned my addr 172.21.15.123:0/3898550624 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:59.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.340+0000 7faf0dc00640 1 --2- 172.21.15.123:0/3898550624 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf081ce510 0x7faf081e0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:59.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.340+0000 7faf07e00640 1 --2- 172.21.15.123:0/3898550624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf081cf800 0x7faf081cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:59.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.340+0000 7faf0d200640 1 -- 172.21.15.123:0/3898550624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf081cf800 msgr2=0x7faf081cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:59.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.340+0000 7faf0d200640 1 --2- 172.21.15.123:0/3898550624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf081cf800 0x7faf081cdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:59.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.340+0000 7faf0d200640 1 -- 172.21.15.123:0/3898550624 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf081ce510 msgr2=0x7faf081e0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:59.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.340+0000 7faf0d200640 1 --2- 172.21.15.123:0/3898550624 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf081ce510 0x7faf081e0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:59.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.340+0000 7faf0d200640 1 -- 172.21.15.123:0/3898550624 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf081d0a30 con 0x7faef00039e0 2024-04-17T05:33:59.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.340+0000 7faf0dc00640 1 --2- 172.21.15.123:0/3898550624 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf081ce510 0x7faf081e0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:33:59.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.340+0000 7faf0d200640 1 --2- 172.21.15.123:0/3898550624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faef00039e0 0x7faf08144f00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7faefc000c00 tx=0x7faefc001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:59.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.341+0000 7faf04c00640 1 -- 172.21.15.123:0/3898550624 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faefc007050 con 0x7faef00039e0 2024-04-17T05:33:59.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.341+0000 7faf04c00640 1 -- 172.21.15.123:0/3898550624 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faefc0071f0 con 0x7faef00039e0 2024-04-17T05:33:59.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.341+0000 7faf0fc00640 1 -- 172.21.15.123:0/3898550624 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf081ce990 con 0x7faef00039e0 2024-04-17T05:33:59.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.341+0000 7faf04c00640 1 -- 172.21.15.123:0/3898550624 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faefc0075a0 con 0x7faef00039e0 2024-04-17T05:33:59.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.341+0000 7faf0fc00640 1 -- 172.21.15.123:0/3898550624 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf081cfd50 con 0x7faef00039e0 2024-04-17T05:33:59.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.342+0000 7faf0fc00640 1 -- 172.21.15.123:0/3898550624 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf08068a40 con 0x7faef00039e0 2024-04-17T05:33:59.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.343+0000 7faf04c00640 1 -- 172.21.15.123:0/3898550624 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faefc0067d0 con 0x7faef00039e0 2024-04-17T05:33:59.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.344+0000 7faf04c00640 1 --2- 172.21.15.123:0/3898550624 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7faee806c920 0x7faee806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:59.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.344+0000 7faf04c00640 1 -- 172.21.15.123:0/3898550624 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7faefc0adbc0 con 0x7faef00039e0 2024-04-17T05:33:59.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.344+0000 7faf07e00640 1 --2- 172.21.15.123:0/3898550624 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7faee806c920 0x7faee806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:59.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.345+0000 7faf07e00640 1 --2- 172.21.15.123:0/3898550624 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7faee806c920 0x7faee806ede0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7faf080bba50 tx=0x7faef4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:59.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.348+0000 7faf04c00640 1 -- 172.21.15.123:0/3898550624 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7faefc04a030 con 0x7faef00039e0 2024-04-17T05:33:59.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.551+0000 7faf0fc00640 1 -- 172.21.15.123:0/3898550624 --> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7faf080b5160 con 0x7faee806c920 2024-04-17T05:33:59.552 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 3 to deep-scrub 2024-04-17T05:33:59.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.552+0000 7faf04c00640 1 -- 172.21.15.123:0/3898550624 <== mgr.4103 v2:172.21.15.164:6832/4204006015 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7faf080b5160 con 0x7faee806c920 2024-04-17T05:33:59.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.555+0000 7faf0fc00640 1 -- 172.21.15.123:0/3898550624 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7faee806c920 msgr2=0x7faee806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:59.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.555+0000 7faf0fc00640 1 --2- 172.21.15.123:0/3898550624 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7faee806c920 0x7faee806ede0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7faf080bba50 tx=0x7faef4008040 comp rx=0 tx=0).stop 2024-04-17T05:33:59.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.555+0000 7faf0fc00640 1 -- 172.21.15.123:0/3898550624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faef00039e0 msgr2=0x7faf08144f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:59.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.555+0000 7faf0fc00640 1 --2- 172.21.15.123:0/3898550624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faef00039e0 0x7faf08144f00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7faefc000c00 tx=0x7faefc001230 comp rx=0 tx=0).stop 2024-04-17T05:33:59.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.555+0000 7faf0fc00640 1 -- 172.21.15.123:0/3898550624 shutdown_connections 2024-04-17T05:33:59.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.555+0000 7faf0fc00640 1 --2- 172.21.15.123:0/3898550624 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faf081ce510 0x7faf081e0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:59.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.555+0000 7faf0fc00640 1 --2- 172.21.15.123:0/3898550624 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7faee806c920 0x7faee806ede0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:59.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.555+0000 7faf0fc00640 1 --2- 172.21.15.123:0/3898550624 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faf081cf800 0x7faf081cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:59.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.555+0000 7faf0fc00640 1 --2- 172.21.15.123:0/3898550624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faef00039e0 0x7faf08144f00 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:59.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.556+0000 7faf0fc00640 1 -- 172.21.15.123:0/3898550624 >> 172.21.15.123:0/3898550624 conn(0x7faf080bd4f0 msgr2=0x7faf08141510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:59.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.556+0000 7faf0fc00640 1 -- 172.21.15.123:0/3898550624 shutdown_connections 2024-04-17T05:33:59.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.556+0000 7faf0fc00640 1 -- 172.21.15.123:0/3898550624 wait complete. 2024-04-17T05:33:59.572 INFO:tasks.ceph:Scrubbing osd.4 2024-04-17T05:33:59.572 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-17T05:33:59.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.780+0000 7f1656a00640 1 Processor -- start 2024-04-17T05:33:59.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.780+0000 7f1656a00640 1 -- start start 2024-04-17T05:33:59.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.781+0000 7f1656a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1650151360 0x7f1650153750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:59.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.781+0000 7f1656a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16500b3760 con 0x7f16500add50 2024-04-17T05:33:59.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.781+0000 7f1656a00640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1650148980 con 0x7f16500ae130 2024-04-17T05:33:59.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.781+0000 7f1656a00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f1650142200 con 0x7f1650151360 2024-04-17T05:33:59.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.782+0000 7f1655600640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f16500add50 0x7f16500b3050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59190/0 (socket says 172.21.15.123:59190) 2024-04-17T05:33:59.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.782+0000 7f1655600640 1 -- 172.21.15.123:0/3663606466 learned_addr learned my addr 172.21.15.123:0/3663606466 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:33:59.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.782+0000 7f1656000640 1 --2- 172.21.15.123:0/3663606466 >> v2:172.21.15.123:3300/0 conn(0x7f1650151360 0x7f1650153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:59.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.782+0000 7f164fe00640 1 -- 172.21.15.123:0/3663606466 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3538382303 0 0) 0x7f16500b3760 con 0x7f16500add50 2024-04-17T05:33:59.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.782+0000 7f164fe00640 1 -- 172.21.15.123:0/3663606466 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1638003520 con 0x7f16500add50 2024-04-17T05:33:59.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.782+0000 7f1656000640 1 -- 172.21.15.123:0/3663606466 >> v1:172.21.15.164:6789/0 conn(0x7f16500ae130 legacy=0x7f1650148270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:33:59.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.782+0000 7f1656000640 1 -- 172.21.15.123:0/3663606466 >> v1:172.21.15.123:6789/0 conn(0x7f16500add50 legacy=0x7f16500b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:59.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.782+0000 7f1656000640 1 -- 172.21.15.123:0/3663606466 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16500ae5c0 con 0x7f1650151360 2024-04-17T05:33:59.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.783+0000 7f1656000640 1 --2- 172.21.15.123:0/3663606466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1650151360 0x7f1650153750 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1648009d90 tx=0x7f164802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d38a6b7afb11b49 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:59.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.784+0000 7f164fe00640 1 -- 172.21.15.123:0/3663606466 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1648039070 con 0x7f1650151360 2024-04-17T05:33:59.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.784+0000 7f164fe00640 1 -- 172.21.15.123:0/3663606466 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f164802cc60 con 0x7f1650151360 2024-04-17T05:33:59.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.784+0000 7f164fe00640 1 -- 172.21.15.123:0/3663606466 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1648034660 con 0x7f1650151360 2024-04-17T05:33:59.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.784+0000 7f1656a00640 1 -- 172.21.15.123:0/3663606466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1650151360 msgr2=0x7f1650153750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:59.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.784+0000 7f1656a00640 1 --2- 172.21.15.123:0/3663606466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1650151360 0x7f1650153750 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1648009d90 tx=0x7f164802beb0 comp rx=0 tx=0).stop 2024-04-17T05:33:59.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.784+0000 7f1656a00640 1 -- 172.21.15.123:0/3663606466 shutdown_connections 2024-04-17T05:33:59.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.784+0000 7f1656a00640 1 --2- 172.21.15.123:0/3663606466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1650151360 0x7f1650153750 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:59.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.784+0000 7f1656a00640 1 -- 172.21.15.123:0/3663606466 >> 172.21.15.123:0/3663606466 conn(0x7f165006c190 msgr2=0x7f16500b9260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:59.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.784+0000 7f1656a00640 1 -- 172.21.15.123:0/3663606466 shutdown_connections 2024-04-17T05:33:59.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.784+0000 7f1656a00640 1 -- 172.21.15.123:0/3663606466 wait complete. 2024-04-17T05:33:59.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.786+0000 7f1656a00640 1 Processor -- start 2024-04-17T05:33:59.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.786+0000 7f1656a00640 1 -- start start 2024-04-17T05:33:59.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.787+0000 7f1656a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16500add50 0x7f16501e0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:59.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.787+0000 7f1656a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16500ae130 0x7f16501e11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:59.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.787+0000 7f1656a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1650151360 0x7f165013a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:59.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.787+0000 7f1656a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1650147a40 con 0x7f16500ae130 2024-04-17T05:33:59.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.787+0000 7f1656a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1650147de0 con 0x7f1650151360 2024-04-17T05:33:59.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.787+0000 7f1656a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f16500aec00 con 0x7f16500add50 2024-04-17T05:33:59.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.787+0000 7f1654c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16500ae130 0x7f16501e11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:59.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.787+0000 7f1654c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16500ae130 0x7f16501e11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49092/0 (socket says 172.21.15.123:49092) 2024-04-17T05:33:59.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.787+0000 7f1654c00640 1 -- 172.21.15.123:0/3492938855 learned_addr learned my addr 172.21.15.123:0/3492938855 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:33:59.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.787+0000 7f1656000640 1 --2- 172.21.15.123:0/3492938855 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1650151360 0x7f165013a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:59.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.787+0000 7f1655600640 1 --2- 172.21.15.123:0/3492938855 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16500add50 0x7f16501e0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:59.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.787+0000 7f1654c00640 1 -- 172.21.15.123:0/3492938855 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16500add50 msgr2=0x7f16501e0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:59.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.787+0000 7f1654c00640 1 --2- 172.21.15.123:0/3492938855 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f16500add50 0x7f16501e0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:59.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.787+0000 7f1654c00640 1 -- 172.21.15.123:0/3492938855 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1650151360 msgr2=0x7f165013a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:59.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.787+0000 7f1654c00640 1 --2- 172.21.15.123:0/3492938855 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1650151360 0x7f165013a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:59.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.787+0000 7f1654c00640 1 -- 172.21.15.123:0/3492938855 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1650143770 con 0x7f16500ae130 2024-04-17T05:33:59.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.788+0000 7f1654c00640 1 --2- 172.21.15.123:0/3492938855 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16500ae130 0x7f16501e11d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f163c00c400 tx=0x7f163c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:59.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.788+0000 7f164d600640 1 -- 172.21.15.123:0/3492938855 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c0052d0 con 0x7f16500ae130 2024-04-17T05:33:59.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.788+0000 7f164d600640 1 -- 172.21.15.123:0/3492938855 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f163c005490 con 0x7f16500ae130 2024-04-17T05:33:59.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.788+0000 7f164d600640 1 -- 172.21.15.123:0/3492938855 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c007260 con 0x7f16500ae130 2024-04-17T05:33:59.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.788+0000 7f1656a00640 1 -- 172.21.15.123:0/3492938855 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1650142450 con 0x7f16500ae130 2024-04-17T05:33:59.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.788+0000 7f1656a00640 1 -- 172.21.15.123:0/3492938855 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16501e1710 con 0x7f16500ae130 2024-04-17T05:33:59.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.789+0000 7f1656a00640 1 -- 172.21.15.123:0/3492938855 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1650075b30 con 0x7f16500ae130 2024-04-17T05:33:59.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.790+0000 7f164d600640 1 -- 172.21.15.123:0/3492938855 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f163c007400 con 0x7f16500ae130 2024-04-17T05:33:59.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.791+0000 7f164d600640 1 --2- 172.21.15.123:0/3492938855 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f163006c920 0x7f163006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:59.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.791+0000 7f164d600640 1 -- 172.21.15.123:0/3492938855 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f163c08b490 con 0x7f16500ae130 2024-04-17T05:33:59.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.792+0000 7f164d600640 1 --2- 172.21.15.123:0/3492938855 >> [v2:172.21.15.164:6800/606484349,v1:172.21.15.164:6801/606484349] conn(0x7f16300763b0 0x7f1630078850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:33:59.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.792+0000 7f164d600640 1 -- 172.21.15.123:0/3492938855 --> [v2:172.21.15.164:6800/606484349,v1:172.21.15.164:6801/606484349] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f163c009e50 con 0x7f16300763b0 2024-04-17T05:33:59.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.792+0000 7f164d600640 1 -- 172.21.15.123:0/3492938855 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f163c092050 con 0x7f16500ae130 2024-04-17T05:33:59.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.792+0000 7f1655600640 1 --2- 172.21.15.123:0/3492938855 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f163006c920 0x7f163006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:59.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.792+0000 7f1656000640 1 --2- 172.21.15.123:0/3492938855 >> [v2:172.21.15.164:6800/606484349,v1:172.21.15.164:6801/606484349] conn(0x7f16300763b0 0x7f1630078850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:33:59.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.793+0000 7f1655600640 1 --2- 172.21.15.123:0/3492938855 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f163006c920 0x7f163006ede0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f16440011e0 tx=0x7f1644009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:59.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.793+0000 7f1656000640 1 --2- 172.21.15.123:0/3492938855 >> [v2:172.21.15.164:6800/606484349,v1:172.21.15.164:6801/606484349] conn(0x7f16300763b0 0x7f1630078850 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:33:59.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.795+0000 7f164d600640 1 -- 172.21.15.123:0/3492938855 <== osd.4 v2:172.21.15.164:6800/606484349 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f163c009e50 con 0x7f16300763b0 2024-04-17T05:33:59.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.810+0000 7f1656a00640 1 -- 172.21.15.123:0/3492938855 --> [v2:172.21.15.164:6800/606484349,v1:172.21.15.164:6801/606484349] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f16500b5a20 con 0x7f16300763b0 2024-04-17T05:33:59.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.812+0000 7f164d600640 1 -- 172.21.15.123:0/3492938855 <== osd.4 v2:172.21.15.164:6800/606484349 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f16500b5a20 con 0x7f16300763b0 2024-04-17T05:33:59.811 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-04-17T05:33:59.811 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T05:33:59.811 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-04-17T05:33:59.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.812+0000 7f1656a00640 1 -- 172.21.15.123:0/3492938855 >> [v2:172.21.15.164:6800/606484349,v1:172.21.15.164:6801/606484349] conn(0x7f16300763b0 msgr2=0x7f1630078850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:59.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.812+0000 7f1656a00640 1 --2- 172.21.15.123:0/3492938855 >> [v2:172.21.15.164:6800/606484349,v1:172.21.15.164:6801/606484349] conn(0x7f16300763b0 0x7f1630078850 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:33:59.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.812+0000 7f1656a00640 1 -- 172.21.15.123:0/3492938855 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f163006c920 msgr2=0x7f163006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:59.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.812+0000 7f1656a00640 1 --2- 172.21.15.123:0/3492938855 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f163006c920 0x7f163006ede0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f16440011e0 tx=0x7f1644009040 comp rx=0 tx=0).stop 2024-04-17T05:33:59.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.812+0000 7f1656a00640 1 -- 172.21.15.123:0/3492938855 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16500ae130 msgr2=0x7f16501e11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:33:59.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.812+0000 7f1656a00640 1 --2- 172.21.15.123:0/3492938855 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16500ae130 0x7f16501e11d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f163c00c400 tx=0x7f163c00c8c0 comp rx=0 tx=0).stop 2024-04-17T05:33:59.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.812+0000 7f1656000640 1 -- 172.21.15.123:0/3492938855 reap_dead start 2024-04-17T05:33:59.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.813+0000 7f1656a00640 1 -- 172.21.15.123:0/3492938855 shutdown_connections 2024-04-17T05:33:59.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.813+0000 7f1656a00640 1 -- 172.21.15.123:0/3492938855 >> 172.21.15.123:0/3492938855 conn(0x7f165006c190 msgr2=0x7f16500b7060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:33:59.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.813+0000 7f1656a00640 1 -- 172.21.15.123:0/3492938855 shutdown_connections 2024-04-17T05:33:59.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:33:59.813+0000 7f1656a00640 1 -- 172.21.15.123:0/3492938855 wait complete. 2024-04-17T05:33:59.828 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-17T05:34:00.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.037+0000 7f6452a00640 1 Processor -- start 2024-04-17T05:34:00.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.037+0000 7f6452a00640 1 -- start start 2024-04-17T05:34:00.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.039+0000 7f6452a00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f644c0730d0 0x7f644c0b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:00.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.039+0000 7f6452a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f644c149840 0x7f644c150440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:00.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.039+0000 7f6452a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f644c0b4fb0 con 0x7f644c0b4bd0 2024-04-17T05:34:00.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.039+0000 7f6452a00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f644c0ba130 con 0x7f644c149840 2024-04-17T05:34:00.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.039+0000 7f6452a00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f644c140360 con 0x7f644c0730d0 2024-04-17T05:34:00.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.039+0000 7f6452000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f644c149840 0x7f644c150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:00.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.039+0000 7f6451600640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f644c0b4bd0 0x7f644c06da20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59198/0 (socket says 172.21.15.123:59198) 2024-04-17T05:34:00.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.039+0000 7f6452000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f644c149840 0x7f644c150440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49104/0 (socket says 172.21.15.123:49104) 2024-04-17T05:34:00.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.039+0000 7f6451600640 1 -- 172.21.15.123:0/3570204928 learned_addr learned my addr 172.21.15.123:0/3570204928 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:34:00.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.039+0000 7f6450c00640 1 --2- 172.21.15.123:0/3570204928 >> v2:172.21.15.164:3300/0 conn(0x7f644c0730d0 0x7f644c0b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:00.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.039+0000 7f6452000640 1 -- 172.21.15.123:0/3570204928 >> v2:172.21.15.164:3300/0 conn(0x7f644c0730d0 msgr2=0x7f644c0b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:00.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.039+0000 7f6452000640 1 --2- 172.21.15.123:0/3570204928 >> v2:172.21.15.164:3300/0 conn(0x7f644c0730d0 0x7f644c0b3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:00.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.039+0000 7f6452000640 1 -- 172.21.15.123:0/3570204928 >> v1:172.21.15.123:6789/0 conn(0x7f644c0b4bd0 legacy=0x7f644c06da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:00.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.040+0000 7f644be00640 1 -- 172.21.15.123:0/3570204928 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3577085344 0 0) 0x7f644c0b4fb0 con 0x7f644c0b4bd0 2024-04-17T05:34:00.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.040+0000 7f6452000640 1 -- 172.21.15.123:0/3570204928 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f644c06cf00 con 0x7f644c149840 2024-04-17T05:34:00.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.041+0000 7f6452000640 1 --2- 172.21.15.123:0/3570204928 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f644c149840 0x7f644c150440 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f644c0b3890 tx=0x7f644402bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0a70686e8a26ef3 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:00.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.041+0000 7f644be00640 1 -- 172.21.15.123:0/3570204928 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6444039070 con 0x7f644c149840 2024-04-17T05:34:00.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.041+0000 7f644be00640 1 -- 172.21.15.123:0/3570204928 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f644402cb60 con 0x7f644c149840 2024-04-17T05:34:00.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.041+0000 7f644be00640 1 -- 172.21.15.123:0/3570204928 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6444034440 con 0x7f644c149840 2024-04-17T05:34:00.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.042+0000 7f6452a00640 1 -- 172.21.15.123:0/3570204928 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f644c149840 msgr2=0x7f644c150440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:00.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.042+0000 7f6452a00640 1 --2- 172.21.15.123:0/3570204928 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f644c149840 0x7f644c150440 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f644c0b3890 tx=0x7f644402bdb0 comp rx=0 tx=0).stop 2024-04-17T05:34:00.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.042+0000 7f6452a00640 1 -- 172.21.15.123:0/3570204928 shutdown_connections 2024-04-17T05:34:00.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.042+0000 7f6452a00640 1 --2- 172.21.15.123:0/3570204928 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f644c149840 0x7f644c150440 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:00.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.042+0000 7f6452a00640 1 --2- 172.21.15.123:0/3570204928 >> v2:172.21.15.164:3300/0 conn(0x7f644c0730d0 0x7f644c0b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:00.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.042+0000 7f6452a00640 1 -- 172.21.15.123:0/3570204928 >> 172.21.15.123:0/3570204928 conn(0x7f644c06c430 msgr2=0x7f644c0b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:00.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.042+0000 7f6452a00640 1 -- 172.21.15.123:0/3570204928 shutdown_connections 2024-04-17T05:34:00.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.042+0000 7f6452a00640 1 -- 172.21.15.123:0/3570204928 wait complete. 2024-04-17T05:34:00.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.044+0000 7f6452a00640 1 Processor -- start 2024-04-17T05:34:00.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.044+0000 7f6452a00640 1 -- start start 2024-04-17T05:34:00.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.045+0000 7f6452a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f644c0730d0 0x7f644c1e0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:00.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.045+0000 7f6452a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f644c0b4bd0 0x7f644c13e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:00.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.045+0000 7f6452a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f644c149840 0x7f644c071850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:00.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.045+0000 7f6452a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f644c06e130 con 0x7f644c0730d0 2024-04-17T05:34:00.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.045+0000 7f6452a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f644c06d550 con 0x7f644c0b4bd0 2024-04-17T05:34:00.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.045+0000 7f6452a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f644c149110 con 0x7f644c149840 2024-04-17T05:34:00.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.045+0000 7f6451600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f644c0730d0 0x7f644c1e0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:00.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.045+0000 7f6451600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f644c0730d0 0x7f644c1e0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49118/0 (socket says 172.21.15.123:49118) 2024-04-17T05:34:00.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.045+0000 7f6451600640 1 -- 172.21.15.123:0/1410723757 learned_addr learned my addr 172.21.15.123:0/1410723757 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:34:00.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.045+0000 7f6452000640 1 --2- 172.21.15.123:0/1410723757 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f644c149840 0x7f644c071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:00.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.045+0000 7f6450c00640 1 --2- 172.21.15.123:0/1410723757 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f644c0b4bd0 0x7f644c13e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:00.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.045+0000 7f6451600640 1 -- 172.21.15.123:0/1410723757 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f644c149840 msgr2=0x7f644c071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:00.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.045+0000 7f6451600640 1 --2- 172.21.15.123:0/1410723757 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f644c149840 0x7f644c071850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:00.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.045+0000 7f6451600640 1 -- 172.21.15.123:0/1410723757 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f644c0b4bd0 msgr2=0x7f644c13e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:00.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.045+0000 7f6451600640 1 --2- 172.21.15.123:0/1410723757 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f644c0b4bd0 0x7f644c13e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:00.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.045+0000 7f6451600640 1 -- 172.21.15.123:0/1410723757 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f644c1e15f0 con 0x7f644c0730d0 2024-04-17T05:34:00.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.046+0000 7f6451600640 1 --2- 172.21.15.123:0/1410723757 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f644c0730d0 0x7f644c1e0cf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f644000c4d0 tx=0x7f644000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:00.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.046+0000 7f6449600640 1 -- 172.21.15.123:0/1410723757 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6440018070 con 0x7f644c0730d0 2024-04-17T05:34:00.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.046+0000 7f6449600640 1 -- 172.21.15.123:0/1410723757 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6440007500 con 0x7f644c0730d0 2024-04-17T05:34:00.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.046+0000 7f6449600640 1 -- 172.21.15.123:0/1410723757 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6440004a20 con 0x7f644c0730d0 2024-04-17T05:34:00.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.046+0000 7f6452a00640 1 -- 172.21.15.123:0/1410723757 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f644c1e18f0 con 0x7f644c0730d0 2024-04-17T05:34:00.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.046+0000 7f6452a00640 1 -- 172.21.15.123:0/1410723757 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f644c1e1230 con 0x7f644c0730d0 2024-04-17T05:34:00.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.047+0000 7f6452a00640 1 -- 172.21.15.123:0/1410723757 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f644c1e1bd0 con 0x7f644c0730d0 2024-04-17T05:34:00.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.048+0000 7f6449600640 1 -- 172.21.15.123:0/1410723757 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6440004bc0 con 0x7f644c0730d0 2024-04-17T05:34:00.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.050+0000 7f6449600640 1 --2- 172.21.15.123:0/1410723757 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f642c06c920 0x7f642c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:00.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.050+0000 7f6449600640 1 -- 172.21.15.123:0/1410723757 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f644008b120 con 0x7f644c0730d0 2024-04-17T05:34:00.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.050+0000 7f6450c00640 1 --2- 172.21.15.123:0/1410723757 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f642c06c920 0x7f642c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:00.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.051+0000 7f6450c00640 1 --2- 172.21.15.123:0/1410723757 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f642c06c920 0x7f642c06ede0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f644c1db3b0 tx=0x7f6438008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:00.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.055+0000 7f6449600640 1 -- 172.21.15.123:0/1410723757 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f644c1e1bd0 con 0x7f644c0730d0 2024-04-17T05:34:00.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.257+0000 7f6452a00640 1 -- 172.21.15.123:0/1410723757 --> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f644c075b30 con 0x7f642c06c920 2024-04-17T05:34:00.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.258+0000 7f6449600640 1 -- 172.21.15.123:0/1410723757 <== mgr.4103 v2:172.21.15.164:6832/4204006015 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f644c075b30 con 0x7f642c06c920 2024-04-17T05:34:00.257 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 4 to deep-scrub 2024-04-17T05:34:00.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.260+0000 7f6452a00640 1 -- 172.21.15.123:0/1410723757 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f642c06c920 msgr2=0x7f642c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:00.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.260+0000 7f6452a00640 1 --2- 172.21.15.123:0/1410723757 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f642c06c920 0x7f642c06ede0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f644c1db3b0 tx=0x7f6438008040 comp rx=0 tx=0).stop 2024-04-17T05:34:00.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.260+0000 7f6452a00640 1 -- 172.21.15.123:0/1410723757 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f644c0730d0 msgr2=0x7f644c1e0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:00.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.260+0000 7f6452a00640 1 --2- 172.21.15.123:0/1410723757 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f644c0730d0 0x7f644c1e0cf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f644000c4d0 tx=0x7f644000c990 comp rx=0 tx=0).stop 2024-04-17T05:34:00.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.261+0000 7f6452a00640 1 -- 172.21.15.123:0/1410723757 shutdown_connections 2024-04-17T05:34:00.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.261+0000 7f6452a00640 1 --2- 172.21.15.123:0/1410723757 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f642c06c920 0x7f642c06ede0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:00.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.261+0000 7f6452a00640 1 --2- 172.21.15.123:0/1410723757 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f644c149840 0x7f644c071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:00.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.261+0000 7f6452a00640 1 --2- 172.21.15.123:0/1410723757 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f644c0b4bd0 0x7f644c13e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:00.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.261+0000 7f6452a00640 1 --2- 172.21.15.123:0/1410723757 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f644c0730d0 0x7f644c1e0cf0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:00.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.261+0000 7f6452a00640 1 -- 172.21.15.123:0/1410723757 >> 172.21.15.123:0/1410723757 conn(0x7f644c06c430 msgr2=0x7f644c0b7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:00.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.261+0000 7f6452a00640 1 -- 172.21.15.123:0/1410723757 shutdown_connections 2024-04-17T05:34:00.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.261+0000 7f6452a00640 1 -- 172.21.15.123:0/1410723757 wait complete. 2024-04-17T05:34:00.278 INFO:tasks.ceph:Scrubbing osd.5 2024-04-17T05:34:00.278 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-17T05:34:00.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.478+0000 7f0435a00640 1 Processor -- start 2024-04-17T05:34:00.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.478+0000 7f0435a00640 1 -- start start 2024-04-17T05:34:00.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.479+0000 7f0435a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f04300b3fd0 0x7f04300b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:00.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.479+0000 7f0435a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f043013ea50 0x7f0430148280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:00.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.479+0000 7f0435a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04300b43b0 con 0x7f0430147dd0 2024-04-17T05:34:00.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.479+0000 7f0435a00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f04300b1b10 con 0x7f04300b3fd0 2024-04-17T05:34:00.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.479+0000 7f0435a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f0430070fc0 con 0x7f043013ea50 2024-04-17T05:34:00.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.480+0000 7f042ea00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f04300b3fd0 0x7f04300b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:00.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.480+0000 7f0426000640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f0430147dd0 0x7f043013e340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59200/0 (socket says 172.21.15.123:59200) 2024-04-17T05:34:00.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.480+0000 7f0426000640 1 -- 172.21.15.123:0/4076161969 learned_addr learned my addr 172.21.15.123:0/4076161969 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:34:00.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.480+0000 7f042f400640 1 --2- 172.21.15.123:0/4076161969 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f043013ea50 0x7f0430148280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:00.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.480+0000 7f042ea00640 1 -- 172.21.15.123:0/4076161969 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f043013ea50 msgr2=0x7f0430148280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:00.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.480+0000 7f042ea00640 1 --2- 172.21.15.123:0/4076161969 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f043013ea50 0x7f0430148280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:00.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.480+0000 7f042ea00640 1 -- 172.21.15.123:0/4076161969 >> v1:172.21.15.123:6789/0 conn(0x7f0430147dd0 legacy=0x7f043013e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:00.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.480+0000 7f042e000640 1 -- 172.21.15.123:0/4076161969 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 950475088 0 0) 0x7f04300b43b0 con 0x7f0430147dd0 2024-04-17T05:34:00.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.480+0000 7f042ea00640 1 -- 172.21.15.123:0/4076161969 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04300b1d60 con 0x7f04300b3fd0 2024-04-17T05:34:00.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.480+0000 7f042f400640 1 --2- 172.21.15.123:0/4076161969 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f043013ea50 0x7f0430148280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:34:00.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.481+0000 7f042ea00640 1 --2- 172.21.15.123:0/4076161969 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04300b3fd0 0x7f04300b33a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0420009dc0 tx=0x7f042002bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99cf9760307a8cb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:00.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.482+0000 7f042e000640 1 -- 172.21.15.123:0/4076161969 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0420039070 con 0x7f04300b3fd0 2024-04-17T05:34:00.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.482+0000 7f042e000640 1 -- 172.21.15.123:0/4076161969 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f042002cb20 con 0x7f04300b3fd0 2024-04-17T05:34:00.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.482+0000 7f042e000640 1 -- 172.21.15.123:0/4076161969 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0420034440 con 0x7f04300b3fd0 2024-04-17T05:34:00.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.482+0000 7f0435a00640 1 -- 172.21.15.123:0/4076161969 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04300b3fd0 msgr2=0x7f04300b33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:00.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.482+0000 7f0435a00640 1 --2- 172.21.15.123:0/4076161969 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04300b3fd0 0x7f04300b33a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0420009dc0 tx=0x7f042002bd70 comp rx=0 tx=0).stop 2024-04-17T05:34:00.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.482+0000 7f0435a00640 1 -- 172.21.15.123:0/4076161969 shutdown_connections 2024-04-17T05:34:00.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.482+0000 7f0435a00640 1 --2- 172.21.15.123:0/4076161969 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f043013ea50 0x7f0430148280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:00.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.482+0000 7f0435a00640 1 --2- 172.21.15.123:0/4076161969 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04300b3fd0 0x7f04300b33a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:00.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.482+0000 7f0435a00640 1 -- 172.21.15.123:0/4076161969 >> 172.21.15.123:0/4076161969 conn(0x7f04300b9360 msgr2=0x7f04300b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:00.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.482+0000 7f0435a00640 1 -- 172.21.15.123:0/4076161969 shutdown_connections 2024-04-17T05:34:00.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.483+0000 7f0435a00640 1 -- 172.21.15.123:0/4076161969 wait complete. 2024-04-17T05:34:00.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.484+0000 7f0435a00640 1 Processor -- start 2024-04-17T05:34:00.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.484+0000 7f0435a00640 1 -- start start 2024-04-17T05:34:00.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.485+0000 7f0435a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04300b3fd0 0x7f04301d2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:00.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.485+0000 7f0435a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f043013ea50 0x7f04301472c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:00.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.485+0000 7f0435a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0430147dd0 0x7f043013d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:00.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.485+0000 7f0435a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f04300b27b0 con 0x7f04300b3fd0 2024-04-17T05:34:00.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.485+0000 7f0435a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f04300b2320 con 0x7f0430147dd0 2024-04-17T05:34:00.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.485+0000 7f0435a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f04301dd3e0 con 0x7f043013ea50 2024-04-17T05:34:00.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.485+0000 7f042ea00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04300b3fd0 0x7f04301d2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:00.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.485+0000 7f042ea00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04300b3fd0 0x7f04301d2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49144/0 (socket says 172.21.15.123:49144) 2024-04-17T05:34:00.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.485+0000 7f042ea00640 1 -- 172.21.15.123:0/1226870746 learned_addr learned my addr 172.21.15.123:0/1226870746 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:34:00.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.485+0000 7f0426000640 1 --2- 172.21.15.123:0/1226870746 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f043013ea50 0x7f04301472c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:00.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.486+0000 7f042ea00640 1 -- 172.21.15.123:0/1226870746 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f043013ea50 msgr2=0x7f04301472c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:00.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.486+0000 7f042f400640 1 --2- 172.21.15.123:0/1226870746 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0430147dd0 0x7f043013d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:00.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.486+0000 7f042ea00640 1 --2- 172.21.15.123:0/1226870746 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f043013ea50 0x7f04301472c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:00.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.486+0000 7f042ea00640 1 -- 172.21.15.123:0/1226870746 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0430147dd0 msgr2=0x7f043013d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:00.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.486+0000 7f042ea00640 1 --2- 172.21.15.123:0/1226870746 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0430147dd0 0x7f043013d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:00.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.486+0000 7f042ea00640 1 -- 172.21.15.123:0/1226870746 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04300aa220 con 0x7f04300b3fd0 2024-04-17T05:34:00.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.486+0000 7f0426000640 1 --2- 172.21.15.123:0/1226870746 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f043013ea50 0x7f04301472c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:34:00.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.486+0000 7f042ea00640 1 --2- 172.21.15.123:0/1226870746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04300b3fd0 0x7f04301d2220 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0420009dc0 tx=0x7f0420004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:00.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.486+0000 7f0427400640 1 -- 172.21.15.123:0/1226870746 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0420039050 con 0x7f04300b3fd0 2024-04-17T05:34:00.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.486+0000 7f0427400640 1 -- 172.21.15.123:0/1226870746 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f042003a040 con 0x7f04300b3fd0 2024-04-17T05:34:00.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.486+0000 7f0427400640 1 -- 172.21.15.123:0/1226870746 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042003e830 con 0x7f04300b3fd0 2024-04-17T05:34:00.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.486+0000 7f0435a00640 1 -- 172.21.15.123:0/1226870746 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f043013e610 con 0x7f04300b3fd0 2024-04-17T05:34:00.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.487+0000 7f0435a00640 1 -- 172.21.15.123:0/1226870746 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04300a96d0 con 0x7f04300b3fd0 2024-04-17T05:34:00.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.488+0000 7f0435a00640 1 -- 172.21.15.123:0/1226870746 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f04300aa5c0 con 0x7f04300b3fd0 2024-04-17T05:34:00.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.489+0000 7f0427400640 1 -- 172.21.15.123:0/1226870746 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0420047020 con 0x7f04300b3fd0 2024-04-17T05:34:00.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.490+0000 7f0427400640 1 --2- 172.21.15.123:0/1226870746 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f040c06c8f0 0x7f040c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:00.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.490+0000 7f0427400640 1 -- 172.21.15.123:0/1226870746 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f04200ae460 con 0x7f04300b3fd0 2024-04-17T05:34:00.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.490+0000 7f0427400640 1 --2- 172.21.15.123:0/1226870746 >> [v2:172.21.15.164:6802/1376989593,v1:172.21.15.164:6805/1376989593] conn(0x7f040c076380 0x7f040c078820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:00.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.490+0000 7f0427400640 1 -- 172.21.15.123:0/1226870746 --> [v2:172.21.15.164:6802/1376989593,v1:172.21.15.164:6805/1376989593] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f04200091a0 con 0x7f040c076380 2024-04-17T05:34:00.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.490+0000 7f0427400640 1 -- 172.21.15.123:0/1226870746 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f04200b5050 con 0x7f04300b3fd0 2024-04-17T05:34:00.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.490+0000 7f0426000640 1 --2- 172.21.15.123:0/1226870746 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f040c06c8f0 0x7f040c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:00.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.491+0000 7f042f400640 1 --2- 172.21.15.123:0/1226870746 >> [v2:172.21.15.164:6802/1376989593,v1:172.21.15.164:6805/1376989593] conn(0x7f040c076380 0x7f040c078820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:00.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.491+0000 7f0426000640 1 --2- 172.21.15.123:0/1226870746 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f040c06c8f0 0x7f040c06edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0430145620 tx=0x7f0418009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:00.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.491+0000 7f042f400640 1 --2- 172.21.15.123:0/1226870746 >> [v2:172.21.15.164:6802/1376989593,v1:172.21.15.164:6805/1376989593] conn(0x7f040c076380 0x7f040c078820 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:00.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.493+0000 7f0427400640 1 -- 172.21.15.123:0/1226870746 <== osd.5 v2:172.21.15.164:6802/1376989593 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f04200091a0 con 0x7f040c076380 2024-04-17T05:34:00.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.508+0000 7f0435a00640 1 -- 172.21.15.123:0/1226870746 --> [v2:172.21.15.164:6802/1376989593,v1:172.21.15.164:6805/1376989593] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0430068a40 con 0x7f040c076380 2024-04-17T05:34:00.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.509+0000 7f0427400640 1 -- 172.21.15.123:0/1226870746 <== osd.5 v2:172.21.15.164:6802/1376989593 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0430068a40 con 0x7f040c076380 2024-04-17T05:34:00.508 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-04-17T05:34:00.508 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T05:34:00.508 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-04-17T05:34:00.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.509+0000 7f0435a00640 1 -- 172.21.15.123:0/1226870746 >> [v2:172.21.15.164:6802/1376989593,v1:172.21.15.164:6805/1376989593] conn(0x7f040c076380 msgr2=0x7f040c078820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:00.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.509+0000 7f0435a00640 1 --2- 172.21.15.123:0/1226870746 >> [v2:172.21.15.164:6802/1376989593,v1:172.21.15.164:6805/1376989593] conn(0x7f040c076380 0x7f040c078820 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:00.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.509+0000 7f0435a00640 1 -- 172.21.15.123:0/1226870746 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f040c06c8f0 msgr2=0x7f040c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:00.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.509+0000 7f0435a00640 1 --2- 172.21.15.123:0/1226870746 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f040c06c8f0 0x7f040c06edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0430145620 tx=0x7f0418009040 comp rx=0 tx=0).stop 2024-04-17T05:34:00.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.510+0000 7f0435a00640 1 -- 172.21.15.123:0/1226870746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04300b3fd0 msgr2=0x7f04301d2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:00.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.510+0000 7f0435a00640 1 --2- 172.21.15.123:0/1226870746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04300b3fd0 0x7f04301d2220 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0420009dc0 tx=0x7f0420004a40 comp rx=0 tx=0).stop 2024-04-17T05:34:00.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.510+0000 7f042f400640 1 -- 172.21.15.123:0/1226870746 reap_dead start 2024-04-17T05:34:00.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.510+0000 7f0435a00640 1 -- 172.21.15.123:0/1226870746 shutdown_connections 2024-04-17T05:34:00.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.510+0000 7f0435a00640 1 -- 172.21.15.123:0/1226870746 >> 172.21.15.123:0/1226870746 conn(0x7f04300b9360 msgr2=0x7f04301447c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:00.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.510+0000 7f0435a00640 1 -- 172.21.15.123:0/1226870746 shutdown_connections 2024-04-17T05:34:00.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.510+0000 7f0435a00640 1 -- 172.21.15.123:0/1226870746 wait complete. 2024-04-17T05:34:00.525 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-17T05:34:00.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.731+0000 7fe195a00640 1 Processor -- start 2024-04-17T05:34:00.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.731+0000 7fe195a00640 1 -- start start 2024-04-17T05:34:00.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.732+0000 7fe195a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1900b61f0 0x7fe1900b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:00.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.732+0000 7fe195a00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe1900b42e0 0x7fe190147ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:00.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.732+0000 7fe195a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1900b65d0 con 0x7fe190148410 2024-04-17T05:34:00.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.732+0000 7fe195a00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7fe1900b4d50 con 0x7fe1900b42e0 2024-04-17T05:34:00.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.732+0000 7fe195a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fe1900b75a0 con 0x7fe1900b61f0 2024-04-17T05:34:00.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.733+0000 7fe195000640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe190148410 0x7fe1900b51e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59214/0 (socket says 172.21.15.123:59214) 2024-04-17T05:34:00.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.733+0000 7fe195000640 1 -- 172.21.15.123:0/1982592420 learned_addr learned my addr 172.21.15.123:0/1982592420 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:34:00.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.733+0000 7fe18fe00640 1 --2- 172.21.15.123:0/1982592420 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1900b61f0 0x7fe1900b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:00.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.733+0000 7fe18f400640 1 --2- 172.21.15.123:0/1982592420 >> v2:172.21.15.164:3300/0 conn(0x7fe1900b42e0 0x7fe190147ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:00.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.733+0000 7fe18ea00640 1 -- 172.21.15.123:0/1982592420 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3854927007 0 0) 0x7fe1900b65d0 con 0x7fe190148410 2024-04-17T05:34:00.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.733+0000 7fe18ea00640 1 -- 172.21.15.123:0/1982592420 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe174003520 con 0x7fe190148410 2024-04-17T05:34:00.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.734+0000 7fe18ea00640 1 -- 172.21.15.123:0/1982592420 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2024111479 0 0) 0x7fe174003520 con 0x7fe190148410 2024-04-17T05:34:00.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.734+0000 7fe18ea00640 1 -- 172.21.15.123:0/1982592420 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1900b61f0 msgr2=0x7fe1900b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:00.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.734+0000 7fe18ea00640 1 --2- 172.21.15.123:0/1982592420 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1900b61f0 0x7fe1900b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:00.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.734+0000 7fe18ea00640 1 -- 172.21.15.123:0/1982592420 >> v2:172.21.15.164:3300/0 conn(0x7fe1900b42e0 msgr2=0x7fe190147ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:00.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.734+0000 7fe18ea00640 1 --2- 172.21.15.123:0/1982592420 >> v2:172.21.15.164:3300/0 conn(0x7fe1900b42e0 0x7fe190147ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:00.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.734+0000 7fe18ea00640 1 -- 172.21.15.123:0/1982592420 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1900b49e0 con 0x7fe190148410 2024-04-17T05:34:00.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.734+0000 7fe18ea00640 1 -- 172.21.15.123:0/1982592420 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1042962670 0 0) 0x7fe188001670 con 0x7fe190148410 2024-04-17T05:34:00.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.734+0000 7fe18ea00640 1 -- 172.21.15.123:0/1982592420 >> v1:172.21.15.123:6789/0 conn(0x7fe190148410 legacy=0x7fe1900b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:00.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.734+0000 7fe18ea00640 1 --2- 172.21.15.123:0/1982592420 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1900b61f0 0x7fe1740039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:00.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.734+0000 7fe18ea00640 1 --2- 172.21.15.123:0/1982592420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe174003f30 0x7fe174004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:00.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.734+0000 7fe18ea00640 1 --2- 172.21.15.123:0/1982592420 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe174004d40 0x7fe1740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:00.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.734+0000 7fe18ea00640 1 -- 172.21.15.123:0/1982592420 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe1900b4d50 con 0x7fe174003f30 2024-04-17T05:34:00.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.734+0000 7fe18ea00640 1 -- 172.21.15.123:0/1982592420 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe1900b75a0 con 0x7fe174004d40 2024-04-17T05:34:00.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.734+0000 7fe18ea00640 1 -- 172.21.15.123:0/1982592420 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fe17400b9c0 con 0x7fe1900b61f0 2024-04-17T05:34:00.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.734+0000 7fe18f400640 1 --2- 172.21.15.123:0/1982592420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe174003f30 0x7fe174004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:00.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.734+0000 7fe18fe00640 1 --2- 172.21.15.123:0/1982592420 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1900b61f0 0x7fe1740039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:00.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.735+0000 7fe195000640 1 --2- 172.21.15.123:0/1982592420 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe174004d40 0x7fe1740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:00.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.735+0000 7fe18f400640 1 -- 172.21.15.123:0/1982592420 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1900b61f0 msgr2=0x7fe1740039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:00.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.735+0000 7fe18f400640 1 --2- 172.21.15.123:0/1982592420 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe1900b61f0 0x7fe1740039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:00.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.735+0000 7fe18f400640 1 -- 172.21.15.123:0/1982592420 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe174004d40 msgr2=0x7fe1740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:00.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.735+0000 7fe18f400640 1 --2- 172.21.15.123:0/1982592420 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe174004d40 0x7fe1740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:00.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.735+0000 7fe18f400640 1 -- 172.21.15.123:0/1982592420 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe174003520 con 0x7fe174003f30 2024-04-17T05:34:00.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.735+0000 7fe195000640 1 --2- 172.21.15.123:0/1982592420 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe174004d40 0x7fe1740051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:34:00.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.736+0000 7fe18f400640 1 --2- 172.21.15.123:0/1982592420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe174003f30 0x7fe174004800 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe17c009ac0 tx=0x7fe174005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ac2b154bd38931 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:00.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.736+0000 7fe18ea00640 1 -- 172.21.15.123:0/1982592420 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17c039070 con 0x7fe174003f30 2024-04-17T05:34:00.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.736+0000 7fe18ea00640 1 -- 172.21.15.123:0/1982592420 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe17c02c6d0 con 0x7fe174003f30 2024-04-17T05:34:00.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.736+0000 7fe18ea00640 1 -- 172.21.15.123:0/1982592420 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17c009690 con 0x7fe174003f30 2024-04-17T05:34:00.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.736+0000 7fe195a00640 1 -- 172.21.15.123:0/1982592420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe174003f30 msgr2=0x7fe174004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:00.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.736+0000 7fe195a00640 1 --2- 172.21.15.123:0/1982592420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe174003f30 0x7fe174004800 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe17c009ac0 tx=0x7fe174005830 comp rx=0 tx=0).stop 2024-04-17T05:34:00.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.736+0000 7fe195000640 1 -- 172.21.15.123:0/1982592420 reap_dead start 2024-04-17T05:34:00.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.737+0000 7fe195a00640 1 -- 172.21.15.123:0/1982592420 shutdown_connections 2024-04-17T05:34:00.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.737+0000 7fe195a00640 1 -- 172.21.15.123:0/1982592420 >> 172.21.15.123:0/1982592420 conn(0x7fe19006c260 msgr2=0x7fe1900b9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:00.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.737+0000 7fe195a00640 1 -- 172.21.15.123:0/1982592420 shutdown_connections 2024-04-17T05:34:00.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.737+0000 7fe195a00640 1 -- 172.21.15.123:0/1982592420 wait complete. 2024-04-17T05:34:00.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.738+0000 7fe195a00640 1 Processor -- start 2024-04-17T05:34:00.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.738+0000 7fe195a00640 1 -- start start 2024-04-17T05:34:00.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.739+0000 7fe195a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe174003f30 0x7fe190140b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:00.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.739+0000 7fe195a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1901cf700 0x7fe1901e08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:00.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.739+0000 7fe195a00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe19013d3f0 0x7fe19013d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:00.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.739+0000 7fe195a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe1900b3da0 con 0x7fe1901cf700 2024-04-17T05:34:00.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.739+0000 7fe195a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe1900b5b40 con 0x7fe174003f30 2024-04-17T05:34:00.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.739+0000 7fe195a00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fe1900b3f20 con 0x7fe19013d3f0 2024-04-17T05:34:00.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.739+0000 7fe18f400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1901cf700 0x7fe1901e08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:00.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.740+0000 7fe18f400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1901cf700 0x7fe1901e08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49166/0 (socket says 172.21.15.123:49166) 2024-04-17T05:34:00.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.740+0000 7fe18f400640 1 -- 172.21.15.123:0/1588015673 learned_addr learned my addr 172.21.15.123:0/1588015673 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:34:00.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.740+0000 7fe18fe00640 1 --2- 172.21.15.123:0/1588015673 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe174003f30 0x7fe190140b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:00.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.740+0000 7fe195000640 1 --2- 172.21.15.123:0/1588015673 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe19013d3f0 0x7fe19013d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:00.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.740+0000 7fe18f400640 1 -- 172.21.15.123:0/1588015673 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe19013d3f0 msgr2=0x7fe19013d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:00.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.740+0000 7fe18f400640 1 --2- 172.21.15.123:0/1588015673 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe19013d3f0 0x7fe19013d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:00.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.740+0000 7fe18f400640 1 -- 172.21.15.123:0/1588015673 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe174003f30 msgr2=0x7fe190140b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:00.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.740+0000 7fe18f400640 1 --2- 172.21.15.123:0/1588015673 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe174003f30 0x7fe190140b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:00.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.740+0000 7fe18f400640 1 -- 172.21.15.123:0/1588015673 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1901d1d60 con 0x7fe1901cf700 2024-04-17T05:34:00.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.740+0000 7fe195000640 1 --2- 172.21.15.123:0/1588015673 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe19013d3f0 0x7fe19013d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:34:00.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.740+0000 7fe18f400640 1 --2- 172.21.15.123:0/1588015673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1901cf700 0x7fe1901e08a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe17c000c00 tx=0x7fe17c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:00.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.741+0000 7fe187e00640 1 -- 172.21.15.123:0/1588015673 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17c039050 con 0x7fe1901cf700 2024-04-17T05:34:00.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.741+0000 7fe187e00640 1 -- 172.21.15.123:0/1588015673 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe17c045070 con 0x7fe1901cf700 2024-04-17T05:34:00.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.741+0000 7fe195a00640 1 -- 172.21.15.123:0/1588015673 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1901d0b60 con 0x7fe1901cf700 2024-04-17T05:34:00.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.741+0000 7fe187e00640 1 -- 172.21.15.123:0/1588015673 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17c0044e0 con 0x7fe1901cf700 2024-04-17T05:34:00.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.741+0000 7fe195a00640 1 -- 172.21.15.123:0/1588015673 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1901d1fd0 con 0x7fe1901cf700 2024-04-17T05:34:00.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.742+0000 7fe195a00640 1 -- 172.21.15.123:0/1588015673 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe190075b30 con 0x7fe1901cf700 2024-04-17T05:34:00.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.743+0000 7fe187e00640 1 -- 172.21.15.123:0/1588015673 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe17c003a50 con 0x7fe1901cf700 2024-04-17T05:34:00.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.744+0000 7fe187e00640 1 --2- 172.21.15.123:0/1588015673 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe17006c8f0 0x7fe17006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:00.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.744+0000 7fe187e00640 1 -- 172.21.15.123:0/1588015673 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fe17c0adb90 con 0x7fe1901cf700 2024-04-17T05:34:00.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.744+0000 7fe18fe00640 1 --2- 172.21.15.123:0/1588015673 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe17006c8f0 0x7fe17006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:00.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.745+0000 7fe18fe00640 1 --2- 172.21.15.123:0/1588015673 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe17006c8f0 0x7fe17006edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe1900b3c80 tx=0x7fe18000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:00.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.749+0000 7fe187e00640 1 -- 172.21.15.123:0/1588015673 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fe17c04e020 con 0x7fe1901cf700 2024-04-17T05:34:00.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.946+0000 7fe195a00640 1 -- 172.21.15.123:0/1588015673 --> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fe1900b72c0 con 0x7fe17006c8f0 2024-04-17T05:34:00.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.948+0000 7fe187e00640 1 -- 172.21.15.123:0/1588015673 <== mgr.4103 v2:172.21.15.164:6832/4204006015 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe1900b72c0 con 0x7fe17006c8f0 2024-04-17T05:34:00.946 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 5 to deep-scrub 2024-04-17T05:34:00.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.949+0000 7fe195a00640 1 -- 172.21.15.123:0/1588015673 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe17006c8f0 msgr2=0x7fe17006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:00.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.950+0000 7fe195a00640 1 --2- 172.21.15.123:0/1588015673 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe17006c8f0 0x7fe17006edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe1900b3c80 tx=0x7fe18000b040 comp rx=0 tx=0).stop 2024-04-17T05:34:00.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.950+0000 7fe195a00640 1 -- 172.21.15.123:0/1588015673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1901cf700 msgr2=0x7fe1901e08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:00.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.950+0000 7fe195a00640 1 --2- 172.21.15.123:0/1588015673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1901cf700 0x7fe1901e08a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe17c000c00 tx=0x7fe17c004730 comp rx=0 tx=0).stop 2024-04-17T05:34:00.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.950+0000 7fe195a00640 1 -- 172.21.15.123:0/1588015673 shutdown_connections 2024-04-17T05:34:00.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.950+0000 7fe195a00640 1 --2- 172.21.15.123:0/1588015673 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe17006c8f0 0x7fe17006edb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:00.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.950+0000 7fe195a00640 1 --2- 172.21.15.123:0/1588015673 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe19013d3f0 0x7fe19013d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:00.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.950+0000 7fe195a00640 1 --2- 172.21.15.123:0/1588015673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1901cf700 0x7fe1901e08a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:00.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.950+0000 7fe195a00640 1 --2- 172.21.15.123:0/1588015673 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe174003f30 0x7fe190140b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:00.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.950+0000 7fe195a00640 1 -- 172.21.15.123:0/1588015673 >> 172.21.15.123:0/1588015673 conn(0x7fe19006c260 msgr2=0x7fe1900676c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:00.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.950+0000 7fe195a00640 1 -- 172.21.15.123:0/1588015673 shutdown_connections 2024-04-17T05:34:00.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:00.950+0000 7fe195a00640 1 -- 172.21.15.123:0/1588015673 wait complete. 2024-04-17T05:34:00.965 INFO:tasks.ceph:Scrubbing osd.6 2024-04-17T05:34:00.966 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-17T05:34:01.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.171+0000 7f17d5000640 1 Processor -- start 2024-04-17T05:34:01.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.171+0000 7f17d5000640 1 -- start start 2024-04-17T05:34:01.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.173+0000 7f17d5000640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f17d00ba9d0 0x7f17d00b5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:01.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.173+0000 7f17d5000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f17d00b6530 0x7f17d01419b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:01.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.173+0000 7f17d5000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17d00badb0 con 0x7f17d0141ef0 2024-04-17T05:34:01.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.173+0000 7f17d5000640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f17d00b76c0 con 0x7f17d00ba9d0 2024-04-17T05:34:01.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.173+0000 7f17d5000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f17d00b55b0 con 0x7f17d00b6530 2024-04-17T05:34:01.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.173+0000 7f17ce800640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f17d0141ef0 0x7f17d014b3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59216/0 (socket says 172.21.15.123:59216) 2024-04-17T05:34:01.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.173+0000 7f17ce800640 1 -- 172.21.15.123:0/2651932221 learned_addr learned my addr 172.21.15.123:0/2651932221 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:34:01.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.173+0000 7f17cde00640 1 --2- 172.21.15.123:0/2651932221 >> v2:172.21.15.164:3300/0 conn(0x7f17d00ba9d0 0x7f17d00b5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:01.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.173+0000 7f17cd400640 1 --2- 172.21.15.123:0/2651932221 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f17d00b6530 0x7f17d01419b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:01.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.173+0000 7f17cca00640 1 -- 172.21.15.123:0/2651932221 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2323651185 0 0) 0x7f17d00badb0 con 0x7f17d0141ef0 2024-04-17T05:34:01.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.174+0000 7f17cca00640 1 -- 172.21.15.123:0/2651932221 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17b0003520 con 0x7f17d0141ef0 2024-04-17T05:34:01.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.174+0000 7f17cca00640 1 -- 172.21.15.123:0/2651932221 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 549131950 0 0) 0x7f17b0003520 con 0x7f17d0141ef0 2024-04-17T05:34:01.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.174+0000 7f17cca00640 1 -- 172.21.15.123:0/2651932221 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f17d00b6530 msgr2=0x7f17d01419b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:01.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.174+0000 7f17cca00640 1 --2- 172.21.15.123:0/2651932221 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f17d00b6530 0x7f17d01419b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:01.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.174+0000 7f17cca00640 1 -- 172.21.15.123:0/2651932221 >> v2:172.21.15.164:3300/0 conn(0x7f17d00ba9d0 msgr2=0x7f17d00b5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:01.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.174+0000 7f17cca00640 1 --2- 172.21.15.123:0/2651932221 >> v2:172.21.15.164:3300/0 conn(0x7f17d00ba9d0 0x7f17d00b5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:01.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.174+0000 7f17cca00640 1 -- 172.21.15.123:0/2651932221 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17d00b5890 con 0x7f17d0141ef0 2024-04-17T05:34:01.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.174+0000 7f17cca00640 1 -- 172.21.15.123:0/2651932221 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1042962670 0 0) 0x7f17c8001670 con 0x7f17d0141ef0 2024-04-17T05:34:01.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.174+0000 7f17cca00640 1 -- 172.21.15.123:0/2651932221 >> v1:172.21.15.123:6789/0 conn(0x7f17d0141ef0 legacy=0x7f17d014b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:01.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.174+0000 7f17cca00640 1 --2- 172.21.15.123:0/2651932221 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f17d00b6530 0x7f17b00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:01.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.174+0000 7f17cca00640 1 --2- 172.21.15.123:0/2651932221 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17b0003f30 0x7f17b0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:01.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.174+0000 7f17cca00640 1 --2- 172.21.15.123:0/2651932221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17b0004d40 0x7f17b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:01.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.174+0000 7f17cca00640 1 -- 172.21.15.123:0/2651932221 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f17d00b55b0 con 0x7f17b0003f30 2024-04-17T05:34:01.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.174+0000 7f17cca00640 1 -- 172.21.15.123:0/2651932221 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f17b000ba20 con 0x7f17b0004d40 2024-04-17T05:34:01.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.174+0000 7f17cca00640 1 -- 172.21.15.123:0/2651932221 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f17b000bc20 con 0x7f17d00b6530 2024-04-17T05:34:01.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.174+0000 7f17cd400640 1 --2- 172.21.15.123:0/2651932221 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17b0003f30 0x7f17b0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:01.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.175+0000 7f17ce800640 1 --2- 172.21.15.123:0/2651932221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17b0004d40 0x7f17b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:01.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.175+0000 7f17cde00640 1 --2- 172.21.15.123:0/2651932221 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f17d00b6530 0x7f17b00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:01.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.175+0000 7f17cd400640 1 -- 172.21.15.123:0/2651932221 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f17d00b6530 msgr2=0x7f17b00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:01.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.175+0000 7f17cd400640 1 --2- 172.21.15.123:0/2651932221 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f17d00b6530 0x7f17b00039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:01.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.175+0000 7f17cd400640 1 -- 172.21.15.123:0/2651932221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17b0004d40 msgr2=0x7f17b00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:01.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.175+0000 7f17cd400640 1 --2- 172.21.15.123:0/2651932221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17b0004d40 0x7f17b00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:01.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.175+0000 7f17cd400640 1 -- 172.21.15.123:0/2651932221 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17b0003520 con 0x7f17b0003f30 2024-04-17T05:34:01.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.176+0000 7f17cd400640 1 --2- 172.21.15.123:0/2651932221 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17b0003f30 0x7f17b0004800 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f17b8009f90 tx=0x7f17b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ef3df163dbeb77 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:01.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.176+0000 7f17cca00640 1 -- 172.21.15.123:0/2651932221 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b8039070 con 0x7f17b0003f30 2024-04-17T05:34:01.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.176+0000 7f17cca00640 1 -- 172.21.15.123:0/2651932221 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17b802cbd0 con 0x7f17b0003f30 2024-04-17T05:34:01.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.176+0000 7f17cca00640 1 -- 172.21.15.123:0/2651932221 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b8009c10 con 0x7f17b0003f30 2024-04-17T05:34:01.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.176+0000 7f17d5000640 1 -- 172.21.15.123:0/2651932221 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17b0003f30 msgr2=0x7f17b0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:01.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.176+0000 7f17d5000640 1 --2- 172.21.15.123:0/2651932221 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17b0003f30 0x7f17b0004800 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f17b8009f90 tx=0x7f17b0005830 comp rx=0 tx=0).stop 2024-04-17T05:34:01.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.177+0000 7f17ce800640 1 -- 172.21.15.123:0/2651932221 reap_dead start 2024-04-17T05:34:01.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.177+0000 7f17d5000640 1 -- 172.21.15.123:0/2651932221 shutdown_connections 2024-04-17T05:34:01.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.177+0000 7f17d5000640 1 -- 172.21.15.123:0/2651932221 >> 172.21.15.123:0/2651932221 conn(0x7f17d00bdf10 msgr2=0x7f17d00b9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:01.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.177+0000 7f17d5000640 1 -- 172.21.15.123:0/2651932221 shutdown_connections 2024-04-17T05:34:01.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.177+0000 7f17d5000640 1 -- 172.21.15.123:0/2651932221 wait complete. 2024-04-17T05:34:01.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.178+0000 7f17d5000640 1 Processor -- start 2024-04-17T05:34:01.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.178+0000 7f17d5000640 1 -- start start 2024-04-17T05:34:01.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.179+0000 7f17d5000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f17b0003f30 0x7f17d0148370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:01.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.179+0000 7f17d5000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17d01390c0 0x7f17d0139540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:01.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.179+0000 7f17d5000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17d0137570 0x7f17d01379d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:01.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.179+0000 7f17d5000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f17d01419b0 con 0x7f17d0137570 2024-04-17T05:34:01.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.179+0000 7f17d5000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f17d014bcd0 con 0x7f17d01390c0 2024-04-17T05:34:01.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.179+0000 7f17d5000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f17d0141b30 con 0x7f17b0003f30 2024-04-17T05:34:01.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.180+0000 7f17ce800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17d0137570 0x7f17d01379d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:01.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.180+0000 7f17ce800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17d0137570 0x7f17d01379d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49172/0 (socket says 172.21.15.123:49172) 2024-04-17T05:34:01.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.180+0000 7f17ce800640 1 -- 172.21.15.123:0/2193180170 learned_addr learned my addr 172.21.15.123:0/2193180170 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:34:01.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.180+0000 7f17cd400640 1 --2- 172.21.15.123:0/2193180170 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17d01390c0 0x7f17d0139540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:01.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.180+0000 7f17cde00640 1 --2- 172.21.15.123:0/2193180170 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f17b0003f30 0x7f17d0148370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:01.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.180+0000 7f17ce800640 1 -- 172.21.15.123:0/2193180170 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f17b0003f30 msgr2=0x7f17d0148370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:01.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.180+0000 7f17ce800640 1 --2- 172.21.15.123:0/2193180170 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f17b0003f30 0x7f17d0148370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:01.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.180+0000 7f17ce800640 1 -- 172.21.15.123:0/2193180170 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17d01390c0 msgr2=0x7f17d0139540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:01.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.180+0000 7f17ce800640 1 --2- 172.21.15.123:0/2193180170 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f17d01390c0 0x7f17d0139540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:01.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.180+0000 7f17ce800640 1 -- 172.21.15.123:0/2193180170 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17d013af90 con 0x7f17d0137570 2024-04-17T05:34:01.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.180+0000 7f17ce800640 1 --2- 172.21.15.123:0/2193180170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17d0137570 0x7f17d01379d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f17c8001eb0 tx=0x7f17c800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:01.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.180+0000 7f17c6000640 1 -- 172.21.15.123:0/2193180170 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c800c610 con 0x7f17d0137570 2024-04-17T05:34:01.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.180+0000 7f17c6000640 1 -- 172.21.15.123:0/2193180170 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17c8018070 con 0x7f17d0137570 2024-04-17T05:34:01.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.181+0000 7f17c6000640 1 -- 172.21.15.123:0/2193180170 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c800c9f0 con 0x7f17d0137570 2024-04-17T05:34:01.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.181+0000 7f17d5000640 1 -- 172.21.15.123:0/2193180170 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17d013a7b0 con 0x7f17d0137570 2024-04-17T05:34:01.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.181+0000 7f17d5000640 1 -- 172.21.15.123:0/2193180170 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17d013b200 con 0x7f17d0137570 2024-04-17T05:34:01.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.182+0000 7f17d5000640 1 -- 172.21.15.123:0/2193180170 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f17d0139a80 con 0x7f17d0137570 2024-04-17T05:34:01.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.183+0000 7f17c6000640 1 -- 172.21.15.123:0/2193180170 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f17c800cb90 con 0x7f17d0137570 2024-04-17T05:34:01.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.184+0000 7f17c6000640 1 --2- 172.21.15.123:0/2193180170 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f17ac06c8f0 0x7f17ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:01.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.184+0000 7f17c6000640 1 -- 172.21.15.123:0/2193180170 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f17c808bb30 con 0x7f17d0137570 2024-04-17T05:34:01.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.184+0000 7f17c6000640 1 --2- 172.21.15.123:0/2193180170 >> [v2:172.21.15.164:6817/1594306924,v1:172.21.15.164:6821/1594306924] conn(0x7f17ac076390 0x7f17ac078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:01.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.184+0000 7f17c6000640 1 -- 172.21.15.123:0/2193180170 --> [v2:172.21.15.164:6817/1594306924,v1:172.21.15.164:6821/1594306924] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f17c8015e70 con 0x7f17ac076390 2024-04-17T05:34:01.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.184+0000 7f17c6000640 1 -- 172.21.15.123:0/2193180170 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f17c80902a0 con 0x7f17d0137570 2024-04-17T05:34:01.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.184+0000 7f17cde00640 1 --2- 172.21.15.123:0/2193180170 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f17ac06c8f0 0x7f17ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:01.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.185+0000 7f17cd400640 1 --2- 172.21.15.123:0/2193180170 >> [v2:172.21.15.164:6817/1594306924,v1:172.21.15.164:6821/1594306924] conn(0x7f17ac076390 0x7f17ac078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:01.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.185+0000 7f17cde00640 1 --2- 172.21.15.123:0/2193180170 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f17ac06c8f0 0x7f17ac06edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f17c0009a90 tx=0x7f17c0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:01.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.186+0000 7f17cd400640 1 --2- 172.21.15.123:0/2193180170 >> [v2:172.21.15.164:6817/1594306924,v1:172.21.15.164:6821/1594306924] conn(0x7f17ac076390 0x7f17ac078830 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:01.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.188+0000 7f17c6000640 1 -- 172.21.15.123:0/2193180170 <== osd.6 v2:172.21.15.164:6817/1594306924 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f17c8015e70 con 0x7f17ac076390 2024-04-17T05:34:01.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.202+0000 7f17d5000640 1 -- 172.21.15.123:0/2193180170 --> [v2:172.21.15.164:6817/1594306924,v1:172.21.15.164:6821/1594306924] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f17d0068a40 con 0x7f17ac076390 2024-04-17T05:34:01.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.203+0000 7f17c6000640 1 -- 172.21.15.123:0/2193180170 <== osd.6 v2:172.21.15.164:6817/1594306924 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f17d0068a40 con 0x7f17ac076390 2024-04-17T05:34:01.202 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-04-17T05:34:01.202 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T05:34:01.202 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-04-17T05:34:01.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.204+0000 7f17d5000640 1 -- 172.21.15.123:0/2193180170 >> [v2:172.21.15.164:6817/1594306924,v1:172.21.15.164:6821/1594306924] conn(0x7f17ac076390 msgr2=0x7f17ac078830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:01.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.204+0000 7f17d5000640 1 --2- 172.21.15.123:0/2193180170 >> [v2:172.21.15.164:6817/1594306924,v1:172.21.15.164:6821/1594306924] conn(0x7f17ac076390 0x7f17ac078830 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:01.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.204+0000 7f17d5000640 1 -- 172.21.15.123:0/2193180170 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f17ac06c8f0 msgr2=0x7f17ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:01.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.204+0000 7f17d5000640 1 --2- 172.21.15.123:0/2193180170 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f17ac06c8f0 0x7f17ac06edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f17c0009a90 tx=0x7f17c0008040 comp rx=0 tx=0).stop 2024-04-17T05:34:01.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.204+0000 7f17d5000640 1 -- 172.21.15.123:0/2193180170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17d0137570 msgr2=0x7f17d01379d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:01.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.204+0000 7f17d5000640 1 --2- 172.21.15.123:0/2193180170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17d0137570 0x7f17d01379d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f17c8001eb0 tx=0x7f17c800eb90 comp rx=0 tx=0).stop 2024-04-17T05:34:01.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.204+0000 7f17ce800640 1 -- 172.21.15.123:0/2193180170 reap_dead start 2024-04-17T05:34:01.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.204+0000 7f17d5000640 1 -- 172.21.15.123:0/2193180170 shutdown_connections 2024-04-17T05:34:01.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.204+0000 7f17d5000640 1 -- 172.21.15.123:0/2193180170 >> 172.21.15.123:0/2193180170 conn(0x7f17d00bdf10 msgr2=0x7f17d013f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:01.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.204+0000 7f17d5000640 1 -- 172.21.15.123:0/2193180170 shutdown_connections 2024-04-17T05:34:01.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.204+0000 7f17d5000640 1 -- 172.21.15.123:0/2193180170 wait complete. 2024-04-17T05:34:01.219 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-17T05:34:01.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.423+0000 7f4a7c600640 1 Processor -- start 2024-04-17T05:34:01.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.423+0000 7f4a7c600640 1 -- start start 2024-04-17T05:34:01.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.424+0000 7f4a7c600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4a7409d410 0x7f4a74143b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:01.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.424+0000 7f4a7c600640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4a74144080 0x7f4a741444f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:01.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.424+0000 7f4a7c600640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a7409cab0 con 0x7f4a7409c6d0 2024-04-17T05:34:01.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.424+0000 7f4a7c600640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f4a740ae850 con 0x7f4a7409d410 2024-04-17T05:34:01.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.424+0000 7f4a7c600640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f4a7409d930 con 0x7f4a74144080 2024-04-17T05:34:01.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.425+0000 7f4a79200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4a7409d410 0x7f4a74143b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:01.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.425+0000 7f4a79200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4a7409d410 0x7f4a74143b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49178/0 (socket says 172.21.15.123:49178) 2024-04-17T05:34:01.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.425+0000 7f4a79200640 1 -- 172.21.15.123:0/3157373020 learned_addr learned my addr 172.21.15.123:0/3157373020 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:34:01.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.425+0000 7f4a7a600640 1 --2- 172.21.15.123:0/3157373020 >> v2:172.21.15.164:3300/0 conn(0x7f4a74144080 0x7f4a741444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:01.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.425+0000 7f4a79200640 1 -- 172.21.15.123:0/3157373020 >> v2:172.21.15.164:3300/0 conn(0x7f4a74144080 msgr2=0x7f4a741444f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:01.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.425+0000 7f4a79200640 1 --2- 172.21.15.123:0/3157373020 >> v2:172.21.15.164:3300/0 conn(0x7f4a74144080 0x7f4a741444f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:01.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.425+0000 7f4a79200640 1 -- 172.21.15.123:0/3157373020 >> v1:172.21.15.164:6789/0 conn(0x7f4a7409c6d0 legacy=0x7f4a740b53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:01.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.425+0000 7f4a79200640 1 -- 172.21.15.123:0/3157373020 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a7409dc10 con 0x7f4a7409d410 2024-04-17T05:34:01.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.426+0000 7f4a79200640 1 --2- 172.21.15.123:0/3157373020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a7409d410 0x7f4a74143b40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4a7409e4f0 tx=0x7f4a6002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cc026bba35fd2ad server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:01.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.426+0000 7f4a73e00640 1 -- 172.21.15.123:0/3157373020 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a60038070 con 0x7f4a7409d410 2024-04-17T05:34:01.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.427+0000 7f4a73e00640 1 -- 172.21.15.123:0/3157373020 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a6002f050 con 0x7f4a7409d410 2024-04-17T05:34:01.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.427+0000 7f4a73e00640 1 -- 172.21.15.123:0/3157373020 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a60031970 con 0x7f4a7409d410 2024-04-17T05:34:01.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.427+0000 7f4a7c600640 1 -- 172.21.15.123:0/3157373020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a7409d410 msgr2=0x7f4a74143b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:01.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.427+0000 7f4a7c600640 1 --2- 172.21.15.123:0/3157373020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a7409d410 0x7f4a74143b40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4a7409e4f0 tx=0x7f4a6002b7f0 comp rx=0 tx=0).stop 2024-04-17T05:34:01.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.427+0000 7f4a7c600640 1 -- 172.21.15.123:0/3157373020 shutdown_connections 2024-04-17T05:34:01.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.427+0000 7f4a7c600640 1 --2- 172.21.15.123:0/3157373020 >> v2:172.21.15.164:3300/0 conn(0x7f4a74144080 0x7f4a741444f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:01.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.427+0000 7f4a7c600640 1 --2- 172.21.15.123:0/3157373020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a7409d410 0x7f4a74143b40 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:01.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.427+0000 7f4a7c600640 1 -- 172.21.15.123:0/3157373020 >> 172.21.15.123:0/3157373020 conn(0x7f4a740b93b0 msgr2=0x7f4a740b97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:01.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.427+0000 7f4a7c600640 1 -- 172.21.15.123:0/3157373020 shutdown_connections 2024-04-17T05:34:01.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.427+0000 7f4a7c600640 1 -- 172.21.15.123:0/3157373020 wait complete. 2024-04-17T05:34:01.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.429+0000 7f4a7c600640 1 Processor -- start 2024-04-17T05:34:01.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.429+0000 7f4a7c600640 1 -- start start 2024-04-17T05:34:01.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.430+0000 7f4a7c600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a7409c6d0 0x7f4a741420f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:01.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.430+0000 7f4a7c600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a7409d410 0x7f4a740b7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:01.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.430+0000 7f4a7c600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a74144080 0x7f4a740b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:01.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.430+0000 7f4a7c600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4a74148130 con 0x7f4a74144080 2024-04-17T05:34:01.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.430+0000 7f4a7c600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4a740b5bf0 con 0x7f4a7409d410 2024-04-17T05:34:01.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.430+0000 7f4a7c600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f4a741482b0 con 0x7f4a7409c6d0 2024-04-17T05:34:01.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.430+0000 7f4a7a600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a74144080 0x7f4a740b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:01.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.430+0000 7f4a7a600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a74144080 0x7f4a740b8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49190/0 (socket says 172.21.15.123:49190) 2024-04-17T05:34:01.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.430+0000 7f4a7a600640 1 -- 172.21.15.123:0/1718393058 learned_addr learned my addr 172.21.15.123:0/1718393058 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:34:01.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.430+0000 7f4a79200640 1 --2- 172.21.15.123:0/1718393058 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a7409d410 0x7f4a740b7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:01.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.430+0000 7f4a79c00640 1 --2- 172.21.15.123:0/1718393058 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a7409c6d0 0x7f4a741420f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:01.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.431+0000 7f4a7a600640 1 -- 172.21.15.123:0/1718393058 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a7409c6d0 msgr2=0x7f4a741420f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:01.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.431+0000 7f4a7a600640 1 --2- 172.21.15.123:0/1718393058 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a7409c6d0 0x7f4a741420f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:01.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.431+0000 7f4a7a600640 1 -- 172.21.15.123:0/1718393058 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a7409d410 msgr2=0x7f4a740b7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:01.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.431+0000 7f4a7a600640 1 --2- 172.21.15.123:0/1718393058 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a7409d410 0x7f4a740b7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:01.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.431+0000 7f4a7a600640 1 -- 172.21.15.123:0/1718393058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a740b8220 con 0x7f4a74144080 2024-04-17T05:34:01.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.431+0000 7f4a7a600640 1 --2- 172.21.15.123:0/1718393058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a74144080 0x7f4a740b8990 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c007e60 tx=0x7f4a6c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:01.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.431+0000 7f4a71600640 1 -- 172.21.15.123:0/1718393058 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c014420 con 0x7f4a74144080 2024-04-17T05:34:01.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.431+0000 7f4a71600640 1 -- 172.21.15.123:0/1718393058 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a6c019070 con 0x7f4a74144080 2024-04-17T05:34:01.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.431+0000 7f4a71600640 1 -- 172.21.15.123:0/1718393058 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c014820 con 0x7f4a74144080 2024-04-17T05:34:01.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.431+0000 7f4a7c600640 1 -- 172.21.15.123:0/1718393058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a740b8500 con 0x7f4a74144080 2024-04-17T05:34:01.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.432+0000 7f4a7c600640 1 -- 172.21.15.123:0/1718393058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a740b7250 con 0x7f4a74144080 2024-04-17T05:34:01.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.433+0000 7f4a7c600640 1 -- 172.21.15.123:0/1718393058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a74142d00 con 0x7f4a74144080 2024-04-17T05:34:01.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.433+0000 7f4a71600640 1 -- 172.21.15.123:0/1718393058 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4a6c0149c0 con 0x7f4a74144080 2024-04-17T05:34:01.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.434+0000 7f4a71600640 1 --2- 172.21.15.123:0/1718393058 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f4a5406c8f0 0x7f4a5406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:01.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.434+0000 7f4a71600640 1 -- 172.21.15.123:0/1718393058 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f4a6c08c7e0 con 0x7f4a74144080 2024-04-17T05:34:01.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.435+0000 7f4a79c00640 1 --2- 172.21.15.123:0/1718393058 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f4a5406c8f0 0x7f4a5406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:01.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.436+0000 7f4a79c00640 1 --2- 172.21.15.123:0/1718393058 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f4a5406c8f0 0x7f4a5406edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4a68004ea0 tx=0x7f4a68009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:01.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.439+0000 7f4a71600640 1 -- 172.21.15.123:0/1718393058 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f4a74142d00 con 0x7f4a74144080 2024-04-17T05:34:01.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.642+0000 7f4a7c600640 1 -- 172.21.15.123:0/1718393058 --> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f4a74068a40 con 0x7f4a5406c8f0 2024-04-17T05:34:01.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.643+0000 7f4a71600640 1 -- 172.21.15.123:0/1718393058 <== mgr.4103 v2:172.21.15.164:6832/4204006015 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4a74068a40 con 0x7f4a5406c8f0 2024-04-17T05:34:01.642 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 6 to deep-scrub 2024-04-17T05:34:01.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.646+0000 7f4a7c600640 1 -- 172.21.15.123:0/1718393058 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f4a5406c8f0 msgr2=0x7f4a5406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:01.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.646+0000 7f4a7c600640 1 --2- 172.21.15.123:0/1718393058 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f4a5406c8f0 0x7f4a5406edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4a68004ea0 tx=0x7f4a68009040 comp rx=0 tx=0).stop 2024-04-17T05:34:01.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.646+0000 7f4a7c600640 1 -- 172.21.15.123:0/1718393058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a74144080 msgr2=0x7f4a740b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:01.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.646+0000 7f4a7c600640 1 --2- 172.21.15.123:0/1718393058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a74144080 0x7f4a740b8990 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c007e60 tx=0x7f4a6c00e4b0 comp rx=0 tx=0).stop 2024-04-17T05:34:01.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.646+0000 7f4a7c600640 1 -- 172.21.15.123:0/1718393058 shutdown_connections 2024-04-17T05:34:01.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.646+0000 7f4a7c600640 1 --2- 172.21.15.123:0/1718393058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a74144080 0x7f4a740b8990 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:01.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.646+0000 7f4a7c600640 1 --2- 172.21.15.123:0/1718393058 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a7409d410 0x7f4a740b7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:01.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.646+0000 7f4a7c600640 1 --2- 172.21.15.123:0/1718393058 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f4a5406c8f0 0x7f4a5406edb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:01.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.646+0000 7f4a7c600640 1 --2- 172.21.15.123:0/1718393058 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a7409c6d0 0x7f4a741420f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:01.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.646+0000 7f4a7c600640 1 -- 172.21.15.123:0/1718393058 >> 172.21.15.123:0/1718393058 conn(0x7f4a740b93b0 msgr2=0x7f4a740af050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:01.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.646+0000 7f4a7c600640 1 -- 172.21.15.123:0/1718393058 shutdown_connections 2024-04-17T05:34:01.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.647+0000 7f4a7c600640 1 -- 172.21.15.123:0/1718393058 wait complete. 2024-04-17T05:34:01.664 INFO:tasks.ceph:Scrubbing osd.7 2024-04-17T05:34:01.664 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-17T05:34:01.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.877+0000 7f7fe3e00640 1 Processor -- start 2024-04-17T05:34:01.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.877+0000 7f7fe3e00640 1 -- start start 2024-04-17T05:34:01.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.879+0000 7f7fe3e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fe40b2be0 0x7f7fe40b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:01.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.879+0000 7f7fe3e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7fe4070b20 0x7f7fe413f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:01.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.879+0000 7f7fe3e00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fe40b2fc0 con 0x7f7fe41492c0 2024-04-17T05:34:01.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.879+0000 7f7fe3e00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f7fe40b57c0 con 0x7f7fe4070b20 2024-04-17T05:34:01.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.879+0000 7f7fe3e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f7fe40b5aa0 con 0x7f7fe40b2be0 2024-04-17T05:34:01.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.879+0000 7f7fe2000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7fe4070b20 0x7f7fe413f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:01.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.879+0000 7f7fe3400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7fe41492c0 0x7f7fe40b3c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59230/0 (socket says 172.21.15.123:59230) 2024-04-17T05:34:01.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.879+0000 7f7fe3400640 1 -- 172.21.15.123:0/3672504581 learned_addr learned my addr 172.21.15.123:0/3672504581 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:34:01.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.879+0000 7f7fe2a00640 1 --2- 172.21.15.123:0/3672504581 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fe40b2be0 0x7f7fe40b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:01.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.880+0000 7f7fe1600640 1 -- 172.21.15.123:0/3672504581 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2116931175 0 0) 0x7f7fe40b2fc0 con 0x7f7fe41492c0 2024-04-17T05:34:01.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.880+0000 7f7fe1600640 1 -- 172.21.15.123:0/3672504581 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fc8003520 con 0x7f7fe41492c0 2024-04-17T05:34:01.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.880+0000 7f7fe2000640 1 -- 172.21.15.123:0/3672504581 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fe40b2be0 msgr2=0x7f7fe40b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:01.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.880+0000 7f7fe2000640 1 --2- 172.21.15.123:0/3672504581 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fe40b2be0 0x7f7fe40b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:01.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.880+0000 7f7fe2000640 1 -- 172.21.15.123:0/3672504581 >> v1:172.21.15.123:6789/0 conn(0x7f7fe41492c0 legacy=0x7f7fe40b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:01.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.880+0000 7f7fe2000640 1 -- 172.21.15.123:0/3672504581 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe4148da0 con 0x7f7fe4070b20 2024-04-17T05:34:01.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.881+0000 7f7fe2000640 1 --2- 172.21.15.123:0/3672504581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fe4070b20 0x7f7fe413f710 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7fd00097a0 tx=0x7f7fd002b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bad9502536fc574 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:01.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.882+0000 7f7fe1600640 1 -- 172.21.15.123:0/3672504581 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0031780 con 0x7f7fe4070b20 2024-04-17T05:34:01.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.882+0000 7f7fe1600640 1 -- 172.21.15.123:0/3672504581 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fd0037070 con 0x7f7fe4070b20 2024-04-17T05:34:01.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.882+0000 7f7fe1600640 1 -- 172.21.15.123:0/3672504581 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0031b20 con 0x7f7fe4070b20 2024-04-17T05:34:01.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.882+0000 7f7fe3e00640 1 -- 172.21.15.123:0/3672504581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fe4070b20 msgr2=0x7f7fe413f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:01.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.882+0000 7f7fe3e00640 1 --2- 172.21.15.123:0/3672504581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fe4070b20 0x7f7fe413f710 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7fd00097a0 tx=0x7f7fd002b820 comp rx=0 tx=0).stop 2024-04-17T05:34:01.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.883+0000 7f7fe3e00640 1 -- 172.21.15.123:0/3672504581 shutdown_connections 2024-04-17T05:34:01.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.883+0000 7f7fe3e00640 1 --2- 172.21.15.123:0/3672504581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fe4070b20 0x7f7fe413f710 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:01.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.883+0000 7f7fe3e00640 1 --2- 172.21.15.123:0/3672504581 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fe40b2be0 0x7f7fe40b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:01.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.883+0000 7f7fe3e00640 1 -- 172.21.15.123:0/3672504581 >> 172.21.15.123:0/3672504581 conn(0x7f7fe406c190 msgr2=0x7f7fe40b9260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:01.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.883+0000 7f7fe3e00640 1 -- 172.21.15.123:0/3672504581 shutdown_connections 2024-04-17T05:34:01.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.883+0000 7f7fe3e00640 1 -- 172.21.15.123:0/3672504581 wait complete. 2024-04-17T05:34:01.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.884+0000 7f7fe3e00640 1 Processor -- start 2024-04-17T05:34:01.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.884+0000 7f7fe3e00640 1 -- start start 2024-04-17T05:34:01.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.885+0000 7f7fe3e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fe4070b20 0x7f7fe40b80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:01.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.885+0000 7f7fe3e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fe40b2be0 0x7f7fe41db100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:01.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.885+0000 7f7fe3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fe41492c0 0x7f7fe41db640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:01.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.885+0000 7f7fe3e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe413fdd0 con 0x7f7fe40b2be0 2024-04-17T05:34:01.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.885+0000 7f7fe3e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe413fc50 con 0x7f7fe41492c0 2024-04-17T05:34:01.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.885+0000 7f7fe3e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f7fe4149710 con 0x7f7fe4070b20 2024-04-17T05:34:01.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.886+0000 7f7fe2000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fe40b2be0 0x7f7fe41db100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:01.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.886+0000 7f7fe2000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fe40b2be0 0x7f7fe41db100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49210/0 (socket says 172.21.15.123:49210) 2024-04-17T05:34:01.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.886+0000 7f7fe2000640 1 -- 172.21.15.123:0/2457575839 learned_addr learned my addr 172.21.15.123:0/2457575839 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:34:01.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.886+0000 7f7fe2a00640 1 --2- 172.21.15.123:0/2457575839 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fe4070b20 0x7f7fe40b80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:01.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.886+0000 7f7fe3400640 1 --2- 172.21.15.123:0/2457575839 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fe41492c0 0x7f7fe41db640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:01.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.886+0000 7f7fe2000640 1 -- 172.21.15.123:0/2457575839 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fe4070b20 msgr2=0x7f7fe40b80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:01.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.886+0000 7f7fe2000640 1 --2- 172.21.15.123:0/2457575839 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fe4070b20 0x7f7fe40b80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:01.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.886+0000 7f7fe2000640 1 -- 172.21.15.123:0/2457575839 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fe41492c0 msgr2=0x7f7fe41db640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:01.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.886+0000 7f7fe2000640 1 --2- 172.21.15.123:0/2457575839 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7fe41492c0 0x7f7fe41db640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:01.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.886+0000 7f7fe2000640 1 -- 172.21.15.123:0/2457575839 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe41d2050 con 0x7f7fe40b2be0 2024-04-17T05:34:01.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.886+0000 7f7fe2a00640 1 --2- 172.21.15.123:0/2457575839 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7fe4070b20 0x7f7fe40b80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:34:01.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.886+0000 7f7fe2000640 1 --2- 172.21.15.123:0/2457575839 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fe40b2be0 0x7f7fe41db100 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0034040 tx=0x7f7fd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:01.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.887+0000 7f7fdaa00640 1 -- 172.21.15.123:0/2457575839 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0031780 con 0x7f7fe40b2be0 2024-04-17T05:34:01.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.887+0000 7f7fdaa00640 1 -- 172.21.15.123:0/2457575839 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fd0031920 con 0x7f7fe40b2be0 2024-04-17T05:34:01.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.887+0000 7f7fdaa00640 1 -- 172.21.15.123:0/2457575839 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0031cd0 con 0x7f7fe40b2be0 2024-04-17T05:34:01.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.887+0000 7f7fe3e00640 1 -- 172.21.15.123:0/2457575839 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fe4140720 con 0x7f7fe40b2be0 2024-04-17T05:34:01.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.887+0000 7f7fe3e00640 1 -- 172.21.15.123:0/2457575839 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fe4140ce0 con 0x7f7fe40b2be0 2024-04-17T05:34:01.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.888+0000 7f7fe3e00640 1 -- 172.21.15.123:0/2457575839 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7fe4075b30 con 0x7f7fe40b2be0 2024-04-17T05:34:01.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.889+0000 7f7fdaa00640 1 -- 172.21.15.123:0/2457575839 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7fd0032410 con 0x7f7fe40b2be0 2024-04-17T05:34:01.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.890+0000 7f7fdaa00640 1 --2- 172.21.15.123:0/2457575839 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f7fc406c8f0 0x7f7fc406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:01.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.890+0000 7f7fdaa00640 1 -- 172.21.15.123:0/2457575839 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f7fd00ae090 con 0x7f7fe40b2be0 2024-04-17T05:34:01.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.890+0000 7f7fdaa00640 1 --2- 172.21.15.123:0/2457575839 >> [v2:172.21.15.164:6816/295402697,v1:172.21.15.164:6818/295402697] conn(0x7f7fc4076390 0x7f7fc4078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:01.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.890+0000 7f7fdaa00640 1 -- 172.21.15.123:0/2457575839 --> [v2:172.21.15.164:6816/295402697,v1:172.21.15.164:6818/295402697] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7fc4078f00 con 0x7f7fc4076390 2024-04-17T05:34:01.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.890+0000 7f7fdaa00640 1 -- 172.21.15.123:0/2457575839 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7fd00b5050 con 0x7f7fe40b2be0 2024-04-17T05:34:01.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.890+0000 7f7fe2a00640 1 --2- 172.21.15.123:0/2457575839 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f7fc406c8f0 0x7f7fc406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:01.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.891+0000 7f7fe3400640 1 --2- 172.21.15.123:0/2457575839 >> [v2:172.21.15.164:6816/295402697,v1:172.21.15.164:6818/295402697] conn(0x7f7fc4076390 0x7f7fc4078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:01.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.892+0000 7f7fe2a00640 1 --2- 172.21.15.123:0/2457575839 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f7fc406c8f0 0x7f7fc406edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4009ac0 tx=0x7f7fd4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:01.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.892+0000 7f7fe3400640 1 --2- 172.21.15.123:0/2457575839 >> [v2:172.21.15.164:6816/295402697,v1:172.21.15.164:6818/295402697] conn(0x7f7fc4076390 0x7f7fc4078830 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:01.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.894+0000 7f7fdaa00640 1 -- 172.21.15.123:0/2457575839 <== osd.7 v2:172.21.15.164:6816/295402697 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7fc4078f00 con 0x7f7fc4076390 2024-04-17T05:34:01.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.909+0000 7f7fe3e00640 1 -- 172.21.15.123:0/2457575839 --> [v2:172.21.15.164:6816/295402697,v1:172.21.15.164:6818/295402697] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7fe40ba100 con 0x7f7fc4076390 2024-04-17T05:34:01.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.911+0000 7f7fdaa00640 1 -- 172.21.15.123:0/2457575839 <== osd.7 v2:172.21.15.164:6816/295402697 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7fe40ba100 con 0x7f7fc4076390 2024-04-17T05:34:01.909 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-04-17T05:34:01.909 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T05:34:01.909 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-04-17T05:34:01.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.911+0000 7f7fe3e00640 1 -- 172.21.15.123:0/2457575839 >> [v2:172.21.15.164:6816/295402697,v1:172.21.15.164:6818/295402697] conn(0x7f7fc4076390 msgr2=0x7f7fc4078830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:01.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.911+0000 7f7fe3e00640 1 --2- 172.21.15.123:0/2457575839 >> [v2:172.21.15.164:6816/295402697,v1:172.21.15.164:6818/295402697] conn(0x7f7fc4076390 0x7f7fc4078830 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:01.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.911+0000 7f7fe3e00640 1 -- 172.21.15.123:0/2457575839 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f7fc406c8f0 msgr2=0x7f7fc406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:01.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.911+0000 7f7fe3e00640 1 --2- 172.21.15.123:0/2457575839 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f7fc406c8f0 0x7f7fc406edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4009ac0 tx=0x7f7fd4008040 comp rx=0 tx=0).stop 2024-04-17T05:34:01.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.911+0000 7f7fe3e00640 1 -- 172.21.15.123:0/2457575839 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fe40b2be0 msgr2=0x7f7fe41db100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:01.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.911+0000 7f7fe3e00640 1 --2- 172.21.15.123:0/2457575839 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fe40b2be0 0x7f7fe41db100 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0034040 tx=0x7f7fd00046c0 comp rx=0 tx=0).stop 2024-04-17T05:34:01.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.911+0000 7f7fe3400640 1 -- 172.21.15.123:0/2457575839 reap_dead start 2024-04-17T05:34:01.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.911+0000 7f7fe3e00640 1 -- 172.21.15.123:0/2457575839 shutdown_connections 2024-04-17T05:34:01.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.911+0000 7f7fe3e00640 1 -- 172.21.15.123:0/2457575839 >> 172.21.15.123:0/2457575839 conn(0x7f7fe406c190 msgr2=0x7f7fe40676c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:01.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.911+0000 7f7fe3e00640 1 -- 172.21.15.123:0/2457575839 shutdown_connections 2024-04-17T05:34:01.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:01.911+0000 7f7fe3e00640 1 -- 172.21.15.123:0/2457575839 wait complete. 2024-04-17T05:34:01.927 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-17T05:34:02.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.137+0000 7fc947e00640 1 Processor -- start 2024-04-17T05:34:02.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.137+0000 7fc947e00640 1 -- start start 2024-04-17T05:34:02.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.138+0000 7fc947e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc94009d630 0x7fc94009da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:02.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.138+0000 7fc947e00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc9401492e0 0x7fc940149770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:02.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.138+0000 7fc947e00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc94009cc30 con 0x7fc94006d060 2024-04-17T05:34:02.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.138+0000 7fc947e00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc94009bcf0 con 0x7fc94009d630 2024-04-17T05:34:02.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.138+0000 7fc947e00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7fc94009cea0 con 0x7fc9401492e0 2024-04-17T05:34:02.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.139+0000 7fc945400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc94009d630 0x7fc94009da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:02.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.139+0000 7fc945400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc94009d630 0x7fc94009da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49216/0 (socket says 172.21.15.123:49216) 2024-04-17T05:34:02.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.139+0000 7fc945400640 1 -- 172.21.15.123:0/3719069317 learned_addr learned my addr 172.21.15.123:0/3719069317 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:34:02.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.139+0000 7fc944a00640 1 --2- 172.21.15.123:0/3719069317 >> v2:172.21.15.164:3300/0 conn(0x7fc9401492e0 0x7fc940149770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:02.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.139+0000 7fc945400640 1 -- 172.21.15.123:0/3719069317 >> v2:172.21.15.164:3300/0 conn(0x7fc9401492e0 msgr2=0x7fc940149770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:02.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.139+0000 7fc945400640 1 --2- 172.21.15.123:0/3719069317 >> v2:172.21.15.164:3300/0 conn(0x7fc9401492e0 0x7fc940149770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:02.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.139+0000 7fc945400640 1 -- 172.21.15.123:0/3719069317 >> v1:172.21.15.123:6789/0 conn(0x7fc94006d060 legacy=0x7fc94006d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:02.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.139+0000 7fc945400640 1 -- 172.21.15.123:0/3719069317 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc940149cb0 con 0x7fc94009d630 2024-04-17T05:34:02.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.139+0000 7fc944a00640 1 --2- 172.21.15.123:0/3719069317 >> v2:172.21.15.164:3300/0 conn(0x7fc9401492e0 0x7fc940149770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T05:34:02.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.140+0000 7fc945400640 1 --2- 172.21.15.123:0/3719069317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc94009d630 0x7fc94009da10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc9400ba2b0 tx=0x7fc93402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e6b08297032ae8 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:02.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.141+0000 7fc93fe00640 1 -- 172.21.15.123:0/3719069317 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc934035020 con 0x7fc94009d630 2024-04-17T05:34:02.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.141+0000 7fc93fe00640 1 -- 172.21.15.123:0/3719069317 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc934031870 con 0x7fc94009d630 2024-04-17T05:34:02.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.141+0000 7fc93fe00640 1 -- 172.21.15.123:0/3719069317 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc934031c40 con 0x7fc94009d630 2024-04-17T05:34:02.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.141+0000 7fc947e00640 1 -- 172.21.15.123:0/3719069317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc94009d630 msgr2=0x7fc94009da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:02.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.141+0000 7fc947e00640 1 --2- 172.21.15.123:0/3719069317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc94009d630 0x7fc94009da10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc9400ba2b0 tx=0x7fc93402b910 comp rx=0 tx=0).stop 2024-04-17T05:34:02.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.141+0000 7fc947e00640 1 -- 172.21.15.123:0/3719069317 shutdown_connections 2024-04-17T05:34:02.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.141+0000 7fc947e00640 1 --2- 172.21.15.123:0/3719069317 >> v2:172.21.15.164:3300/0 conn(0x7fc9401492e0 0x7fc940149770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:02.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.141+0000 7fc947e00640 1 --2- 172.21.15.123:0/3719069317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc94009d630 0x7fc94009da10 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:02.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.141+0000 7fc947e00640 1 -- 172.21.15.123:0/3719069317 >> 172.21.15.123:0/3719069317 conn(0x7fc9400b93b0 msgr2=0x7fc9400b97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:02.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.141+0000 7fc947e00640 1 -- 172.21.15.123:0/3719069317 shutdown_connections 2024-04-17T05:34:02.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.142+0000 7fc947e00640 1 -- 172.21.15.123:0/3719069317 wait complete. 2024-04-17T05:34:02.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.143+0000 7fc947e00640 1 Processor -- start 2024-04-17T05:34:02.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.143+0000 7fc947e00640 1 -- start start 2024-04-17T05:34:02.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.144+0000 7fc947e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc94006d060 0x7fc9400ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:02.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.144+0000 7fc947e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc94009d630 0x7fc9400b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:02.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.144+0000 7fc947e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9401492e0 0x7fc9400b2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:02.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.144+0000 7fc947e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc94009b980 con 0x7fc94006d060 2024-04-17T05:34:02.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.144+0000 7fc947e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc94009b6a0 con 0x7fc9401492e0 2024-04-17T05:34:02.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.144+0000 7fc947e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fc9400b5b10 con 0x7fc94009d630 2024-04-17T05:34:02.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.144+0000 7fc945400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc94006d060 0x7fc9400ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:02.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.144+0000 7fc945400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc94006d060 0x7fc9400ae640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49222/0 (socket says 172.21.15.123:49222) 2024-04-17T05:34:02.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.144+0000 7fc945400640 1 -- 172.21.15.123:0/3109045245 learned_addr learned my addr 172.21.15.123:0/3109045245 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:34:02.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.145+0000 7fc944a00640 1 --2- 172.21.15.123:0/3109045245 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc94009d630 0x7fc9400b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:02.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.145+0000 7fc945e00640 1 --2- 172.21.15.123:0/3109045245 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9401492e0 0x7fc9400b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:02.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.145+0000 7fc945400640 1 -- 172.21.15.123:0/3109045245 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc94009d630 msgr2=0x7fc9400b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:02.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.145+0000 7fc945400640 1 --2- 172.21.15.123:0/3109045245 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc94009d630 0x7fc9400b1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:02.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.145+0000 7fc945400640 1 -- 172.21.15.123:0/3109045245 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9401492e0 msgr2=0x7fc9400b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:02.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.145+0000 7fc945400640 1 --2- 172.21.15.123:0/3109045245 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9401492e0 0x7fc9400b2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:02.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.145+0000 7fc945400640 1 -- 172.21.15.123:0/3109045245 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc940091100 con 0x7fc94006d060 2024-04-17T05:34:02.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.145+0000 7fc945400640 1 --2- 172.21.15.123:0/3109045245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc94006d060 0x7fc9400ae640 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc93402b950 tx=0x7fc9340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:02.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.145+0000 7fc93d600640 1 -- 172.21.15.123:0/3109045245 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc934040070 con 0x7fc94006d060 2024-04-17T05:34:02.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.145+0000 7fc93d600640 1 -- 172.21.15.123:0/3109045245 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc934030d00 con 0x7fc94006d060 2024-04-17T05:34:02.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.145+0000 7fc93d600640 1 -- 172.21.15.123:0/3109045245 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc934035040 con 0x7fc94006d060 2024-04-17T05:34:02.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.146+0000 7fc947e00640 1 -- 172.21.15.123:0/3109045245 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9400b3090 con 0x7fc94006d060 2024-04-17T05:34:02.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.146+0000 7fc947e00640 1 -- 172.21.15.123:0/3109045245 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc940091370 con 0x7fc94006d060 2024-04-17T05:34:02.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.147+0000 7fc947e00640 1 -- 172.21.15.123:0/3109045245 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc940068a40 con 0x7fc94006d060 2024-04-17T05:34:02.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.148+0000 7fc93d600640 1 -- 172.21.15.123:0/3109045245 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc934038020 con 0x7fc94006d060 2024-04-17T05:34:02.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.149+0000 7fc93d600640 1 --2- 172.21.15.123:0/3109045245 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc92006c8f0 0x7fc92006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:02.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.149+0000 7fc93d600640 1 -- 172.21.15.123:0/3109045245 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fc9340ade20 con 0x7fc94006d060 2024-04-17T05:34:02.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.149+0000 7fc944a00640 1 --2- 172.21.15.123:0/3109045245 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc92006c8f0 0x7fc92006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:02.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.150+0000 7fc944a00640 1 --2- 172.21.15.123:0/3109045245 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc92006c8f0 0x7fc92006edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc9401db1a0 tx=0x7fc92c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:02.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.153+0000 7fc93d600640 1 -- 172.21.15.123:0/3109045245 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fc93407be20 con 0x7fc94006d060 2024-04-17T05:34:02.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.355+0000 7fc947e00640 1 -- 172.21.15.123:0/3109045245 --> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fc9400b1d60 con 0x7fc92006c8f0 2024-04-17T05:34:02.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.357+0000 7fc93d600640 1 -- 172.21.15.123:0/3109045245 <== mgr.4103 v2:172.21.15.164:6832/4204006015 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc9400b1d60 con 0x7fc92006c8f0 2024-04-17T05:34:02.356 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 7 to deep-scrub 2024-04-17T05:34:02.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.359+0000 7fc947e00640 1 -- 172.21.15.123:0/3109045245 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc92006c8f0 msgr2=0x7fc92006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:02.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.359+0000 7fc947e00640 1 --2- 172.21.15.123:0/3109045245 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc92006c8f0 0x7fc92006edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc9401db1a0 tx=0x7fc92c008040 comp rx=0 tx=0).stop 2024-04-17T05:34:02.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.359+0000 7fc947e00640 1 -- 172.21.15.123:0/3109045245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc94006d060 msgr2=0x7fc9400ae640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:02.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.359+0000 7fc947e00640 1 --2- 172.21.15.123:0/3109045245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc94006d060 0x7fc9400ae640 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc93402b950 tx=0x7fc9340046c0 comp rx=0 tx=0).stop 2024-04-17T05:34:02.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.359+0000 7fc947e00640 1 -- 172.21.15.123:0/3109045245 shutdown_connections 2024-04-17T05:34:02.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.359+0000 7fc947e00640 1 --2- 172.21.15.123:0/3109045245 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc9401492e0 0x7fc9400b2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:02.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.359+0000 7fc947e00640 1 --2- 172.21.15.123:0/3109045245 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fc92006c8f0 0x7fc92006edb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:02.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.359+0000 7fc947e00640 1 --2- 172.21.15.123:0/3109045245 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc94009d630 0x7fc9400b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:02.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.360+0000 7fc947e00640 1 --2- 172.21.15.123:0/3109045245 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc94006d060 0x7fc9400ae640 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:02.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.360+0000 7fc947e00640 1 -- 172.21.15.123:0/3109045245 >> 172.21.15.123:0/3109045245 conn(0x7fc9400b93b0 msgr2=0x7fc9400afc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:02.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.360+0000 7fc947e00640 1 -- 172.21.15.123:0/3109045245 shutdown_connections 2024-04-17T05:34:02.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.360+0000 7fc947e00640 1 -- 172.21.15.123:0/3109045245 wait complete. 2024-04-17T05:34:02.378 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T05:34:02.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.581+0000 7f8284c00640 1 Processor -- start 2024-04-17T05:34:02.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.582+0000 7f8284c00640 1 -- start start 2024-04-17T05:34:02.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.583+0000 7f8284c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f828006db60 0x7f828009cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:02.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.583+0000 7f8284c00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f828006df40 con 0x7f82800afc60 2024-04-17T05:34:02.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.583+0000 7f8284c00640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8280073f80 con 0x7f82801480e0 2024-04-17T05:34:02.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.583+0000 7f8284c00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f828009d4c0 con 0x7f828006db60 2024-04-17T05:34:02.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.583+0000 7f827de00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f828006db60 0x7f828009cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:02.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.583+0000 7f827de00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f828006db60 0x7f828009cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49226/0 (socket says 172.21.15.123:49226) 2024-04-17T05:34:02.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.583+0000 7f827de00640 1 -- 172.21.15.123:0/3937180308 learned_addr learned my addr 172.21.15.123:0/3937180308 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:34:02.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.583+0000 7f8275400640 1 --1- 172.21.15.123:0/3937180308 >> v1:172.21.15.123:6789/0 conn(0x7f82800afc60 0x7f82801479d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59250/0 (socket says 172.21.15.123:59250) 2024-04-17T05:34:02.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.584+0000 7f827de00640 1 -- 172.21.15.123:0/3937180308 >> v1:172.21.15.164:6789/0 conn(0x7f82801480e0 legacy=0x7f828014ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:02.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.584+0000 7f827de00640 1 -- 172.21.15.123:0/3937180308 >> v1:172.21.15.123:6789/0 conn(0x7f82800afc60 legacy=0x7f82801479d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:02.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.584+0000 7f827de00640 1 -- 172.21.15.123:0/3937180308 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8280073930 con 0x7f828006db60 2024-04-17T05:34:02.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.584+0000 7f827d400640 1 -- 172.21.15.123:0/3937180308 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2807884764 0 0) 0x7f828006df40 con 0x7f82800afc60 2024-04-17T05:34:02.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.585+0000 7f827de00640 1 --2- 172.21.15.123:0/3937180308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f828006db60 0x7f828009cf80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8270009870 tx=0x7f827002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12071f44db0fad17 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:02.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.585+0000 7f827d400640 1 -- 172.21.15.123:0/3937180308 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8270035020 con 0x7f828006db60 2024-04-17T05:34:02.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.585+0000 7f827d400640 1 -- 172.21.15.123:0/3937180308 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8270031870 con 0x7f828006db60 2024-04-17T05:34:02.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.585+0000 7f827d400640 1 -- 172.21.15.123:0/3937180308 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8270031c40 con 0x7f828006db60 2024-04-17T05:34:02.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.586+0000 7f8284c00640 1 -- 172.21.15.123:0/3937180308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f828006db60 msgr2=0x7f828009cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:02.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.586+0000 7f8284c00640 1 --2- 172.21.15.123:0/3937180308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f828006db60 0x7f828009cf80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8270009870 tx=0x7f827002b910 comp rx=0 tx=0).stop 2024-04-17T05:34:02.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.586+0000 7f8284c00640 1 -- 172.21.15.123:0/3937180308 shutdown_connections 2024-04-17T05:34:02.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.586+0000 7f8284c00640 1 --2- 172.21.15.123:0/3937180308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f828006db60 0x7f828009cf80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:02.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.586+0000 7f8284c00640 1 -- 172.21.15.123:0/3937180308 >> 172.21.15.123:0/3937180308 conn(0x7f82800b93b0 msgr2=0x7f82800b97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:02.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.586+0000 7f8284c00640 1 -- 172.21.15.123:0/3937180308 shutdown_connections 2024-04-17T05:34:02.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.586+0000 7f8284c00640 1 -- 172.21.15.123:0/3937180308 wait complete. 2024-04-17T05:34:02.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.587+0000 7f8284c00640 1 Processor -- start 2024-04-17T05:34:02.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.588+0000 7f8284c00640 1 -- start start 2024-04-17T05:34:02.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.588+0000 7f8284c00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f828006db60 0x7f8280146e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:02.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.588+0000 7f8284c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f82800afc60 0x7f8280072c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:02.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.588+0000 7f8284c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82801480e0 0x7f8280071770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:02.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.588+0000 7f8284c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f82800734e0 con 0x7f82801480e0 2024-04-17T05:34:02.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.588+0000 7f8284c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f828009c620 con 0x7f82800afc60 2024-04-17T05:34:02.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.588+0000 7f8284c00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f8280073660 con 0x7f828006db60 2024-04-17T05:34:02.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.589+0000 7f827e800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82801480e0 0x7f8280071770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:02.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.589+0000 7f827e800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82801480e0 0x7f8280071770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49242/0 (socket says 172.21.15.123:49242) 2024-04-17T05:34:02.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.589+0000 7f827e800640 1 -- 172.21.15.123:0/2360119516 learned_addr learned my addr 172.21.15.123:0/2360119516 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:34:02.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.589+0000 7f8275400640 1 --2- 172.21.15.123:0/2360119516 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f82800afc60 0x7f8280072c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:02.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.589+0000 7f827e800640 1 -- 172.21.15.123:0/2360119516 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f828006db60 msgr2=0x7f8280146e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:02.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.589+0000 7f827e800640 1 --2- 172.21.15.123:0/2360119516 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f828006db60 0x7f8280146e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:02.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.589+0000 7f827e800640 1 -- 172.21.15.123:0/2360119516 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f82800afc60 msgr2=0x7f8280072c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:02.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.589+0000 7f827e800640 1 --2- 172.21.15.123:0/2360119516 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f82800afc60 0x7f8280072c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:02.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.589+0000 7f827e800640 1 -- 172.21.15.123:0/2360119516 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8280070bb0 con 0x7f82801480e0 2024-04-17T05:34:02.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.589+0000 7f827e800640 1 --2- 172.21.15.123:0/2360119516 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82801480e0 0x7f8280071770 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f827800b970 tx=0x7f827800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:02.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.590+0000 7f8276a00640 1 -- 172.21.15.123:0/2360119516 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8278019070 con 0x7f82801480e0 2024-04-17T05:34:02.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.590+0000 7f8276a00640 1 -- 172.21.15.123:0/2360119516 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f827800cae0 con 0x7f82801480e0 2024-04-17T05:34:02.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.590+0000 7f8276a00640 1 -- 172.21.15.123:0/2360119516 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8278014440 con 0x7f82801480e0 2024-04-17T05:34:02.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.590+0000 7f8284c00640 1 -- 172.21.15.123:0/2360119516 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8280072240 con 0x7f82801480e0 2024-04-17T05:34:02.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.590+0000 7f8284c00640 1 -- 172.21.15.123:0/2360119516 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8280071390 con 0x7f82801480e0 2024-04-17T05:34:02.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.591+0000 7f8284c00640 1 -- 172.21.15.123:0/2360119516 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f828009dc40 con 0x7f82801480e0 2024-04-17T05:34:02.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.592+0000 7f8276a00640 1 -- 172.21.15.123:0/2360119516 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f827801c070 con 0x7f82801480e0 2024-04-17T05:34:02.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.593+0000 7f8276a00640 1 --2- 172.21.15.123:0/2360119516 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f825c06c8f0 0x7f825c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:02.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.593+0000 7f8276a00640 1 -- 172.21.15.123:0/2360119516 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f827808baf0 con 0x7f82801480e0 2024-04-17T05:34:02.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.593+0000 7f827de00640 1 --2- 172.21.15.123:0/2360119516 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f825c06c8f0 0x7f825c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:02.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.594+0000 7f827de00640 1 --2- 172.21.15.123:0/2360119516 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f825c06c8f0 0x7f825c06edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8270036000 tx=0x7f8270030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:02.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.597+0000 7f8276a00640 1 -- 172.21.15.123:0/2360119516 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f828009dc40 con 0x7f82801480e0 2024-04-17T05:34:02.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.784+0000 7f8284c00640 1 -- 172.21.15.123:0/2360119516 --> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8280148600 con 0x7f825c06c8f0 2024-04-17T05:34:02.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.809+0000 7f8276a00640 1 -- 172.21.15.123:0/2360119516 <== mgr.4103 v2:172.21.15.164:6832/4204006015 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+330206 (secure 0 0 0) 0x7f8280148600 con 0x7f825c06c8f0 2024-04-17T05:34:02.813 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:34:02.815 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-04-17T05:34:02.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.816+0000 7f8284c00640 1 -- 172.21.15.123:0/2360119516 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f825c06c8f0 msgr2=0x7f825c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:02.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.816+0000 7f8284c00640 1 --2- 172.21.15.123:0/2360119516 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f825c06c8f0 0x7f825c06edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8270036000 tx=0x7f8270030000 comp rx=0 tx=0).stop 2024-04-17T05:34:02.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.816+0000 7f8284c00640 1 -- 172.21.15.123:0/2360119516 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82801480e0 msgr2=0x7f8280071770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:02.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.816+0000 7f8284c00640 1 --2- 172.21.15.123:0/2360119516 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82801480e0 0x7f8280071770 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f827800b970 tx=0x7f827800be30 comp rx=0 tx=0).stop 2024-04-17T05:34:02.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.816+0000 7f8284c00640 1 -- 172.21.15.123:0/2360119516 shutdown_connections 2024-04-17T05:34:02.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.816+0000 7f8284c00640 1 --2- 172.21.15.123:0/2360119516 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82801480e0 0x7f8280071770 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:02.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.816+0000 7f8284c00640 1 --2- 172.21.15.123:0/2360119516 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f82800afc60 0x7f8280072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:02.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.816+0000 7f8284c00640 1 --2- 172.21.15.123:0/2360119516 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f825c06c8f0 0x7f825c06edb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:02.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.816+0000 7f8284c00640 1 --2- 172.21.15.123:0/2360119516 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f828006db60 0x7f8280146e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:02.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.816+0000 7f8284c00640 1 -- 172.21.15.123:0/2360119516 >> 172.21.15.123:0/2360119516 conn(0x7f82800b93b0 msgr2=0x7f828009c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:02.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.817+0000 7f8284c00640 1 -- 172.21.15.123:0/2360119516 shutdown_connections 2024-04-17T05:34:02.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:02.817+0000 7f8284c00640 1 -- 172.21.15.123:0/2360119516 wait complete. 2024-04-17T05:34:02.834 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":240,"stamp":"2024-04-17T05:34:02.483877+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1536271,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":152,"num_read_kb":136,"num_write":562,"num_write_kb":3543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1023,"ondisk_log_size":1023,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225688,"kb_used_data":5400,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749032,"statfs":{"total":773094113280,"available":772863008768,"internally_reserved":0,"allocated":5529600,"data_stored":4051390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005662"},"pg_stats":[{"pgid":"2.1f","version":"28'6","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:00.321107+0000","last_change":"2024-04-17T05:34:00.321155+0000","last_active":"2024-04-17T05:34:00.321107+0000","last_peered":"2024-04-17T05:34:00.321107+0000","last_clean":"2024-04-17T05:34:00.321107+0000","last_became_active":"2024-04-17T05:26:52.205459+0000","last_became_peered":"2024-04-17T05:26:52.205459+0000","last_unstale":"2024-04-17T05:34:00.321107+0000","last_undegraded":"2024-04-17T05:34:00.321107+0000","last_fullsized":"2024-04-17T05:34:00.321107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-04-17T05:34:00.321026+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-04-17T05:34:00.321026+0000","last_clean_scrub_stamp":"2024-04-17T05:34:00.321026+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:10:24.222415+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'7","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.381375+0000","last_change":"2024-04-17T05:26:53.231441+0000","last_active":"2024-04-17T05:33:47.381375+0000","last_peered":"2024-04-17T05:33:47.381375+0000","last_clean":"2024-04-17T05:33:47.381375+0000","last_became_active":"2024-04-17T05:26:53.231139+0000","last_became_peered":"2024-04-17T05:26:53.231139+0000","last_unstale":"2024-04-17T05:33:47.381375+0000","last_undegraded":"2024-04-17T05:33:47.381375+0000","last_fullsized":"2024-04-17T05:33:47.381375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:50.386218+0000","last_change":"2024-04-17T05:26:57.347742+0000","last_active":"2024-04-17T05:31:50.386218+0000","last_peered":"2024-04-17T05:31:50.386218+0000","last_clean":"2024-04-17T05:31:50.386218+0000","last_became_active":"2024-04-17T05:26:57.347333+0000","last_became_peered":"2024-04-17T05:26:57.347333+0000","last_unstale":"2024-04-17T05:31:50.386218+0000","last_undegraded":"2024-04-17T05:31:50.386218+0000","last_fullsized":"2024-04-17T05:31:50.386218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"28'3","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:32:55.396369+0000","last_change":"2024-04-17T05:26:52.203448+0000","last_active":"2024-04-17T05:32:55.396369+0000","last_peered":"2024-04-17T05:32:55.396369+0000","last_clean":"2024-04-17T05:32:55.396369+0000","last_became_active":"2024-04-17T05:26:52.203161+0000","last_became_peered":"2024-04-17T05:26:52.203161+0000","last_unstale":"2024-04-17T05:32:55.396369+0000","last_undegraded":"2024-04-17T05:32:55.396369+0000","last_fullsized":"2024-04-17T05:32:55.396369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'8","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.396741+0000","last_change":"2024-04-17T05:26:53.241735+0000","last_active":"2024-04-17T05:33:47.396741+0000","last_peered":"2024-04-17T05:33:47.396741+0000","last_clean":"2024-04-17T05:33:47.396741+0000","last_became_active":"2024-04-17T05:26:53.241460+0000","last_became_peered":"2024-04-17T05:26:53.241460+0000","last_unstale":"2024-04-17T05:33:47.396741+0000","last_undegraded":"2024-04-17T05:33:47.396741+0000","last_fullsized":"2024-04-17T05:33:47.396741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:50.382684+0000","last_change":"2024-04-17T05:26:57.310052+0000","last_active":"2024-04-17T05:31:50.382684+0000","last_peered":"2024-04-17T05:31:50.382684+0000","last_clean":"2024-04-17T05:31:50.382684+0000","last_became_active":"2024-04-17T05:26:57.309057+0000","last_became_peered":"2024-04-17T05:26:57.309057+0000","last_unstale":"2024-04-17T05:31:50.382684+0000","last_undegraded":"2024-04-17T05:31:50.382684+0000","last_fullsized":"2024-04-17T05:31:50.382684+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'6","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:42.521017+0000","last_change":"2024-04-17T05:26:52.217413+0000","last_active":"2024-04-17T05:29:42.521017+0000","last_peered":"2024-04-17T05:29:42.521017+0000","last_clean":"2024-04-17T05:29:42.521017+0000","last_became_active":"2024-04-17T05:26:52.217101+0000","last_became_peered":"2024-04-17T05:26:52.217101+0000","last_unstale":"2024-04-17T05:29:42.521017+0000","last_undegraded":"2024-04-17T05:29:42.521017+0000","last_fullsized":"2024-04-17T05:29:42.521017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:39:51.930934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'8","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.393645+0000","last_change":"2024-04-17T05:26:53.219012+0000","last_active":"2024-04-17T05:33:47.393645+0000","last_peered":"2024-04-17T05:33:47.393645+0000","last_clean":"2024-04-17T05:33:47.393645+0000","last_became_active":"2024-04-17T05:26:53.216591+0000","last_became_peered":"2024-04-17T05:26:53.216591+0000","last_unstale":"2024-04-17T05:33:47.393645+0000","last_undegraded":"2024-04-17T05:33:47.393645+0000","last_fullsized":"2024-04-17T05:33:47.393645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:02:12.833146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:32:00.384495+0000","last_change":"2024-04-17T05:26:57.310537+0000","last_active":"2024-04-17T05:32:00.384495+0000","last_peered":"2024-04-17T05:32:00.384495+0000","last_clean":"2024-04-17T05:32:00.384495+0000","last_became_active":"2024-04-17T05:26:57.309381+0000","last_became_peered":"2024-04-17T05:26:57.309381+0000","last_unstale":"2024-04-17T05:32:00.384495+0000","last_undegraded":"2024-04-17T05:32:00.384495+0000","last_fullsized":"2024-04-17T05:32:00.384495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'5","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:55.432886+0000","last_change":"2024-04-17T05:26:52.218309+0000","last_active":"2024-04-17T05:31:55.432886+0000","last_peered":"2024-04-17T05:31:55.432886+0000","last_clean":"2024-04-17T05:31:55.432886+0000","last_became_active":"2024-04-17T05:26:52.217898+0000","last_became_peered":"2024-04-17T05:26:52.217898+0000","last_unstale":"2024-04-17T05:31:55.432886+0000","last_undegraded":"2024-04-17T05:31:55.432886+0000","last_fullsized":"2024-04-17T05:31:55.432886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:16:02.152039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'14","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.396662+0000","last_change":"2024-04-17T05:26:53.232546+0000","last_active":"2024-04-17T05:33:47.396662+0000","last_peered":"2024-04-17T05:33:47.396662+0000","last_clean":"2024-04-17T05:33:47.396662+0000","last_became_active":"2024-04-17T05:26:53.232239+0000","last_became_peered":"2024-04-17T05:26:53.232239+0000","last_unstale":"2024-04-17T05:33:47.396662+0000","last_undegraded":"2024-04-17T05:33:47.396662+0000","last_fullsized":"2024-04-17T05:33:47.396662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:38:13.010763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:32:00.384457+0000","last_change":"2024-04-17T05:26:57.297256+0000","last_active":"2024-04-17T05:32:00.384457+0000","last_peered":"2024-04-17T05:32:00.384457+0000","last_clean":"2024-04-17T05:32:00.384457+0000","last_became_active":"2024-04-17T05:26:57.296757+0000","last_became_peered":"2024-04-17T05:26:57.296757+0000","last_unstale":"2024-04-17T05:32:00.384457+0000","last_undegraded":"2024-04-17T05:32:00.384457+0000","last_fullsized":"2024-04-17T05:32:00.384457+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.386895+0000","last_change":"2024-04-17T05:26:53.244539+0000","last_active":"2024-04-17T05:33:47.386895+0000","last_peered":"2024-04-17T05:33:47.386895+0000","last_clean":"2024-04-17T05:33:47.386895+0000","last_became_active":"2024-04-17T05:26:53.244104+0000","last_became_peered":"2024-04-17T05:26:53.244104+0000","last_unstale":"2024-04-17T05:33:47.386895+0000","last_undegraded":"2024-04-17T05:33:47.386895+0000","last_fullsized":"2024-04-17T05:33:47.386895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:41:48.514881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'8","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:25.427323+0000","last_change":"2024-04-17T05:26:52.214434+0000","last_active":"2024-04-17T05:31:25.427323+0000","last_peered":"2024-04-17T05:31:25.427323+0000","last_clean":"2024-04-17T05:31:25.427323+0000","last_became_active":"2024-04-17T05:26:52.214158+0000","last_became_peered":"2024-04-17T05:26:52.214158+0000","last_unstale":"2024-04-17T05:31:25.427323+0000","last_undegraded":"2024-04-17T05:31:25.427323+0000","last_fullsized":"2024-04-17T05:31:25.427323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:36:56.201576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:45.402514+0000","last_change":"2024-04-17T05:26:57.307151+0000","last_active":"2024-04-17T05:33:45.402514+0000","last_peered":"2024-04-17T05:33:45.402514+0000","last_clean":"2024-04-17T05:33:45.402514+0000","last_became_active":"2024-04-17T05:26:57.305676+0000","last_became_peered":"2024-04-17T05:26:57.305676+0000","last_unstale":"2024-04-17T05:33:45.402514+0000","last_undegraded":"2024-04-17T05:33:45.402514+0000","last_fullsized":"2024-04-17T05:33:45.402514+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"28'9","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.377473+0000","last_change":"2024-04-17T05:26:53.230514+0000","last_active":"2024-04-17T05:33:47.377473+0000","last_peered":"2024-04-17T05:33:47.377473+0000","last_clean":"2024-04-17T05:33:47.377473+0000","last_became_active":"2024-04-17T05:26:53.230175+0000","last_became_peered":"2024-04-17T05:26:53.230175+0000","last_unstale":"2024-04-17T05:33:47.377473+0000","last_undegraded":"2024-04-17T05:33:47.377473+0000","last_fullsized":"2024-04-17T05:33:47.377473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:25.405430+0000","last_change":"2024-04-17T05:26:52.207664+0000","last_active":"2024-04-17T05:33:25.405430+0000","last_peered":"2024-04-17T05:33:25.405430+0000","last_clean":"2024-04-17T05:33:25.405430+0000","last_became_active":"2024-04-17T05:26:52.207343+0000","last_became_peered":"2024-04-17T05:26:52.207343+0000","last_unstale":"2024-04-17T05:33:25.405430+0000","last_undegraded":"2024-04-17T05:33:25.405430+0000","last_fullsized":"2024-04-17T05:33:25.405430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:45.402464+0000","last_change":"2024-04-17T05:26:57.311205+0000","last_active":"2024-04-17T05:33:45.402464+0000","last_peered":"2024-04-17T05:33:45.402464+0000","last_clean":"2024-04-17T05:33:45.402464+0000","last_became_active":"2024-04-17T05:26:57.310038+0000","last_became_peered":"2024-04-17T05:26:57.310038+0000","last_unstale":"2024-04-17T05:33:45.402464+0000","last_undegraded":"2024-04-17T05:33:45.402464+0000","last_fullsized":"2024-04-17T05:33:45.402464+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'6","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.375684+0000","last_change":"2024-04-17T05:27:39.897206+0000","last_active":"2024-04-17T05:33:47.375684+0000","last_peered":"2024-04-17T05:33:47.375684+0000","last_clean":"2024-04-17T05:33:47.375684+0000","last_became_active":"2024-04-17T05:27:39.896306+0000","last_became_peered":"2024-04-17T05:27:39.896306+0000","last_unstale":"2024-04-17T05:33:47.375684+0000","last_undegraded":"2024-04-17T05:33:47.375684+0000","last_fullsized":"2024-04-17T05:33:47.375684+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"28'3","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:25.405399+0000","last_change":"2024-04-17T05:26:52.207557+0000","last_active":"2024-04-17T05:33:25.405399+0000","last_peered":"2024-04-17T05:33:25.405399+0000","last_clean":"2024-04-17T05:33:25.405399+0000","last_became_active":"2024-04-17T05:26:52.207019+0000","last_became_peered":"2024-04-17T05:26:52.207019+0000","last_unstale":"2024-04-17T05:33:25.405399+0000","last_undegraded":"2024-04-17T05:33:25.405399+0000","last_fullsized":"2024-04-17T05:33:25.405399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:45.407995+0000","last_change":"2024-04-17T05:26:57.345734+0000","last_active":"2024-04-17T05:33:45.407995+0000","last_peered":"2024-04-17T05:33:45.407995+0000","last_clean":"2024-04-17T05:33:45.407995+0000","last_became_active":"2024-04-17T05:26:57.345300+0000","last_became_peered":"2024-04-17T05:26:57.345300+0000","last_unstale":"2024-04-17T05:33:45.407995+0000","last_undegraded":"2024-04-17T05:33:45.407995+0000","last_fullsized":"2024-04-17T05:33:45.407995+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"28'3","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.386095+0000","last_change":"2024-04-17T05:26:53.218687+0000","last_active":"2024-04-17T05:33:47.386095+0000","last_peered":"2024-04-17T05:33:47.386095+0000","last_clean":"2024-04-17T05:33:47.386095+0000","last_became_active":"2024-04-17T05:26:53.218355+0000","last_became_peered":"2024-04-17T05:26:53.218355+0000","last_unstale":"2024-04-17T05:33:47.386095+0000","last_undegraded":"2024-04-17T05:33:47.386095+0000","last_fullsized":"2024-04-17T05:33:47.386095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:15.425628+0000","last_change":"2024-04-17T05:26:52.214868+0000","last_active":"2024-04-17T05:31:15.425628+0000","last_peered":"2024-04-17T05:31:15.425628+0000","last_clean":"2024-04-17T05:31:15.425628+0000","last_became_active":"2024-04-17T05:26:52.214633+0000","last_became_peered":"2024-04-17T05:26:52.214633+0000","last_unstale":"2024-04-17T05:31:15.425628+0000","last_undegraded":"2024-04-17T05:31:15.425628+0000","last_fullsized":"2024-04-17T05:31:15.425628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:10:33.072665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:45.402536+0000","last_change":"2024-04-17T05:26:57.309644+0000","last_active":"2024-04-17T05:33:45.402536+0000","last_peered":"2024-04-17T05:33:45.402536+0000","last_clean":"2024-04-17T05:33:45.402536+0000","last_became_active":"2024-04-17T05:26:57.309175+0000","last_became_peered":"2024-04-17T05:26:57.309175+0000","last_unstale":"2024-04-17T05:33:45.402536+0000","last_undegraded":"2024-04-17T05:33:45.402536+0000","last_fullsized":"2024-04-17T05:33:45.402536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"28'5","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.376056+0000","last_change":"2024-04-17T05:26:53.220368+0000","last_active":"2024-04-17T05:33:47.376056+0000","last_peered":"2024-04-17T05:33:47.376056+0000","last_clean":"2024-04-17T05:33:47.376056+0000","last_became_active":"2024-04-17T05:26:53.220068+0000","last_became_peered":"2024-04-17T05:26:53.220068+0000","last_unstale":"2024-04-17T05:33:47.376056+0000","last_undegraded":"2024-04-17T05:33:47.376056+0000","last_fullsized":"2024-04-17T05:33:47.376056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:15.414626+0000","last_change":"2024-04-17T05:26:52.215954+0000","last_active":"2024-04-17T05:31:15.414626+0000","last_peered":"2024-04-17T05:31:15.414626+0000","last_clean":"2024-04-17T05:31:15.414626+0000","last_became_active":"2024-04-17T05:26:52.215637+0000","last_became_peered":"2024-04-17T05:26:52.215637+0000","last_unstale":"2024-04-17T05:31:15.414626+0000","last_undegraded":"2024-04-17T05:31:15.414626+0000","last_fullsized":"2024-04-17T05:31:15.414626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:05:12.780620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:15.397286+0000","last_change":"2024-04-17T05:26:57.342654+0000","last_active":"2024-04-17T05:33:15.397286+0000","last_peered":"2024-04-17T05:33:15.397286+0000","last_clean":"2024-04-17T05:33:15.397286+0000","last_became_active":"2024-04-17T05:26:57.342205+0000","last_became_peered":"2024-04-17T05:26:57.342205+0000","last_unstale":"2024-04-17T05:33:15.397286+0000","last_undegraded":"2024-04-17T05:33:15.397286+0000","last_fullsized":"2024-04-17T05:33:15.397286+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'6","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.381727+0000","last_change":"2024-04-17T05:26:53.238192+0000","last_active":"2024-04-17T05:33:47.381727+0000","last_peered":"2024-04-17T05:33:47.381727+0000","last_clean":"2024-04-17T05:33:47.381727+0000","last_became_active":"2024-04-17T05:26:53.237901+0000","last_became_peered":"2024-04-17T05:26:53.237901+0000","last_unstale":"2024-04-17T05:33:47.381727+0000","last_undegraded":"2024-04-17T05:33:47.381727+0000","last_fullsized":"2024-04-17T05:33:47.381727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'106","reported_seq":136,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.315293+0000","last_change":"2024-04-17T05:26:52.213337+0000","last_active":"2024-04-17T05:33:47.315293+0000","last_peered":"2024-04-17T05:33:47.315293+0000","last_clean":"2024-04-17T05:33:47.315293+0000","last_became_active":"2024-04-17T05:26:52.213091+0000","last_became_peered":"2024-04-17T05:26:52.213091+0000","last_unstale":"2024-04-17T05:33:47.315293+0000","last_undegraded":"2024-04-17T05:33:47.315293+0000","last_fullsized":"2024-04-17T05:33:47.315293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":210,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:00.397161+0000","last_change":"2024-04-17T05:26:57.342025+0000","last_active":"2024-04-17T05:33:00.397161+0000","last_peered":"2024-04-17T05:33:00.397161+0000","last_clean":"2024-04-17T05:33:00.397161+0000","last_became_active":"2024-04-17T05:26:57.341654+0000","last_became_peered":"2024-04-17T05:26:57.341654+0000","last_unstale":"2024-04-17T05:33:00.397161+0000","last_undegraded":"2024-04-17T05:33:00.397161+0000","last_fullsized":"2024-04-17T05:33:00.397161+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'11","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.373768+0000","last_change":"2024-04-17T05:26:53.220626+0000","last_active":"2024-04-17T05:33:47.373768+0000","last_peered":"2024-04-17T05:33:47.373768+0000","last_clean":"2024-04-17T05:33:47.373768+0000","last_became_active":"2024-04-17T05:26:53.220331+0000","last_became_peered":"2024-04-17T05:26:53.220331+0000","last_unstale":"2024-04-17T05:33:47.373768+0000","last_undegraded":"2024-04-17T05:33:47.373768+0000","last_fullsized":"2024-04-17T05:33:47.373768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:05.423944+0000","last_change":"2024-04-17T05:26:52.216060+0000","last_active":"2024-04-17T05:31:05.423944+0000","last_peered":"2024-04-17T05:31:05.423944+0000","last_clean":"2024-04-17T05:31:05.423944+0000","last_became_active":"2024-04-17T05:26:52.215771+0000","last_became_peered":"2024-04-17T05:26:52.215771+0000","last_unstale":"2024-04-17T05:31:05.423944+0000","last_undegraded":"2024-04-17T05:31:05.423944+0000","last_fullsized":"2024-04-17T05:31:05.423944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:14:11.769826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:15.400357+0000","last_change":"2024-04-17T05:27:39.587602+0000","last_active":"2024-04-17T05:33:15.400357+0000","last_peered":"2024-04-17T05:33:15.400357+0000","last_clean":"2024-04-17T05:33:15.400357+0000","last_became_active":"2024-04-17T05:27:39.586593+0000","last_became_peered":"2024-04-17T05:27:39.586593+0000","last_unstale":"2024-04-17T05:33:15.400357+0000","last_undegraded":"2024-04-17T05:33:15.400357+0000","last_fullsized":"2024-04-17T05:33:15.400357+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.396983+0000","last_change":"2024-04-17T05:26:53.238977+0000","last_active":"2024-04-17T05:33:47.396983+0000","last_peered":"2024-04-17T05:33:47.396983+0000","last_clean":"2024-04-17T05:33:47.396983+0000","last_became_active":"2024-04-17T05:26:53.238516+0000","last_became_peered":"2024-04-17T05:26:53.238516+0000","last_unstale":"2024-04-17T05:33:47.396983+0000","last_undegraded":"2024-04-17T05:33:47.396983+0000","last_fullsized":"2024-04-17T05:33:47.396983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:59:47.655532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:59.807334+0000","last_change":"2024-04-17T05:33:59.807354+0000","last_active":"2024-04-17T05:33:59.807334+0000","last_peered":"2024-04-17T05:33:59.807334+0000","last_clean":"2024-04-17T05:33:59.807334+0000","last_became_active":"2024-04-17T05:26:52.204529+0000","last_became_peered":"2024-04-17T05:26:52.204529+0000","last_unstale":"2024-04-17T05:33:59.807334+0000","last_undegraded":"2024-04-17T05:33:59.807334+0000","last_fullsized":"2024-04-17T05:33:59.807334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:33:59.807271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:33:59.807271+0000","last_clean_scrub_stamp":"2024-04-17T05:33:59.807271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:10:01.526077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:15.404444+0000","last_change":"2024-04-17T05:26:57.300433+0000","last_active":"2024-04-17T05:33:15.404444+0000","last_peered":"2024-04-17T05:33:15.404444+0000","last_clean":"2024-04-17T05:33:15.404444+0000","last_became_active":"2024-04-17T05:26:57.299625+0000","last_became_peered":"2024-04-17T05:26:57.299625+0000","last_unstale":"2024-04-17T05:33:15.404444+0000","last_undegraded":"2024-04-17T05:33:15.404444+0000","last_fullsized":"2024-04-17T05:33:15.404444+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"28'5","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.382528+0000","last_change":"2024-04-17T05:26:53.221039+0000","last_active":"2024-04-17T05:33:47.382528+0000","last_peered":"2024-04-17T05:33:47.382528+0000","last_clean":"2024-04-17T05:33:47.382528+0000","last_became_active":"2024-04-17T05:26:53.220763+0000","last_became_peered":"2024-04-17T05:26:53.220763+0000","last_unstale":"2024-04-17T05:33:47.382528+0000","last_undegraded":"2024-04-17T05:33:47.382528+0000","last_fullsized":"2024-04-17T05:33:47.382528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'5","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:05.373798+0000","last_change":"2024-04-17T05:26:52.200059+0000","last_active":"2024-04-17T05:31:05.373798+0000","last_peered":"2024-04-17T05:31:05.373798+0000","last_clean":"2024-04-17T05:31:05.373798+0000","last_became_active":"2024-04-17T05:26:52.199528+0000","last_became_peered":"2024-04-17T05:26:52.199528+0000","last_unstale":"2024-04-17T05:31:05.373798+0000","last_undegraded":"2024-04-17T05:31:05.373798+0000","last_fullsized":"2024-04-17T05:31:05.373798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:39:42.873364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'2","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:41.906817+0000","last_change":"2024-04-17T05:27:39.629806+0000","last_active":"2024-04-17T05:33:41.906817+0000","last_peered":"2024-04-17T05:33:41.906817+0000","last_clean":"2024-04-17T05:33:41.906817+0000","last_became_active":"2024-04-17T05:27:39.628034+0000","last_became_peered":"2024-04-17T05:27:39.628034+0000","last_unstale":"2024-04-17T05:33:41.906817+0000","last_undegraded":"2024-04-17T05:33:41.906817+0000","last_fullsized":"2024-04-17T05:33:41.906817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:39:30.581787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"28'8","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.374151+0000","last_change":"2024-04-17T05:26:53.225946+0000","last_active":"2024-04-17T05:33:47.374151+0000","last_peered":"2024-04-17T05:33:47.374151+0000","last_clean":"2024-04-17T05:33:47.374151+0000","last_became_active":"2024-04-17T05:26:53.220930+0000","last_became_peered":"2024-04-17T05:26:53.220930+0000","last_unstale":"2024-04-17T05:33:47.374151+0000","last_undegraded":"2024-04-17T05:33:47.374151+0000","last_fullsized":"2024-04-17T05:33:47.374151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'42","reported_seq":108,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:42.902994+0000","last_change":"2024-04-17T05:26:52.200139+0000","last_active":"2024-04-17T05:33:42.902994+0000","last_peered":"2024-04-17T05:33:42.902994+0000","last_clean":"2024-04-17T05:33:42.902994+0000","last_became_active":"2024-04-17T05:26:52.199804+0000","last_became_peered":"2024-04-17T05:26:52.199804+0000","last_unstale":"2024-04-17T05:33:42.902994+0000","last_undegraded":"2024-04-17T05:33:42.902994+0000","last_fullsized":"2024-04-17T05:33:42.902994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10823,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":36,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:30.405945+0000","last_change":"2024-04-17T05:26:57.303365+0000","last_active":"2024-04-17T05:33:30.405945+0000","last_peered":"2024-04-17T05:33:30.405945+0000","last_clean":"2024-04-17T05:33:30.405945+0000","last_became_active":"2024-04-17T05:26:57.301101+0000","last_became_peered":"2024-04-17T05:26:57.301101+0000","last_unstale":"2024-04-17T05:33:30.405945+0000","last_undegraded":"2024-04-17T05:33:30.405945+0000","last_fullsized":"2024-04-17T05:33:30.405945+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"28'5","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:58.320953+0000","last_change":"2024-04-17T05:33:58.320998+0000","last_active":"2024-04-17T05:33:58.320953+0000","last_peered":"2024-04-17T05:33:58.320953+0000","last_clean":"2024-04-17T05:33:58.320953+0000","last_became_active":"2024-04-17T05:26:53.238488+0000","last_became_peered":"2024-04-17T05:26:53.238488+0000","last_unstale":"2024-04-17T05:33:58.320953+0000","last_undegraded":"2024-04-17T05:33:58.320953+0000","last_fullsized":"2024-04-17T05:33:58.320953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-04-17T05:33:58.320826+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-04-17T05:33:58.320826+0000","last_clean_scrub_stamp":"2024-04-17T05:33:58.320826+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:49:04.501280+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:55.422328+0000","last_change":"2024-04-17T05:26:52.213104+0000","last_active":"2024-04-17T05:30:55.422328+0000","last_peered":"2024-04-17T05:30:55.422328+0000","last_clean":"2024-04-17T05:30:55.422328+0000","last_became_active":"2024-04-17T05:26:52.212838+0000","last_became_peered":"2024-04-17T05:26:52.212838+0000","last_unstale":"2024-04-17T05:30:55.422328+0000","last_undegraded":"2024-04-17T05:30:55.422328+0000","last_fullsized":"2024-04-17T05:30:55.422328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:11:58.913400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:30.401873+0000","last_change":"2024-04-17T05:26:57.342387+0000","last_active":"2024-04-17T05:33:30.401873+0000","last_peered":"2024-04-17T05:33:30.401873+0000","last_clean":"2024-04-17T05:33:30.401873+0000","last_became_active":"2024-04-17T05:26:57.342008+0000","last_became_peered":"2024-04-17T05:26:57.342008+0000","last_unstale":"2024-04-17T05:33:30.401873+0000","last_undegraded":"2024-04-17T05:33:30.401873+0000","last_fullsized":"2024-04-17T05:33:30.401873+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:59.961753+0000","last_change":"2024-04-17T05:33:59.961795+0000","last_active":"2024-04-17T05:33:59.961753+0000","last_peered":"2024-04-17T05:33:59.961753+0000","last_clean":"2024-04-17T05:33:59.961753+0000","last_became_active":"2024-04-17T05:26:53.242778+0000","last_became_peered":"2024-04-17T05:26:53.242778+0000","last_unstale":"2024-04-17T05:33:59.961753+0000","last_undegraded":"2024-04-17T05:33:59.961753+0000","last_fullsized":"2024-04-17T05:33:59.961753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-04-17T05:33:59.961601+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-04-17T05:33:59.961601+0000","last_clean_scrub_stamp":"2024-04-17T05:33:59.961601+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:12.359904+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'4","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:05.373837+0000","last_change":"2024-04-17T05:26:52.198125+0000","last_active":"2024-04-17T05:31:05.373837+0000","last_peered":"2024-04-17T05:31:05.373837+0000","last_clean":"2024-04-17T05:31:05.373837+0000","last_became_active":"2024-04-17T05:26:52.197762+0000","last_became_peered":"2024-04-17T05:26:52.197762+0000","last_unstale":"2024-04-17T05:31:05.373837+0000","last_undegraded":"2024-04-17T05:31:05.373837+0000","last_fullsized":"2024-04-17T05:31:05.373837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:54:28.440614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":185,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:50.421452+0000","last_change":"2024-04-17T05:26:48.072527+0000","last_active":"2024-04-17T05:30:50.421452+0000","last_peered":"2024-04-17T05:30:50.421452+0000","last_clean":"2024-04-17T05:30:50.421452+0000","last_became_active":"2024-04-17T05:26:48.070585+0000","last_became_peered":"2024-04-17T05:26:48.070585+0000","last_unstale":"2024-04-17T05:30:50.421452+0000","last_undegraded":"2024-04-17T05:30:50.421452+0000","last_fullsized":"2024-04-17T05:30:50.421452+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:46.995002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:46.995002+0000","last_clean_scrub_stamp":"2024-04-17T05:26:46.995002+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:48:35.792125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:10.413588+0000","last_change":"2024-04-17T05:26:57.346681+0000","last_active":"2024-04-17T05:31:10.413588+0000","last_peered":"2024-04-17T05:31:10.413588+0000","last_clean":"2024-04-17T05:31:10.413588+0000","last_became_active":"2024-04-17T05:26:57.345320+0000","last_became_peered":"2024-04-17T05:26:57.345320+0000","last_unstale":"2024-04-17T05:31:10.413588+0000","last_undegraded":"2024-04-17T05:31:10.413588+0000","last_fullsized":"2024-04-17T05:31:10.413588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:14:02.473527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'5","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.384494+0000","last_change":"2024-04-17T05:27:39.898572+0000","last_active":"2024-04-17T05:33:47.384494+0000","last_peered":"2024-04-17T05:33:47.384494+0000","last_clean":"2024-04-17T05:33:47.384494+0000","last_became_active":"2024-04-17T05:27:39.897777+0000","last_became_peered":"2024-04-17T05:27:39.897777+0000","last_unstale":"2024-04-17T05:33:47.384494+0000","last_undegraded":"2024-04-17T05:33:47.384494+0000","last_fullsized":"2024-04-17T05:33:47.384494+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:31:02.906556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'3","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:41.905076+0000","last_change":"2024-04-17T05:26:52.209276+0000","last_active":"2024-04-17T05:33:41.905076+0000","last_peered":"2024-04-17T05:33:41.905076+0000","last_clean":"2024-04-17T05:33:41.905076+0000","last_became_active":"2024-04-17T05:26:52.208422+0000","last_became_peered":"2024-04-17T05:26:52.208422+0000","last_unstale":"2024-04-17T05:33:41.905076+0000","last_undegraded":"2024-04-17T05:33:41.905076+0000","last_fullsized":"2024-04-17T05:33:41.905076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:20.415373+0000","last_change":"2024-04-17T05:26:57.342209+0000","last_active":"2024-04-17T05:31:20.415373+0000","last_peered":"2024-04-17T05:31:20.415373+0000","last_clean":"2024-04-17T05:31:20.415373+0000","last_became_active":"2024-04-17T05:26:57.341658+0000","last_became_peered":"2024-04-17T05:26:57.341658+0000","last_unstale":"2024-04-17T05:31:20.415373+0000","last_undegraded":"2024-04-17T05:31:20.415373+0000","last_fullsized":"2024-04-17T05:31:20.415373+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:49.740852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.392825+0000","last_change":"2024-04-17T05:26:53.239720+0000","last_active":"2024-04-17T05:33:47.392825+0000","last_peered":"2024-04-17T05:33:47.392825+0000","last_clean":"2024-04-17T05:33:47.392825+0000","last_became_active":"2024-04-17T05:26:53.238669+0000","last_became_peered":"2024-04-17T05:26:53.238669+0000","last_unstale":"2024-04-17T05:33:47.392825+0000","last_undegraded":"2024-04-17T05:33:47.392825+0000","last_fullsized":"2024-04-17T05:33:47.392825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:58:59.967200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'5","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:58.851128+0000","last_change":"2024-04-17T05:33:58.851172+0000","last_active":"2024-04-17T05:33:58.851128+0000","last_peered":"2024-04-17T05:33:58.851128+0000","last_clean":"2024-04-17T05:33:58.851128+0000","last_became_active":"2024-04-17T05:26:52.202246+0000","last_became_peered":"2024-04-17T05:26:52.202246+0000","last_unstale":"2024-04-17T05:33:58.851128+0000","last_undegraded":"2024-04-17T05:33:58.851128+0000","last_fullsized":"2024-04-17T05:33:58.851128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-04-17T05:33:58.851034+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-04-17T05:33:58.851034+0000","last_clean_scrub_stamp":"2024-04-17T05:33:58.851034+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:49:05.031488+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:45.403815+0000","last_change":"2024-04-17T05:26:57.303069+0000","last_active":"2024-04-17T05:33:45.403815+0000","last_peered":"2024-04-17T05:33:45.403815+0000","last_clean":"2024-04-17T05:33:45.403815+0000","last_became_active":"2024-04-17T05:26:57.302457+0000","last_became_peered":"2024-04-17T05:26:57.302457+0000","last_unstale":"2024-04-17T05:33:45.403815+0000","last_undegraded":"2024-04-17T05:33:45.403815+0000","last_fullsized":"2024-04-17T05:33:45.403815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.391025+0000","last_change":"2024-04-17T05:26:53.255140+0000","last_active":"2024-04-17T05:33:47.391025+0000","last_peered":"2024-04-17T05:33:47.391025+0000","last_clean":"2024-04-17T05:33:47.391025+0000","last_became_active":"2024-04-17T05:26:53.254371+0000","last_became_peered":"2024-04-17T05:26:53.254371+0000","last_unstale":"2024-04-17T05:33:47.391025+0000","last_undegraded":"2024-04-17T05:33:47.391025+0000","last_fullsized":"2024-04-17T05:33:47.391025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:33:12.651636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'3","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:40.399924+0000","last_change":"2024-04-17T05:26:52.204598+0000","last_active":"2024-04-17T05:33:40.399924+0000","last_peered":"2024-04-17T05:33:40.399924+0000","last_clean":"2024-04-17T05:33:40.399924+0000","last_became_active":"2024-04-17T05:26:52.204139+0000","last_became_peered":"2024-04-17T05:26:52.204139+0000","last_unstale":"2024-04-17T05:33:40.399924+0000","last_undegraded":"2024-04-17T05:33:40.399924+0000","last_fullsized":"2024-04-17T05:33:40.399924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:20.376450+0000","last_change":"2024-04-17T05:26:57.345152+0000","last_active":"2024-04-17T05:31:20.376450+0000","last_peered":"2024-04-17T05:31:20.376450+0000","last_clean":"2024-04-17T05:31:20.376450+0000","last_became_active":"2024-04-17T05:26:57.342006+0000","last_became_peered":"2024-04-17T05:26:57.342006+0000","last_unstale":"2024-04-17T05:31:20.376450+0000","last_undegraded":"2024-04-17T05:31:20.376450+0000","last_fullsized":"2024-04-17T05:31:20.376450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:56:05.345989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.389227+0000","last_change":"2024-04-17T05:26:53.253746+0000","last_active":"2024-04-17T05:33:47.389227+0000","last_peered":"2024-04-17T05:33:47.389227+0000","last_clean":"2024-04-17T05:33:47.389227+0000","last_became_active":"2024-04-17T05:26:53.253395+0000","last_became_peered":"2024-04-17T05:26:53.253395+0000","last_unstale":"2024-04-17T05:33:47.389227+0000","last_undegraded":"2024-04-17T05:33:47.389227+0000","last_fullsized":"2024-04-17T05:33:47.389227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:46:38.091860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'5","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:40.401683+0000","last_change":"2024-04-17T05:26:52.199105+0000","last_active":"2024-04-17T05:33:40.401683+0000","last_peered":"2024-04-17T05:33:40.401683+0000","last_clean":"2024-04-17T05:33:40.401683+0000","last_became_active":"2024-04-17T05:26:52.198798+0000","last_became_peered":"2024-04-17T05:26:52.198798+0000","last_unstale":"2024-04-17T05:33:40.401683+0000","last_undegraded":"2024-04-17T05:33:40.401683+0000","last_fullsized":"2024-04-17T05:33:40.401683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:30.399795+0000","last_change":"2024-04-17T05:26:57.306130+0000","last_active":"2024-04-17T05:33:30.399795+0000","last_peered":"2024-04-17T05:33:30.399795+0000","last_clean":"2024-04-17T05:33:30.399795+0000","last_became_active":"2024-04-17T05:26:57.305415+0000","last_became_peered":"2024-04-17T05:26:57.305415+0000","last_unstale":"2024-04-17T05:33:30.399795+0000","last_undegraded":"2024-04-17T05:33:30.399795+0000","last_fullsized":"2024-04-17T05:33:30.399795+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"28'7","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.386398+0000","last_change":"2024-04-17T05:27:39.579857+0000","last_active":"2024-04-17T05:33:47.386398+0000","last_peered":"2024-04-17T05:33:47.386398+0000","last_clean":"2024-04-17T05:33:47.386398+0000","last_became_active":"2024-04-17T05:27:39.579096+0000","last_became_peered":"2024-04-17T05:27:39.579096+0000","last_unstale":"2024-04-17T05:33:47.386398+0000","last_undegraded":"2024-04-17T05:33:47.386398+0000","last_fullsized":"2024-04-17T05:33:47.386398+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"28'15","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:59.796967+0000","last_change":"2024-04-17T05:33:59.796996+0000","last_active":"2024-04-17T05:33:59.796967+0000","last_peered":"2024-04-17T05:33:59.796967+0000","last_clean":"2024-04-17T05:33:59.796967+0000","last_became_active":"2024-04-17T05:26:52.197250+0000","last_became_peered":"2024-04-17T05:26:52.197250+0000","last_unstale":"2024-04-17T05:33:59.796967+0000","last_undegraded":"2024-04-17T05:33:59.796967+0000","last_fullsized":"2024-04-17T05:33:59.796967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'15","last_scrub_stamp":"2024-04-17T05:33:59.796902+0000","last_deep_scrub":"28'15","last_deep_scrub_stamp":"2024-04-17T05:33:59.796902+0000","last_clean_scrub_stamp":"2024-04-17T05:33:59.796902+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:29:28.444689+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:50.387112+0000","last_change":"2024-04-17T05:26:57.296438+0000","last_active":"2024-04-17T05:31:50.387112+0000","last_peered":"2024-04-17T05:31:50.387112+0000","last_clean":"2024-04-17T05:31:50.387112+0000","last_became_active":"2024-04-17T05:26:57.296040+0000","last_became_peered":"2024-04-17T05:26:57.296040+0000","last_unstale":"2024-04-17T05:31:50.387112+0000","last_undegraded":"2024-04-17T05:31:50.387112+0000","last_fullsized":"2024-04-17T05:31:50.387112+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.382423+0000","last_change":"2024-04-17T05:26:53.231338+0000","last_active":"2024-04-17T05:33:47.382423+0000","last_peered":"2024-04-17T05:33:47.382423+0000","last_clean":"2024-04-17T05:33:47.382423+0000","last_became_active":"2024-04-17T05:26:53.230987+0000","last_became_peered":"2024-04-17T05:26:53.230987+0000","last_unstale":"2024-04-17T05:33:47.382423+0000","last_undegraded":"2024-04-17T05:33:47.382423+0000","last_fullsized":"2024-04-17T05:33:47.382423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:08:10.489719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:35.417966+0000","last_change":"2024-04-17T05:26:52.207087+0000","last_active":"2024-04-17T05:31:35.417966+0000","last_peered":"2024-04-17T05:31:35.417966+0000","last_clean":"2024-04-17T05:31:35.417966+0000","last_became_active":"2024-04-17T05:26:52.206401+0000","last_became_peered":"2024-04-17T05:26:52.206401+0000","last_unstale":"2024-04-17T05:31:35.417966+0000","last_undegraded":"2024-04-17T05:31:35.417966+0000","last_fullsized":"2024-04-17T05:31:35.417966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:56:53.915549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:50.386275+0000","last_change":"2024-04-17T05:26:57.346955+0000","last_active":"2024-04-17T05:31:50.386275+0000","last_peered":"2024-04-17T05:31:50.386275+0000","last_clean":"2024-04-17T05:31:50.386275+0000","last_became_active":"2024-04-17T05:26:57.346516+0000","last_became_peered":"2024-04-17T05:26:57.346516+0000","last_unstale":"2024-04-17T05:31:50.386275+0000","last_undegraded":"2024-04-17T05:31:50.386275+0000","last_fullsized":"2024-04-17T05:31:50.386275+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"28'20","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.392426+0000","last_change":"2024-04-17T05:26:53.254195+0000","last_active":"2024-04-17T05:33:47.392426+0000","last_peered":"2024-04-17T05:33:47.392426+0000","last_clean":"2024-04-17T05:33:47.392426+0000","last_became_active":"2024-04-17T05:26:53.253813+0000","last_became_peered":"2024-04-17T05:26:53.253813+0000","last_unstale":"2024-04-17T05:33:47.392426+0000","last_undegraded":"2024-04-17T05:33:47.392426+0000","last_fullsized":"2024-04-17T05:33:47.392426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:18:31.208224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'8","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:35.378986+0000","last_change":"2024-04-17T05:26:52.211664+0000","last_active":"2024-04-17T05:31:35.378986+0000","last_peered":"2024-04-17T05:31:35.378986+0000","last_clean":"2024-04-17T05:31:35.378986+0000","last_became_active":"2024-04-17T05:26:52.210106+0000","last_became_peered":"2024-04-17T05:26:52.210106+0000","last_unstale":"2024-04-17T05:31:35.378986+0000","last_undegraded":"2024-04-17T05:31:35.378986+0000","last_fullsized":"2024-04-17T05:31:35.378986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:11:26.292397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:59.554976+0000","last_change":"2024-04-17T05:26:57.344473+0000","last_active":"2024-04-17T05:33:59.554976+0000","last_peered":"2024-04-17T05:33:59.554976+0000","last_clean":"2024-04-17T05:33:59.554976+0000","last_became_active":"2024-04-17T05:26:57.341999+0000","last_became_peered":"2024-04-17T05:26:57.341999+0000","last_unstale":"2024-04-17T05:33:59.554976+0000","last_undegraded":"2024-04-17T05:33:59.554976+0000","last_fullsized":"2024-04-17T05:33:59.554976+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'6","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:55.405003+0000","last_change":"2024-04-17T05:26:53.235732+0000","last_active":"2024-04-17T05:33:55.405003+0000","last_peered":"2024-04-17T05:33:55.405003+0000","last_clean":"2024-04-17T05:33:55.405003+0000","last_became_active":"2024-04-17T05:26:53.233202+0000","last_became_peered":"2024-04-17T05:26:53.233202+0000","last_unstale":"2024-04-17T05:33:55.405003+0000","last_undegraded":"2024-04-17T05:33:55.405003+0000","last_fullsized":"2024-04-17T05:33:55.405003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'6","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:59.358795+0000","last_change":"2024-04-17T05:33:59.358828+0000","last_active":"2024-04-17T05:33:59.358795+0000","last_peered":"2024-04-17T05:33:59.358795+0000","last_clean":"2024-04-17T05:33:59.358795+0000","last_became_active":"2024-04-17T05:26:52.194504+0000","last_became_peered":"2024-04-17T05:26:52.194504+0000","last_unstale":"2024-04-17T05:33:59.358795+0000","last_undegraded":"2024-04-17T05:33:59.358795+0000","last_fullsized":"2024-04-17T05:33:59.358795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-04-17T05:33:59.358703+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-04-17T05:33:59.358703+0000","last_clean_scrub_stamp":"2024-04-17T05:33:59.358703+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:10:01.077509+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:29:25.357676+0000","last_change":"2024-04-17T05:26:57.344052+0000","last_active":"2024-04-17T05:29:25.357676+0000","last_peered":"2024-04-17T05:29:25.357676+0000","last_clean":"2024-04-17T05:29:25.357676+0000","last_became_active":"2024-04-17T05:26:57.343479+0000","last_became_peered":"2024-04-17T05:26:57.343479+0000","last_unstale":"2024-04-17T05:29:25.357676+0000","last_undegraded":"2024-04-17T05:29:25.357676+0000","last_fullsized":"2024-04-17T05:29:25.357676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:23:44.724644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.384414+0000","last_change":"2024-04-17T05:26:53.250744+0000","last_active":"2024-04-17T05:33:47.384414+0000","last_peered":"2024-04-17T05:33:47.384414+0000","last_clean":"2024-04-17T05:33:47.384414+0000","last_became_active":"2024-04-17T05:26:53.249125+0000","last_became_peered":"2024-04-17T05:26:53.249125+0000","last_unstale":"2024-04-17T05:33:47.384414+0000","last_undegraded":"2024-04-17T05:33:47.384414+0000","last_fullsized":"2024-04-17T05:33:47.384414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:29.313074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'95","reported_seq":124,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.401304+0000","last_change":"2024-04-17T05:26:52.208074+0000","last_active":"2024-04-17T05:33:47.401304+0000","last_peered":"2024-04-17T05:33:47.401304+0000","last_clean":"2024-04-17T05:33:47.401304+0000","last_became_active":"2024-04-17T05:26:52.207696+0000","last_became_peered":"2024-04-17T05:26:52.207696+0000","last_unstale":"2024-04-17T05:33:47.401304+0000","last_undegraded":"2024-04-17T05:33:47.401304+0000","last_fullsized":"2024-04-17T05:33:47.401304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:10:33.072665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":934282,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:58.215798+0000","last_change":"2024-04-17T05:26:57.303649+0000","last_active":"2024-04-17T05:33:58.215798+0000","last_peered":"2024-04-17T05:33:58.215798+0000","last_clean":"2024-04-17T05:33:58.215798+0000","last_became_active":"2024-04-17T05:26:57.303124+0000","last_became_peered":"2024-04-17T05:26:57.303124+0000","last_unstale":"2024-04-17T05:33:58.215798+0000","last_undegraded":"2024-04-17T05:33:58.215798+0000","last_fullsized":"2024-04-17T05:33:58.215798+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'12","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:55.404269+0000","last_change":"2024-04-17T05:26:53.232911+0000","last_active":"2024-04-17T05:33:55.404269+0000","last_peered":"2024-04-17T05:33:55.404269+0000","last_clean":"2024-04-17T05:33:55.404269+0000","last_became_active":"2024-04-17T05:26:53.232624+0000","last_became_peered":"2024-04-17T05:26:53.232624+0000","last_unstale":"2024-04-17T05:33:55.404269+0000","last_undegraded":"2024-04-17T05:33:55.404269+0000","last_fullsized":"2024-04-17T05:33:55.404269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'26","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:42.912458+0000","last_change":"2024-04-17T05:26:52.207484+0000","last_active":"2024-04-17T05:33:42.912458+0000","last_peered":"2024-04-17T05:33:42.912458+0000","last_clean":"2024-04-17T05:33:42.912458+0000","last_became_active":"2024-04-17T05:26:52.207181+0000","last_became_peered":"2024-04-17T05:26:52.207181+0000","last_unstale":"2024-04-17T05:33:42.912458+0000","last_undegraded":"2024-04-17T05:33:42.912458+0000","last_fullsized":"2024-04-17T05:33:42.912458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:00.260998+0000","last_change":"2024-04-17T05:27:39.629173+0000","last_active":"2024-04-17T05:34:00.260998+0000","last_peered":"2024-04-17T05:34:00.260998+0000","last_clean":"2024-04-17T05:34:00.260998+0000","last_became_active":"2024-04-17T05:27:39.627825+0000","last_became_peered":"2024-04-17T05:27:39.627825+0000","last_unstale":"2024-04-17T05:34:00.260998+0000","last_undegraded":"2024-04-17T05:34:00.260998+0000","last_fullsized":"2024-04-17T05:34:00.260998+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"28'9","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.397383+0000","last_change":"2024-04-17T05:26:53.241678+0000","last_active":"2024-04-17T05:33:47.397383+0000","last_peered":"2024-04-17T05:33:47.397383+0000","last_clean":"2024-04-17T05:33:47.397383+0000","last_became_active":"2024-04-17T05:26:53.241388+0000","last_became_peered":"2024-04-17T05:26:53.241388+0000","last_unstale":"2024-04-17T05:33:47.397383+0000","last_undegraded":"2024-04-17T05:33:47.397383+0000","last_fullsized":"2024-04-17T05:33:47.397383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'7","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:17.584715+0000","last_change":"2024-04-17T05:26:52.213786+0000","last_active":"2024-04-17T05:30:17.584715+0000","last_peered":"2024-04-17T05:30:17.584715+0000","last_clean":"2024-04-17T05:30:17.584715+0000","last_became_active":"2024-04-17T05:26:52.212440+0000","last_became_peered":"2024-04-17T05:26:52.212440+0000","last_unstale":"2024-04-17T05:30:17.584715+0000","last_undegraded":"2024-04-17T05:30:17.584715+0000","last_fullsized":"2024-04-17T05:30:17.584715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:06:05.676066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:59.555057+0000","last_change":"2024-04-17T05:26:57.300596+0000","last_active":"2024-04-17T05:33:59.555057+0000","last_peered":"2024-04-17T05:33:59.555057+0000","last_clean":"2024-04-17T05:33:59.555057+0000","last_became_active":"2024-04-17T05:26:57.300156+0000","last_became_peered":"2024-04-17T05:26:57.300156+0000","last_unstale":"2024-04-17T05:33:59.555057+0000","last_undegraded":"2024-04-17T05:33:59.555057+0000","last_fullsized":"2024-04-17T05:33:59.555057+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.395877+0000","last_change":"2024-04-17T05:26:53.238893+0000","last_active":"2024-04-17T05:33:47.395877+0000","last_peered":"2024-04-17T05:33:47.395877+0000","last_clean":"2024-04-17T05:33:47.395877+0000","last_became_active":"2024-04-17T05:26:53.238566+0000","last_became_peered":"2024-04-17T05:26:53.238566+0000","last_unstale":"2024-04-17T05:33:47.395877+0000","last_undegraded":"2024-04-17T05:33:47.395877+0000","last_fullsized":"2024-04-17T05:33:47.395877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:52:32.392870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"28'5","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:27.602689+0000","last_change":"2024-04-17T05:26:52.215304+0000","last_active":"2024-04-17T05:30:27.602689+0000","last_peered":"2024-04-17T05:30:27.602689+0000","last_clean":"2024-04-17T05:30:27.602689+0000","last_became_active":"2024-04-17T05:26:52.214958+0000","last_became_peered":"2024-04-17T05:26:52.214958+0000","last_unstale":"2024-04-17T05:30:27.602689+0000","last_undegraded":"2024-04-17T05:30:27.602689+0000","last_fullsized":"2024-04-17T05:30:27.602689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:13:25.702517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:59.555015+0000","last_change":"2024-04-17T05:26:57.342083+0000","last_active":"2024-04-17T05:33:59.555015+0000","last_peered":"2024-04-17T05:33:59.555015+0000","last_clean":"2024-04-17T05:33:59.555015+0000","last_became_active":"2024-04-17T05:26:57.341304+0000","last_became_peered":"2024-04-17T05:26:57.341304+0000","last_unstale":"2024-04-17T05:33:59.555015+0000","last_undegraded":"2024-04-17T05:33:59.555015+0000","last_fullsized":"2024-04-17T05:33:59.555015+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:00.397813+0000","last_change":"2024-04-17T05:26:57.342446+0000","last_active":"2024-04-17T05:33:00.397813+0000","last_peered":"2024-04-17T05:33:00.397813+0000","last_clean":"2024-04-17T05:33:00.397813+0000","last_became_active":"2024-04-17T05:26:57.342076+0000","last_became_peered":"2024-04-17T05:26:57.342076+0000","last_unstale":"2024-04-17T05:33:00.397813+0000","last_undegraded":"2024-04-17T05:33:00.397813+0000","last_fullsized":"2024-04-17T05:33:00.397813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'11","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.374791+0000","last_change":"2024-04-17T05:26:53.228706+0000","last_active":"2024-04-17T05:33:47.374791+0000","last_peered":"2024-04-17T05:33:47.374791+0000","last_clean":"2024-04-17T05:33:47.374791+0000","last_became_active":"2024-04-17T05:26:53.228381+0000","last_became_peered":"2024-04-17T05:26:53.228381+0000","last_unstale":"2024-04-17T05:33:47.374791+0000","last_undegraded":"2024-04-17T05:33:47.374791+0000","last_fullsized":"2024-04-17T05:33:47.374791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'5","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:27.602400+0000","last_change":"2024-04-17T05:26:52.195697+0000","last_active":"2024-04-17T05:30:27.602400+0000","last_peered":"2024-04-17T05:30:27.602400+0000","last_clean":"2024-04-17T05:30:27.602400+0000","last_became_active":"2024-04-17T05:26:52.193995+0000","last_became_peered":"2024-04-17T05:26:52.193995+0000","last_unstale":"2024-04-17T05:30:27.602400+0000","last_undegraded":"2024-04-17T05:30:27.602400+0000","last_fullsized":"2024-04-17T05:30:27.602400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:05:28.743450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:10.413660+0000","last_change":"2024-04-17T05:26:57.306563+0000","last_active":"2024-04-17T05:31:10.413660+0000","last_peered":"2024-04-17T05:31:10.413660+0000","last_clean":"2024-04-17T05:31:10.413660+0000","last_became_active":"2024-04-17T05:26:57.305777+0000","last_became_peered":"2024-04-17T05:26:57.305777+0000","last_unstale":"2024-04-17T05:31:10.413660+0000","last_undegraded":"2024-04-17T05:31:10.413660+0000","last_fullsized":"2024-04-17T05:31:10.413660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:33.395856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.376585+0000","last_change":"2024-04-17T05:26:53.229100+0000","last_active":"2024-04-17T05:33:47.376585+0000","last_peered":"2024-04-17T05:33:47.376585+0000","last_clean":"2024-04-17T05:33:47.376585+0000","last_became_active":"2024-04-17T05:26:53.225554+0000","last_became_peered":"2024-04-17T05:26:53.225554+0000","last_unstale":"2024-04-17T05:33:47.376585+0000","last_undegraded":"2024-04-17T05:33:47.376585+0000","last_fullsized":"2024-04-17T05:33:47.376585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'2","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:45.385671+0000","last_change":"2024-04-17T05:26:52.205214+0000","last_active":"2024-04-17T05:31:45.385671+0000","last_peered":"2024-04-17T05:31:45.385671+0000","last_clean":"2024-04-17T05:31:45.385671+0000","last_became_active":"2024-04-17T05:26:52.204982+0000","last_became_peered":"2024-04-17T05:26:52.204982+0000","last_unstale":"2024-04-17T05:31:45.385671+0000","last_undegraded":"2024-04-17T05:31:45.385671+0000","last_fullsized":"2024-04-17T05:31:45.385671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"28'4","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:30:02.559734+0000","last_change":"2024-04-17T05:26:52.211538+0000","last_active":"2024-04-17T05:30:02.559734+0000","last_peered":"2024-04-17T05:30:02.559734+0000","last_clean":"2024-04-17T05:30:02.559734+0000","last_became_active":"2024-04-17T05:26:52.211242+0000","last_became_peered":"2024-04-17T05:26:52.211242+0000","last_unstale":"2024-04-17T05:30:02.559734+0000","last_undegraded":"2024-04-17T05:30:02.559734+0000","last_fullsized":"2024-04-17T05:30:02.559734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:30:14.163882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.391362+0000","last_change":"2024-04-17T05:26:53.239968+0000","last_active":"2024-04-17T05:33:47.391362+0000","last_peered":"2024-04-17T05:33:47.391362+0000","last_clean":"2024-04-17T05:33:47.391362+0000","last_became_active":"2024-04-17T05:26:53.239688+0000","last_became_peered":"2024-04-17T05:26:53.239688+0000","last_unstale":"2024-04-17T05:33:47.391362+0000","last_undegraded":"2024-04-17T05:33:47.391362+0000","last_fullsized":"2024-04-17T05:33:47.391362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:32:00.385404+0000","last_change":"2024-04-17T05:26:57.297209+0000","last_active":"2024-04-17T05:32:00.385404+0000","last_peered":"2024-04-17T05:32:00.385404+0000","last_clean":"2024-04-17T05:32:00.385404+0000","last_became_active":"2024-04-17T05:26:57.295730+0000","last_became_peered":"2024-04-17T05:26:57.295730+0000","last_unstale":"2024-04-17T05:32:00.385404+0000","last_undegraded":"2024-04-17T05:32:00.385404+0000","last_fullsized":"2024-04-17T05:32:00.385404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:31:55.386717+0000","last_change":"2024-04-17T05:26:52.214520+0000","last_active":"2024-04-17T05:31:55.386717+0000","last_peered":"2024-04-17T05:31:55.386717+0000","last_clean":"2024-04-17T05:31:55.386717+0000","last_became_active":"2024-04-17T05:26:52.214153+0000","last_became_peered":"2024-04-17T05:26:52.214153+0000","last_unstale":"2024-04-17T05:31:55.386717+0000","last_undegraded":"2024-04-17T05:31:55.386717+0000","last_fullsized":"2024-04-17T05:31:55.386717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:51.142721+0000","last_clean_scrub_stamp":"2024-04-17T05:26:51.142721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.385111+0000","last_change":"2024-04-17T05:26:53.218086+0000","last_active":"2024-04-17T05:33:47.385111+0000","last_peered":"2024-04-17T05:33:47.385111+0000","last_clean":"2024-04-17T05:33:47.385111+0000","last_became_active":"2024-04-17T05:26:53.213566+0000","last_became_peered":"2024-04-17T05:26:53.213566+0000","last_unstale":"2024-04-17T05:33:47.385111+0000","last_undegraded":"2024-04-17T05:33:47.385111+0000","last_fullsized":"2024-04-17T05:33:47.385111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:32:00.387105+0000","last_change":"2024-04-17T05:26:57.306742+0000","last_active":"2024-04-17T05:32:00.387105+0000","last_peered":"2024-04-17T05:32:00.387105+0000","last_clean":"2024-04-17T05:32:00.387105+0000","last_became_active":"2024-04-17T05:26:57.305115+0000","last_became_peered":"2024-04-17T05:26:57.305115+0000","last_unstale":"2024-04-17T05:32:00.387105+0000","last_undegraded":"2024-04-17T05:32:00.387105+0000","last_fullsized":"2024-04-17T05:32:00.387105+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:56.244202+0000","last_clean_scrub_stamp":"2024-04-17T05:26:56.244202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.382150+0000","last_change":"2024-04-17T05:26:53.232255+0000","last_active":"2024-04-17T05:33:47.382150+0000","last_peered":"2024-04-17T05:33:47.382150+0000","last_clean":"2024-04-17T05:33:47.382150+0000","last_became_active":"2024-04-17T05:26:53.231624+0000","last_became_peered":"2024-04-17T05:26:53.231624+0000","last_unstale":"2024-04-17T05:33:47.382150+0000","last_undegraded":"2024-04-17T05:33:47.382150+0000","last_fullsized":"2024-04-17T05:33:47.382150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:27:51.120892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"28'8","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.393091+0000","last_change":"2024-04-17T05:26:53.222619+0000","last_active":"2024-04-17T05:33:47.393091+0000","last_peered":"2024-04-17T05:33:47.393091+0000","last_clean":"2024-04-17T05:33:47.393091+0000","last_became_active":"2024-04-17T05:26:53.222128+0000","last_became_peered":"2024-04-17T05:26:53.222128+0000","last_unstale":"2024-04-17T05:33:47.393091+0000","last_undegraded":"2024-04-17T05:33:47.393091+0000","last_fullsized":"2024-04-17T05:33:47.393091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.396844+0000","last_change":"2024-04-17T05:26:53.234820+0000","last_active":"2024-04-17T05:33:47.396844+0000","last_peered":"2024-04-17T05:33:47.396844+0000","last_clean":"2024-04-17T05:33:47.396844+0000","last_became_active":"2024-04-17T05:26:53.233708+0000","last_became_peered":"2024-04-17T05:26:53.233708+0000","last_unstale":"2024-04-17T05:33:47.396844+0000","last_undegraded":"2024-04-17T05:33:47.396844+0000","last_fullsized":"2024-04-17T05:33:47.396844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:08:16.322998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"28'5","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.375181+0000","last_change":"2024-04-17T05:26:53.234961+0000","last_active":"2024-04-17T05:33:47.375181+0000","last_peered":"2024-04-17T05:33:47.375181+0000","last_clean":"2024-04-17T05:33:47.375181+0000","last_became_active":"2024-04-17T05:26:53.234387+0000","last_became_peered":"2024-04-17T05:26:53.234387+0000","last_unstale":"2024-04-17T05:33:47.375181+0000","last_undegraded":"2024-04-17T05:33:47.375181+0000","last_fullsized":"2024-04-17T05:33:47.375181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'6","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.392444+0000","last_change":"2024-04-17T05:26:53.242359+0000","last_active":"2024-04-17T05:33:47.392444+0000","last_peered":"2024-04-17T05:33:47.392444+0000","last_clean":"2024-04-17T05:33:47.392444+0000","last_became_active":"2024-04-17T05:26:53.236476+0000","last_became_peered":"2024-04-17T05:26:53.236476+0000","last_unstale":"2024-04-17T05:33:47.392444+0000","last_undegraded":"2024-04-17T05:33:47.392444+0000","last_fullsized":"2024-04-17T05:33:47.392444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"28'6","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.374416+0000","last_change":"2024-04-17T05:26:53.231647+0000","last_active":"2024-04-17T05:33:47.374416+0000","last_peered":"2024-04-17T05:33:47.374416+0000","last_clean":"2024-04-17T05:33:47.374416+0000","last_became_active":"2024-04-17T05:26:53.231335+0000","last_became_peered":"2024-04-17T05:26:53.231335+0000","last_unstale":"2024-04-17T05:33:47.374416+0000","last_undegraded":"2024-04-17T05:33:47.374416+0000","last_fullsized":"2024-04-17T05:33:47.374416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"28'13","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.393123+0000","last_change":"2024-04-17T05:26:53.234892+0000","last_active":"2024-04-17T05:33:47.393123+0000","last_peered":"2024-04-17T05:33:47.393123+0000","last_clean":"2024-04-17T05:33:47.393123+0000","last_became_active":"2024-04-17T05:26:53.234582+0000","last_became_peered":"2024-04-17T05:26:53.234582+0000","last_unstale":"2024-04-17T05:33:47.393123+0000","last_undegraded":"2024-04-17T05:33:47.393123+0000","last_fullsized":"2024-04-17T05:33:47.393123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:48:56.352270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'7","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.391324+0000","last_change":"2024-04-17T05:26:53.245242+0000","last_active":"2024-04-17T05:33:47.391324+0000","last_peered":"2024-04-17T05:33:47.391324+0000","last_clean":"2024-04-17T05:33:47.391324+0000","last_became_active":"2024-04-17T05:26:53.244910+0000","last_became_peered":"2024-04-17T05:26:53.244910+0000","last_unstale":"2024-04-17T05:33:47.391324+0000","last_undegraded":"2024-04-17T05:33:47.391324+0000","last_fullsized":"2024-04-17T05:33:47.391324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'9","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.376935+0000","last_change":"2024-04-17T05:27:39.627151+0000","last_active":"2024-04-17T05:33:47.376935+0000","last_peered":"2024-04-17T05:33:47.376935+0000","last_clean":"2024-04-17T05:33:47.376935+0000","last_became_active":"2024-04-17T05:27:39.626252+0000","last_became_peered":"2024-04-17T05:27:39.626252+0000","last_unstale":"2024-04-17T05:33:47.376935+0000","last_undegraded":"2024-04-17T05:33:47.376935+0000","last_fullsized":"2024-04-17T05:33:47.376935+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"28'9","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.391713+0000","last_change":"2024-04-17T05:26:53.236750+0000","last_active":"2024-04-17T05:33:47.391713+0000","last_peered":"2024-04-17T05:33:47.391713+0000","last_clean":"2024-04-17T05:33:47.391713+0000","last_became_active":"2024-04-17T05:26:53.236386+0000","last_became_peered":"2024-04-17T05:26:53.236386+0000","last_unstale":"2024-04-17T05:33:47.391713+0000","last_undegraded":"2024-04-17T05:33:47.391713+0000","last_fullsized":"2024-04-17T05:33:47.391713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"28'13","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.397229+0000","last_change":"2024-04-17T05:26:53.242520+0000","last_active":"2024-04-17T05:33:47.397229+0000","last_peered":"2024-04-17T05:33:47.397229+0000","last_clean":"2024-04-17T05:33:47.397229+0000","last_became_active":"2024-04-17T05:26:53.242213+0000","last_became_peered":"2024-04-17T05:26:53.242213+0000","last_unstale":"2024-04-17T05:33:47.397229+0000","last_undegraded":"2024-04-17T05:33:47.397229+0000","last_fullsized":"2024-04-17T05:33:47.397229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:32.131344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"28'11","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.391119+0000","last_change":"2024-04-17T05:26:53.230464+0000","last_active":"2024-04-17T05:33:47.391119+0000","last_peered":"2024-04-17T05:33:47.391119+0000","last_clean":"2024-04-17T05:33:47.391119+0000","last_became_active":"2024-04-17T05:26:53.230146+0000","last_became_peered":"2024-04-17T05:26:53.230146+0000","last_unstale":"2024-04-17T05:33:47.391119+0000","last_undegraded":"2024-04-17T05:33:47.391119+0000","last_fullsized":"2024-04-17T05:33:47.391119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"28'8","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.388426+0000","last_change":"2024-04-17T05:26:53.252592+0000","last_active":"2024-04-17T05:33:47.388426+0000","last_peered":"2024-04-17T05:33:47.388426+0000","last_clean":"2024-04-17T05:33:47.388426+0000","last_became_active":"2024-04-17T05:26:53.252280+0000","last_became_peered":"2024-04-17T05:26:53.252280+0000","last_unstale":"2024-04-17T05:33:47.388426+0000","last_undegraded":"2024-04-17T05:33:47.388426+0000","last_fullsized":"2024-04-17T05:33:47.388426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:47:18.182576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"28'7","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.387703+0000","last_change":"2024-04-17T05:26:53.242405+0000","last_active":"2024-04-17T05:33:47.387703+0000","last_peered":"2024-04-17T05:33:47.387703+0000","last_clean":"2024-04-17T05:33:47.387703+0000","last_became_active":"2024-04-17T05:26:53.242046+0000","last_became_peered":"2024-04-17T05:26:53.242046+0000","last_unstale":"2024-04-17T05:33:47.387703+0000","last_undegraded":"2024-04-17T05:33:47.387703+0000","last_fullsized":"2024-04-17T05:33:47.387703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:25:09.244149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"28'12","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:55.402084+0000","last_change":"2024-04-17T05:26:53.228029+0000","last_active":"2024-04-17T05:33:55.402084+0000","last_peered":"2024-04-17T05:33:55.402084+0000","last_clean":"2024-04-17T05:33:55.402084+0000","last_became_active":"2024-04-17T05:26:53.227572+0000","last_became_peered":"2024-04-17T05:26:53.227572+0000","last_unstale":"2024-04-17T05:33:55.402084+0000","last_undegraded":"2024-04-17T05:33:55.402084+0000","last_fullsized":"2024-04-17T05:33:55.402084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.399113+0000","last_change":"2024-04-17T05:26:53.226283+0000","last_active":"2024-04-17T05:33:47.399113+0000","last_peered":"2024-04-17T05:33:47.399113+0000","last_clean":"2024-04-17T05:33:47.399113+0000","last_became_active":"2024-04-17T05:26:53.225983+0000","last_became_peered":"2024-04-17T05:26:53.225983+0000","last_unstale":"2024-04-17T05:33:47.399113+0000","last_undegraded":"2024-04-17T05:33:47.399113+0000","last_fullsized":"2024-04-17T05:33:47.399113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:40:51.044161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"28'11","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.399076+0000","last_change":"2024-04-17T05:26:53.230256+0000","last_active":"2024-04-17T05:33:47.399076+0000","last_peered":"2024-04-17T05:33:47.399076+0000","last_clean":"2024-04-17T05:33:47.399076+0000","last_became_active":"2024-04-17T05:26:53.229888+0000","last_became_peered":"2024-04-17T05:26:53.229888+0000","last_unstale":"2024-04-17T05:33:47.399076+0000","last_undegraded":"2024-04-17T05:33:47.399076+0000","last_fullsized":"2024-04-17T05:33:47.399076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:45:55.350158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"28'6","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:55.409286+0000","last_change":"2024-04-17T05:26:53.211199+0000","last_active":"2024-04-17T05:33:55.409286+0000","last_peered":"2024-04-17T05:33:55.409286+0000","last_clean":"2024-04-17T05:33:55.409286+0000","last_became_active":"2024-04-17T05:26:53.208394+0000","last_became_peered":"2024-04-17T05:26:53.208394+0000","last_unstale":"2024-04-17T05:33:55.409286+0000","last_undegraded":"2024-04-17T05:33:55.409286+0000","last_fullsized":"2024-04-17T05:33:55.409286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"28'5","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:55.404983+0000","last_change":"2024-04-17T05:26:53.224930+0000","last_active":"2024-04-17T05:33:55.404983+0000","last_peered":"2024-04-17T05:33:55.404983+0000","last_clean":"2024-04-17T05:33:55.404983+0000","last_became_active":"2024-04-17T05:26:53.224314+0000","last_became_peered":"2024-04-17T05:26:53.224314+0000","last_unstale":"2024-04-17T05:33:55.404983+0000","last_undegraded":"2024-04-17T05:33:55.404983+0000","last_fullsized":"2024-04-17T05:33:55.404983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"28'10","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.379711+0000","last_change":"2024-04-17T05:26:53.234152+0000","last_active":"2024-04-17T05:33:47.379711+0000","last_peered":"2024-04-17T05:33:47.379711+0000","last_clean":"2024-04-17T05:33:47.379711+0000","last_became_active":"2024-04-17T05:26:53.233885+0000","last_became_peered":"2024-04-17T05:26:53.233885+0000","last_unstale":"2024-04-17T05:33:47.379711+0000","last_undegraded":"2024-04-17T05:33:47.379711+0000","last_fullsized":"2024-04-17T05:33:47.379711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.388334+0000","last_change":"2024-04-17T05:26:53.233213+0000","last_active":"2024-04-17T05:33:47.388334+0000","last_peered":"2024-04-17T05:33:47.388334+0000","last_clean":"2024-04-17T05:33:47.388334+0000","last_became_active":"2024-04-17T05:26:53.232809+0000","last_became_peered":"2024-04-17T05:26:53.232809+0000","last_unstale":"2024-04-17T05:33:47.388334+0000","last_undegraded":"2024-04-17T05:33:47.388334+0000","last_fullsized":"2024-04-17T05:33:47.388334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.384785+0000","last_change":"2024-04-17T05:26:53.245453+0000","last_active":"2024-04-17T05:33:47.384785+0000","last_peered":"2024-04-17T05:33:47.384785+0000","last_clean":"2024-04-17T05:33:47.384785+0000","last_became_active":"2024-04-17T05:26:53.245051+0000","last_became_peered":"2024-04-17T05:26:53.245051+0000","last_unstale":"2024-04-17T05:33:47.384785+0000","last_undegraded":"2024-04-17T05:33:47.384785+0000","last_fullsized":"2024-04-17T05:33:47.384785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:44:40.424363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"28'16","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.397336+0000","last_change":"2024-04-17T05:26:53.241934+0000","last_active":"2024-04-17T05:33:47.397336+0000","last_peered":"2024-04-17T05:33:47.397336+0000","last_clean":"2024-04-17T05:33:47.397336+0000","last_became_active":"2024-04-17T05:26:53.241108+0000","last_became_peered":"2024-04-17T05:26:53.241108+0000","last_unstale":"2024-04-17T05:33:47.397336+0000","last_undegraded":"2024-04-17T05:33:47.397336+0000","last_fullsized":"2024-04-17T05:33:47.397336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:53:43.076144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"28'9","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.364950+0000","last_change":"2024-04-17T05:27:39.898458+0000","last_active":"2024-04-17T05:33:47.364950+0000","last_peered":"2024-04-17T05:33:47.364950+0000","last_clean":"2024-04-17T05:33:47.364950+0000","last_became_active":"2024-04-17T05:27:39.897830+0000","last_became_peered":"2024-04-17T05:27:39.897830+0000","last_unstale":"2024-04-17T05:33:47.364950+0000","last_undegraded":"2024-04-17T05:33:47.364950+0000","last_fullsized":"2024-04-17T05:33:47.364950+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:15:26.293817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.394930+0000","last_change":"2024-04-17T05:26:53.244109+0000","last_active":"2024-04-17T05:33:47.394930+0000","last_peered":"2024-04-17T05:33:47.394930+0000","last_clean":"2024-04-17T05:33:47.394930+0000","last_became_active":"2024-04-17T05:26:53.243625+0000","last_became_peered":"2024-04-17T05:26:53.243625+0000","last_unstale":"2024-04-17T05:33:47.394930+0000","last_undegraded":"2024-04-17T05:33:47.394930+0000","last_fullsized":"2024-04-17T05:33:47.394930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"28'5","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.383931+0000","last_change":"2024-04-17T05:26:53.246489+0000","last_active":"2024-04-17T05:33:47.383931+0000","last_peered":"2024-04-17T05:33:47.383931+0000","last_clean":"2024-04-17T05:33:47.383931+0000","last_became_active":"2024-04-17T05:26:53.246286+0000","last_became_peered":"2024-04-17T05:26:53.246286+0000","last_unstale":"2024-04-17T05:33:47.383931+0000","last_undegraded":"2024-04-17T05:33:47.383931+0000","last_fullsized":"2024-04-17T05:33:47.383931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:51:45.658070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'5","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.396608+0000","last_change":"2024-04-17T05:26:53.229115+0000","last_active":"2024-04-17T05:33:47.396608+0000","last_peered":"2024-04-17T05:33:47.396608+0000","last_clean":"2024-04-17T05:33:47.396608+0000","last_became_active":"2024-04-17T05:26:53.228706+0000","last_became_peered":"2024-04-17T05:26:53.228706+0000","last_unstale":"2024-04-17T05:33:47.396608+0000","last_undegraded":"2024-04-17T05:33:47.396608+0000","last_fullsized":"2024-04-17T05:33:47.396608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:19:17.442103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.385791+0000","last_change":"2024-04-17T05:26:53.244961+0000","last_active":"2024-04-17T05:33:47.385791+0000","last_peered":"2024-04-17T05:33:47.385791+0000","last_clean":"2024-04-17T05:33:47.385791+0000","last_became_active":"2024-04-17T05:26:53.244595+0000","last_became_peered":"2024-04-17T05:26:53.244595+0000","last_unstale":"2024-04-17T05:33:47.385791+0000","last_undegraded":"2024-04-17T05:33:47.385791+0000","last_fullsized":"2024-04-17T05:33:47.385791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:13:34.455173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"28'6","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.392806+0000","last_change":"2024-04-17T05:26:53.241645+0000","last_active":"2024-04-17T05:33:47.392806+0000","last_peered":"2024-04-17T05:33:47.392806+0000","last_clean":"2024-04-17T05:33:47.392806+0000","last_became_active":"2024-04-17T05:26:53.241292+0000","last_became_peered":"2024-04-17T05:26:53.241292+0000","last_unstale":"2024-04-17T05:33:47.392806+0000","last_undegraded":"2024-04-17T05:33:47.392806+0000","last_fullsized":"2024-04-17T05:33:47.392806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:31:26.820940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"28'8","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.376250+0000","last_change":"2024-04-17T05:26:53.221256+0000","last_active":"2024-04-17T05:33:47.376250+0000","last_peered":"2024-04-17T05:33:47.376250+0000","last_clean":"2024-04-17T05:33:47.376250+0000","last_became_active":"2024-04-17T05:26:53.220445+0000","last_became_peered":"2024-04-17T05:26:53.220445+0000","last_unstale":"2024-04-17T05:33:47.376250+0000","last_undegraded":"2024-04-17T05:33:47.376250+0000","last_fullsized":"2024-04-17T05:33:47.376250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'4","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.376677+0000","last_change":"2024-04-17T05:26:53.214897+0000","last_active":"2024-04-17T05:33:47.376677+0000","last_peered":"2024-04-17T05:33:47.376677+0000","last_clean":"2024-04-17T05:33:47.376677+0000","last_became_active":"2024-04-17T05:26:53.214591+0000","last_became_peered":"2024-04-17T05:26:53.214591+0000","last_unstale":"2024-04-17T05:33:47.376677+0000","last_undegraded":"2024-04-17T05:33:47.376677+0000","last_fullsized":"2024-04-17T05:33:47.376677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"28'10","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:47.390013+0000","last_change":"2024-04-17T05:26:53.248726+0000","last_active":"2024-04-17T05:33:47.390013+0000","last_peered":"2024-04-17T05:33:47.390013+0000","last_clean":"2024-04-17T05:33:47.390013+0000","last_became_active":"2024-04-17T05:26:53.248143+0000","last_became_peered":"2024-04-17T05:26:53.248143+0000","last_unstale":"2024-04-17T05:33:47.390013+0000","last_undegraded":"2024-04-17T05:33:47.390013+0000","last_fullsized":"2024-04-17T05:33:47.390013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:26:52.161420+0000","last_clean_scrub_stamp":"2024-04-17T05:26:52.161420+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:02:51.306764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":945903,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":397,"num_write_kb":1123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1949696,"data_stored":1891806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":397,"ondisk_log_size":397,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542235,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":897024,"data_stored":713306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542234,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28228,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343612,"statfs":{"total":96636764160,"available":96607858688,"internally_reserved":0,"allocated":1241088,"data_stored":1056638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542235,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":122446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542234,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":122482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542236,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1253376,"data_stored":1067461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542234,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":133179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542235,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":122516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542234,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":905216,"data_stored":713362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":10823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":954368,"data_stored":945105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":942080,"data_stored":934282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T05:34:02.842 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.843 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-17T05:26:56.244202+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=56, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.843 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-17T05:26:51.142721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=51, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.843 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.843 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-17T05:26:56.244202+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=56, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.843 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-17T05:26:51.142721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=51, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.843 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.843 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-17T05:26:56.244202+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=56, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.843 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-17T05:26:51.142721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=51, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.843 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.844 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-17T05:26:56.244202+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=56, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.844 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.844 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-17T05:26:51.142721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=51, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.844 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-17T05:26:56.244202+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=56, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.844 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.844 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-17T05:26:51.142721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=51, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.844 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-17T05:26:56.244202+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=56, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.844 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.844 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-17T05:26:51.142721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=51, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.844 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-17T05:26:56.244202+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=56, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.845 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.845 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-17T05:26:51.142721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=51, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.845 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-17T05:26:56.244202+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=56, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.845 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.845 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-17T05:26:51.142721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=51, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.845 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-17T05:26:56.244202+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=56, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.845 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.845 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-17T05:26:51.142721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=51, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.845 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-17T05:26:56.244202+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=56, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.845 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.846 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-17T05:26:51.142721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=51, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.846 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-17T05:26:56.244202+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=56, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.846 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.846 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-17T05:26:56.244202+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=56, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.846 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.846 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-17T05:26:51.142721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=51, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.846 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-17T05:26:56.244202+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=56, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.846 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.846 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-17T05:26:51.142721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=51, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.847 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-17T05:26:56.244202+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=56, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.847 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-17T05:26:51.142721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=51, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.847 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-17T05:26:56.244202+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=56, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.847 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-17T05:26:51.142721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=51, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.847 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-17T05:26:46.995002+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=46, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.847 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-17T05:26:56.244202+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=56, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.847 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.847 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-17T05:26:51.142721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=51, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.847 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-17T05:26:56.244202+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=56, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.848 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.848 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-17T05:26:56.244202+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=56, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.848 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.848 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-17T05:26:51.142721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=51, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.848 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-17T05:26:56.244202+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=56, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.848 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.848 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-17T05:26:51.142721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=51, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.848 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-17T05:26:56.244202+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=56, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.848 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.849 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-17T05:26:56.244202+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=56, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.849 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.849 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-17T05:26:51.142721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=51, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.849 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-17T05:26:56.244202+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=56, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.849 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.849 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-17T05:26:51.142721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=51, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.849 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-17T05:26:56.244202+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=56, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.849 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.849 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-17T05:26:56.244202+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=56, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.849 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.850 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-17T05:26:51.142721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=51, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.850 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-17T05:26:56.244202+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=56, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.850 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.850 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-17T05:26:51.142721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=51, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.850 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-17T05:26:56.244202+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=56, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.850 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.850 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-17T05:26:51.142721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=51, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.850 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-17T05:26:56.244202+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=56, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.851 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.851 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-17T05:26:51.142721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=51, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.851 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-17T05:26:56.244202+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=56, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.851 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-17T05:26:56.244202+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=56, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.851 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.851 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-17T05:26:51.142721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=51, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.851 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-17T05:26:56.244202+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=56, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.851 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.851 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-17T05:26:51.142721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=51, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.851 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-17T05:26:51.142721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=51, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.852 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.852 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-17T05:26:56.244202+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=56, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.852 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-17T05:26:51.142721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=51, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.852 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.852 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-17T05:26:56.244202+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=56, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.852 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.852 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.852 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.852 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.852 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.853 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.853 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.853 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.853 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.853 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.853 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.853 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.853 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.853 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.854 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.854 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.854 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.854 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.854 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.854 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.854 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.854 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.854 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.855 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.855 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.855 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.855 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.855 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.855 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.855 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.855 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.855 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-17T05:26:52.161420+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=52, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=5, tm_min=33, tm_sec=55, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T05:34:02.855 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-17T05:34:19.450 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:34:19.458 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:34:22.856 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T05:34:23.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.077+0000 7f2632e00640 1 Processor -- start 2024-04-17T05:34:23.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.077+0000 7f2632e00640 1 -- start start 2024-04-17T05:34:23.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.078+0000 7f2632e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f262c0b3dc0 0x7f262c147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:23.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.079+0000 7f2632e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f262c148420 0x7f262c13e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:23.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.079+0000 7f2632e00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f262c0b5910 con 0x7f262c13e920 2024-04-17T05:34:23.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.079+0000 7f2632e00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f262c0b2c80 con 0x7f262c0b3dc0 2024-04-17T05:34:23.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.079+0000 7f2632e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f262c0708c0 con 0x7f262c148420 2024-04-17T05:34:23.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.079+0000 7f2631a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f262c0b3dc0 0x7f262c147ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:23.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.079+0000 7f2632400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f262c13e920 0x7f262c0b0650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40436/0 (socket says 172.21.15.123:40436) 2024-04-17T05:34:23.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.079+0000 7f2632400640 1 -- 172.21.15.123:0/2872685483 learned_addr learned my addr 172.21.15.123:0/2872685483 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:34:23.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.079+0000 7f2631000640 1 --2- 172.21.15.123:0/2872685483 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f262c148420 0x7f262c13e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:23.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.079+0000 7f2631a00640 1 -- 172.21.15.123:0/2872685483 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f262c148420 msgr2=0x7f262c13e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:23.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.079+0000 7f2631a00640 1 --2- 172.21.15.123:0/2872685483 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f262c148420 0x7f262c13e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:23.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.079+0000 7f2631a00640 1 -- 172.21.15.123:0/2872685483 >> v1:172.21.15.123:6789/0 conn(0x7f262c13e920 legacy=0x7f262c0b0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:23.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.080+0000 7f2631a00640 1 -- 172.21.15.123:0/2872685483 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f262c0b1870 con 0x7f262c0b3dc0 2024-04-17T05:34:23.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.079+0000 7f262be00640 1 -- 172.21.15.123:0/2872685483 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1681657986 0 0) 0x7f262c0b5910 con 0x7f262c13e920 2024-04-17T05:34:23.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.081+0000 7f2631a00640 1 --2- 172.21.15.123:0/2872685483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f262c0b3dc0 0x7f262c147ee0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f26200097a0 tx=0x7f262002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d714e1addd29ac server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:23.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.081+0000 7f262be00640 1 -- 172.21.15.123:0/2872685483 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26200315a0 con 0x7f262c0b3dc0 2024-04-17T05:34:23.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.081+0000 7f262be00640 1 -- 172.21.15.123:0/2872685483 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2620037070 con 0x7f262c0b3dc0 2024-04-17T05:34:23.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.081+0000 7f262be00640 1 -- 172.21.15.123:0/2872685483 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2620031960 con 0x7f262c0b3dc0 2024-04-17T05:34:23.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.082+0000 7f2632e00640 1 -- 172.21.15.123:0/2872685483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f262c0b3dc0 msgr2=0x7f262c147ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:23.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.082+0000 7f2632e00640 1 --2- 172.21.15.123:0/2872685483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f262c0b3dc0 0x7f262c147ee0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f26200097a0 tx=0x7f262002b840 comp rx=0 tx=0).stop 2024-04-17T05:34:23.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.082+0000 7f2632e00640 1 -- 172.21.15.123:0/2872685483 shutdown_connections 2024-04-17T05:34:23.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.082+0000 7f2632e00640 1 --2- 172.21.15.123:0/2872685483 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f262c148420 0x7f262c13e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:23.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.082+0000 7f2632e00640 1 --2- 172.21.15.123:0/2872685483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f262c0b3dc0 0x7f262c147ee0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:23.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.082+0000 7f2632e00640 1 -- 172.21.15.123:0/2872685483 >> 172.21.15.123:0/2872685483 conn(0x7f262c0b9150 msgr2=0x7f262c0b9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:23.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.082+0000 7f2632e00640 1 -- 172.21.15.123:0/2872685483 shutdown_connections 2024-04-17T05:34:23.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.082+0000 7f2632e00640 1 -- 172.21.15.123:0/2872685483 wait complete. 2024-04-17T05:34:23.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.083+0000 7f2632e00640 1 Processor -- start 2024-04-17T05:34:23.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.083+0000 7f2632e00640 1 -- start start 2024-04-17T05:34:23.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.084+0000 7f2632e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f262c0b3dc0 0x7f262c147390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:23.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.084+0000 7f2632e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f262c13e920 0x7f262c0b77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:23.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.084+0000 7f2632e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f262c148420 0x7f262c0b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:23.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.084+0000 7f2632e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f262c0b2ed0 con 0x7f262c0b3dc0 2024-04-17T05:34:23.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.084+0000 7f2632e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f262c148880 con 0x7f262c148420 2024-04-17T05:34:23.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.084+0000 7f2632e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f262c0b1b10 con 0x7f262c13e920 2024-04-17T05:34:23.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.084+0000 7f2631a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f262c0b3dc0 0x7f262c147390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:23.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.085+0000 7f2631a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f262c0b3dc0 0x7f262c147390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60794/0 (socket says 172.21.15.123:60794) 2024-04-17T05:34:23.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.085+0000 7f2631a00640 1 -- 172.21.15.123:0/791852684 learned_addr learned my addr 172.21.15.123:0/791852684 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:34:23.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.085+0000 7f2631000640 1 --2- 172.21.15.123:0/791852684 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f262c13e920 0x7f262c0b77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:23.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.085+0000 7f2632400640 1 --2- 172.21.15.123:0/791852684 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f262c148420 0x7f262c0b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:23.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.085+0000 7f2631a00640 1 -- 172.21.15.123:0/791852684 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f262c13e920 msgr2=0x7f262c0b77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:23.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.085+0000 7f2631a00640 1 --2- 172.21.15.123:0/791852684 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f262c13e920 0x7f262c0b77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:23.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.085+0000 7f2631a00640 1 -- 172.21.15.123:0/791852684 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f262c148420 msgr2=0x7f262c0b0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:23.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.085+0000 7f2631a00640 1 --2- 172.21.15.123:0/791852684 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f262c148420 0x7f262c0b0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:23.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.085+0000 7f2631a00640 1 -- 172.21.15.123:0/791852684 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f262c145bb0 con 0x7f262c0b3dc0 2024-04-17T05:34:23.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.085+0000 7f2631a00640 1 --2- 172.21.15.123:0/791852684 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f262c0b3dc0 0x7f262c147390 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f26200098c0 tx=0x7f26200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:23.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.086+0000 7f2629600640 1 -- 172.21.15.123:0/791852684 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2620032840 con 0x7f262c0b3dc0 2024-04-17T05:34:23.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.086+0000 7f2629600640 1 -- 172.21.15.123:0/791852684 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2620032a00 con 0x7f262c0b3dc0 2024-04-17T05:34:23.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.086+0000 7f2629600640 1 -- 172.21.15.123:0/791852684 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2620032df0 con 0x7f262c0b3dc0 2024-04-17T05:34:23.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.086+0000 7f2632e00640 1 -- 172.21.15.123:0/791852684 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f262c146920 con 0x7f262c0b3dc0 2024-04-17T05:34:23.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.086+0000 7f2632e00640 1 -- 172.21.15.123:0/791852684 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f262c1458d0 con 0x7f262c0b3dc0 2024-04-17T05:34:23.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.087+0000 7f2632e00640 1 -- 172.21.15.123:0/791852684 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f262c072bd0 con 0x7f262c0b3dc0 2024-04-17T05:34:23.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.088+0000 7f2629600640 1 -- 172.21.15.123:0/791852684 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f262004e430 con 0x7f262c0b3dc0 2024-04-17T05:34:23.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.089+0000 7f2629600640 1 --2- 172.21.15.123:0/791852684 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f260c06c920 0x7f260c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:23.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.089+0000 7f2629600640 1 -- 172.21.15.123:0/791852684 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f262002f030 con 0x7f262c0b3dc0 2024-04-17T05:34:23.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.089+0000 7f2631000640 1 --2- 172.21.15.123:0/791852684 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f260c06c920 0x7f260c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:23.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.091+0000 7f2631000640 1 --2- 172.21.15.123:0/791852684 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f260c06c920 0x7f260c06ede0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2618006fd0 tx=0x7f2618008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:23.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.094+0000 7f2629600640 1 -- 172.21.15.123:0/791852684 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f2620040070 con 0x7f262c0b3dc0 2024-04-17T05:34:23.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.290+0000 7f2632e00640 1 -- 172.21.15.123:0/791852684 --> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f262c0759b0 con 0x7f260c06c920 2024-04-17T05:34:23.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.314+0000 7f2629600640 1 -- 172.21.15.123:0/791852684 <== mgr.4103 v2:172.21.15.164:6832/4204006015 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333089 (secure 0 0 0) 0x7f262c0759b0 con 0x7f260c06c920 2024-04-17T05:34:23.317 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:34:23.319 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-04-17T05:34:23.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.320+0000 7f2632e00640 1 -- 172.21.15.123:0/791852684 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f260c06c920 msgr2=0x7f260c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:23.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.320+0000 7f2632e00640 1 --2- 172.21.15.123:0/791852684 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f260c06c920 0x7f260c06ede0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2618006fd0 tx=0x7f2618008040 comp rx=0 tx=0).stop 2024-04-17T05:34:23.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.320+0000 7f2632e00640 1 -- 172.21.15.123:0/791852684 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f262c0b3dc0 msgr2=0x7f262c147390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:23.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.320+0000 7f2632e00640 1 --2- 172.21.15.123:0/791852684 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f262c0b3dc0 0x7f262c147390 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f26200098c0 tx=0x7f26200046c0 comp rx=0 tx=0).stop 2024-04-17T05:34:23.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.320+0000 7f2632e00640 1 -- 172.21.15.123:0/791852684 shutdown_connections 2024-04-17T05:34:23.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.320+0000 7f2632e00640 1 --2- 172.21.15.123:0/791852684 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f262c148420 0x7f262c0b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:23.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.320+0000 7f2632e00640 1 --2- 172.21.15.123:0/791852684 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f260c06c920 0x7f260c06ede0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:23.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.320+0000 7f2632e00640 1 --2- 172.21.15.123:0/791852684 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f262c13e920 0x7f262c0b77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:23.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.320+0000 7f2632e00640 1 --2- 172.21.15.123:0/791852684 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f262c0b3dc0 0x7f262c147390 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:23.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.320+0000 7f2632e00640 1 -- 172.21.15.123:0/791852684 >> 172.21.15.123:0/791852684 conn(0x7f262c0b9150 msgr2=0x7f262c0b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:23.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.320+0000 7f2632e00640 1 -- 172.21.15.123:0/791852684 shutdown_connections 2024-04-17T05:34:23.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.320+0000 7f2632e00640 1 -- 172.21.15.123:0/791852684 wait complete. 2024-04-17T05:34:23.338 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":250,"stamp":"2024-04-17T05:34:22.492567+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1536271,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":152,"num_read_kb":136,"num_write":562,"num_write_kb":3543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1034,"ondisk_log_size":1034,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234008,"kb_used_data":5400,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754740712,"statfs":{"total":773094113280,"available":772854489088,"internally_reserved":0,"allocated":5529600,"data_stored":4051390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005355"},"pg_stats":[{"pgid":"2.1f","version":"28'6","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:00.321107+0000","last_change":"2024-04-17T05:34:00.321155+0000","last_active":"2024-04-17T05:34:00.321107+0000","last_peered":"2024-04-17T05:34:00.321107+0000","last_clean":"2024-04-17T05:34:00.321107+0000","last_became_active":"2024-04-17T05:26:52.205459+0000","last_became_peered":"2024-04-17T05:26:52.205459+0000","last_unstale":"2024-04-17T05:34:00.321107+0000","last_undegraded":"2024-04-17T05:34:00.321107+0000","last_fullsized":"2024-04-17T05:34:00.321107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-04-17T05:34:00.321026+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-04-17T05:34:00.321026+0000","last_clean_scrub_stamp":"2024-04-17T05:34:00.321026+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:10:24.222415+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'7","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:08.921675+0000","last_change":"2024-04-17T05:34:08.921734+0000","last_active":"2024-04-17T05:34:08.921675+0000","last_peered":"2024-04-17T05:34:08.921675+0000","last_clean":"2024-04-17T05:34:08.921675+0000","last_became_active":"2024-04-17T05:26:53.231139+0000","last_became_peered":"2024-04-17T05:26:53.231139+0000","last_unstale":"2024-04-17T05:34:08.921675+0000","last_undegraded":"2024-04-17T05:34:08.921675+0000","last_fullsized":"2024-04-17T05:34:08.921675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-04-17T05:34:08.921473+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-04-17T05:34:08.921473+0000","last_clean_scrub_stamp":"2024-04-17T05:34:08.921473+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:54:21.996863+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:18.870075+0000","last_change":"2024-04-17T05:34:18.870130+0000","last_active":"2024-04-17T05:34:18.870075+0000","last_peered":"2024-04-17T05:34:18.870075+0000","last_clean":"2024-04-17T05:34:18.870075+0000","last_became_active":"2024-04-17T05:26:57.347333+0000","last_became_peered":"2024-04-17T05:26:57.347333+0000","last_unstale":"2024-04-17T05:34:18.870075+0000","last_undegraded":"2024-04-17T05:34:18.870075+0000","last_fullsized":"2024-04-17T05:34:18.870075+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:34:18.869899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:34:18.869899+0000","last_clean_scrub_stamp":"2024-04-17T05:34:18.869899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:36:30.381959+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"28'3","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:04.002693+0000","last_change":"2024-04-17T05:34:04.002756+0000","last_active":"2024-04-17T05:34:04.002693+0000","last_peered":"2024-04-17T05:34:04.002693+0000","last_clean":"2024-04-17T05:34:04.002693+0000","last_became_active":"2024-04-17T05:26:52.203161+0000","last_became_peered":"2024-04-17T05:26:52.203161+0000","last_unstale":"2024-04-17T05:34:04.002693+0000","last_undegraded":"2024-04-17T05:34:04.002693+0000","last_fullsized":"2024-04-17T05:34:04.002693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-04-17T05:34:04.002486+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-04-17T05:34:04.002486+0000","last_clean_scrub_stamp":"2024-04-17T05:34:04.002486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:24:53.548562+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:09.361222+0000","last_change":"2024-04-17T05:34:09.361284+0000","last_active":"2024-04-17T05:34:09.361222+0000","last_peered":"2024-04-17T05:34:09.361222+0000","last_clean":"2024-04-17T05:34:09.361222+0000","last_became_active":"2024-04-17T05:26:53.241460+0000","last_became_peered":"2024-04-17T05:26:53.241460+0000","last_unstale":"2024-04-17T05:34:09.361222+0000","last_undegraded":"2024-04-17T05:34:09.361222+0000","last_fullsized":"2024-04-17T05:34:09.361222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-04-17T05:34:09.361041+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-04-17T05:34:09.361041+0000","last_clean_scrub_stamp":"2024-04-17T05:34:09.361041+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:07:20.616194+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:10.559225+0000","last_change":"2024-04-17T05:34:10.559225+0000","last_active":"2024-04-17T05:34:10.559225+0000","last_peered":"2024-04-17T05:34:10.559225+0000","last_clean":"2024-04-17T05:34:10.559225+0000","last_became_active":"2024-04-17T05:26:57.309057+0000","last_became_peered":"2024-04-17T05:26:57.309057+0000","last_unstale":"2024-04-17T05:34:10.559225+0000","last_undegraded":"2024-04-17T05:34:10.559225+0000","last_fullsized":"2024-04-17T05:34:10.559225+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:34:10.558917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:34:10.558917+0000","last_clean_scrub_stamp":"2024-04-17T05:34:10.558917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:05:22.621012+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'7","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:09.259360+0000","last_change":"2024-04-17T05:34:09.259427+0000","last_active":"2024-04-17T05:34:09.259360+0000","last_peered":"2024-04-17T05:34:09.259360+0000","last_clean":"2024-04-17T05:34:09.259360+0000","last_became_active":"2024-04-17T05:26:52.217101+0000","last_became_peered":"2024-04-17T05:26:52.217101+0000","last_unstale":"2024-04-17T05:34:09.259360+0000","last_undegraded":"2024-04-17T05:34:09.259360+0000","last_fullsized":"2024-04-17T05:34:09.259360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-04-17T05:34:09.259172+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-04-17T05:34:09.259172+0000","last_clean_scrub_stamp":"2024-04-17T05:34:09.259172+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:31:18.699571+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'8","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:09.021064+0000","last_change":"2024-04-17T05:34:09.021124+0000","last_active":"2024-04-17T05:34:09.021064+0000","last_peered":"2024-04-17T05:34:09.021064+0000","last_clean":"2024-04-17T05:34:09.021064+0000","last_became_active":"2024-04-17T05:26:53.216591+0000","last_became_peered":"2024-04-17T05:26:53.216591+0000","last_unstale":"2024-04-17T05:34:09.021064+0000","last_undegraded":"2024-04-17T05:34:09.021064+0000","last_fullsized":"2024-04-17T05:34:09.021064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-04-17T05:34:09.020898+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-04-17T05:34:09.020898+0000","last_clean_scrub_stamp":"2024-04-17T05:34:09.020898+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:09:08.588995+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:11.585671+0000","last_change":"2024-04-17T05:34:11.585727+0000","last_active":"2024-04-17T05:34:11.585671+0000","last_peered":"2024-04-17T05:34:11.585671+0000","last_clean":"2024-04-17T05:34:11.585671+0000","last_became_active":"2024-04-17T05:26:57.309381+0000","last_became_peered":"2024-04-17T05:26:57.309381+0000","last_unstale":"2024-04-17T05:34:11.585671+0000","last_undegraded":"2024-04-17T05:34:11.585671+0000","last_fullsized":"2024-04-17T05:34:11.585671+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:34:11.585505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:34:11.585505+0000","last_clean_scrub_stamp":"2024-04-17T05:34:11.585505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:00:59.790897+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'6","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:10.258608+0000","last_change":"2024-04-17T05:34:10.258671+0000","last_active":"2024-04-17T05:34:10.258608+0000","last_peered":"2024-04-17T05:34:10.258608+0000","last_clean":"2024-04-17T05:34:10.258608+0000","last_became_active":"2024-04-17T05:26:52.217898+0000","last_became_peered":"2024-04-17T05:26:52.217898+0000","last_unstale":"2024-04-17T05:34:10.258608+0000","last_undegraded":"2024-04-17T05:34:10.258608+0000","last_fullsized":"2024-04-17T05:34:10.258608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-04-17T05:34:10.258446+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-04-17T05:34:10.258446+0000","last_clean_scrub_stamp":"2024-04-17T05:34:10.258446+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:17:16.712088+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'14","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:01.051385+0000","last_change":"2024-04-17T05:34:01.051449+0000","last_active":"2024-04-17T05:34:01.051385+0000","last_peered":"2024-04-17T05:34:01.051385+0000","last_clean":"2024-04-17T05:34:01.051385+0000","last_became_active":"2024-04-17T05:26:53.232239+0000","last_became_peered":"2024-04-17T05:26:53.232239+0000","last_unstale":"2024-04-17T05:34:01.051385+0000","last_undegraded":"2024-04-17T05:34:01.051385+0000","last_fullsized":"2024-04-17T05:34:01.051385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'14","last_scrub_stamp":"2024-04-17T05:34:01.051223+0000","last_deep_scrub":"28'14","last_deep_scrub_stamp":"2024-04-17T05:34:01.051223+0000","last_clean_scrub_stamp":"2024-04-17T05:34:01.051223+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:10:02.770029+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:06.537765+0000","last_change":"2024-04-17T05:34:06.537819+0000","last_active":"2024-04-17T05:34:06.537765+0000","last_peered":"2024-04-17T05:34:06.537765+0000","last_clean":"2024-04-17T05:34:06.537765+0000","last_became_active":"2024-04-17T05:26:57.296757+0000","last_became_peered":"2024-04-17T05:26:57.296757+0000","last_unstale":"2024-04-17T05:34:06.537765+0000","last_undegraded":"2024-04-17T05:34:06.537765+0000","last_fullsized":"2024-04-17T05:34:06.537765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:34:06.537586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:34:06.537586+0000","last_clean_scrub_stamp":"2024-04-17T05:34:06.537586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:25:52.927196+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"28'7","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:11.399625+0000","last_change":"2024-04-17T05:34:11.399688+0000","last_active":"2024-04-17T05:34:11.399625+0000","last_peered":"2024-04-17T05:34:11.399625+0000","last_clean":"2024-04-17T05:34:11.399625+0000","last_became_active":"2024-04-17T05:26:53.244104+0000","last_became_peered":"2024-04-17T05:26:53.244104+0000","last_unstale":"2024-04-17T05:34:11.399625+0000","last_undegraded":"2024-04-17T05:34:11.399625+0000","last_fullsized":"2024-04-17T05:34:11.399625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-04-17T05:34:11.399433+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-04-17T05:34:11.399433+0000","last_clean_scrub_stamp":"2024-04-17T05:34:11.399433+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:13:26.002577+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'9","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:06.256364+0000","last_change":"2024-04-17T05:34:06.256431+0000","last_active":"2024-04-17T05:34:06.256364+0000","last_peered":"2024-04-17T05:34:06.256364+0000","last_clean":"2024-04-17T05:34:06.256364+0000","last_became_active":"2024-04-17T05:26:52.214158+0000","last_became_peered":"2024-04-17T05:26:52.214158+0000","last_unstale":"2024-04-17T05:34:06.256364+0000","last_undegraded":"2024-04-17T05:34:06.256364+0000","last_fullsized":"2024-04-17T05:34:06.256364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-04-17T05:34:06.256197+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-04-17T05:34:06.256197+0000","last_clean_scrub_stamp":"2024-04-17T05:34:06.256197+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:12:12.178616+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:08.568289+0000","last_change":"2024-04-17T05:34:08.568351+0000","last_active":"2024-04-17T05:34:08.568289+0000","last_peered":"2024-04-17T05:34:08.568289+0000","last_clean":"2024-04-17T05:34:08.568289+0000","last_became_active":"2024-04-17T05:26:57.305676+0000","last_became_peered":"2024-04-17T05:26:57.305676+0000","last_unstale":"2024-04-17T05:34:08.568289+0000","last_undegraded":"2024-04-17T05:34:08.568289+0000","last_fullsized":"2024-04-17T05:34:08.568289+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:34:08.568079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:34:08.568079+0000","last_clean_scrub_stamp":"2024-04-17T05:34:08.568079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:05:43.775726+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"28'9","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:07.942097+0000","last_change":"2024-04-17T05:34:07.942211+0000","last_active":"2024-04-17T05:34:07.942097+0000","last_peered":"2024-04-17T05:34:07.942097+0000","last_clean":"2024-04-17T05:34:07.942097+0000","last_became_active":"2024-04-17T05:26:53.230175+0000","last_became_peered":"2024-04-17T05:26:53.230175+0000","last_unstale":"2024-04-17T05:34:07.942097+0000","last_undegraded":"2024-04-17T05:34:07.942097+0000","last_fullsized":"2024-04-17T05:34:07.942097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-04-17T05:34:07.941892+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-04-17T05:34:07.941892+0000","last_clean_scrub_stamp":"2024-04-17T05:34:07.941892+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:43:51.602459+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:02.818906+0000","last_change":"2024-04-17T05:34:02.818935+0000","last_active":"2024-04-17T05:34:02.818906+0000","last_peered":"2024-04-17T05:34:02.818906+0000","last_clean":"2024-04-17T05:34:02.818906+0000","last_became_active":"2024-04-17T05:26:52.207343+0000","last_became_peered":"2024-04-17T05:26:52.207343+0000","last_unstale":"2024-04-17T05:34:02.818906+0000","last_undegraded":"2024-04-17T05:34:02.818906+0000","last_fullsized":"2024-04-17T05:34:02.818906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:34:02.818741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:34:02.818741+0000","last_clean_scrub_stamp":"2024-04-17T05:34:02.818741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:10:09.378621+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:12.629563+0000","last_change":"2024-04-17T05:34:12.629628+0000","last_active":"2024-04-17T05:34:12.629563+0000","last_peered":"2024-04-17T05:34:12.629563+0000","last_clean":"2024-04-17T05:34:12.629563+0000","last_became_active":"2024-04-17T05:26:57.310038+0000","last_became_peered":"2024-04-17T05:26:57.310038+0000","last_unstale":"2024-04-17T05:34:12.629563+0000","last_undegraded":"2024-04-17T05:34:12.629563+0000","last_fullsized":"2024-04-17T05:34:12.629563+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:34:12.629384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:34:12.629384+0000","last_clean_scrub_stamp":"2024-04-17T05:34:12.629384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:01:32.473734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'6","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:08.813948+0000","last_change":"2024-04-17T05:34:08.813948+0000","last_active":"2024-04-17T05:34:08.813948+0000","last_peered":"2024-04-17T05:34:08.813948+0000","last_clean":"2024-04-17T05:34:08.813948+0000","last_became_active":"2024-04-17T05:27:39.896306+0000","last_became_peered":"2024-04-17T05:27:39.896306+0000","last_unstale":"2024-04-17T05:34:08.813948+0000","last_undegraded":"2024-04-17T05:34:08.813948+0000","last_fullsized":"2024-04-17T05:34:08.813948+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-04-17T05:34:08.813595+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-04-17T05:34:08.813595+0000","last_clean_scrub_stamp":"2024-04-17T05:34:08.813595+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:11:06.876009+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"28'3","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:01.783268+0000","last_change":"2024-04-17T05:34:01.783315+0000","last_active":"2024-04-17T05:34:01.783268+0000","last_peered":"2024-04-17T05:34:01.783268+0000","last_clean":"2024-04-17T05:34:01.783268+0000","last_became_active":"2024-04-17T05:26:52.207019+0000","last_became_peered":"2024-04-17T05:26:52.207019+0000","last_unstale":"2024-04-17T05:34:01.783268+0000","last_undegraded":"2024-04-17T05:34:01.783268+0000","last_fullsized":"2024-04-17T05:34:01.783268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-04-17T05:34:01.783143+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-04-17T05:34:01.783143+0000","last_clean_scrub_stamp":"2024-04-17T05:34:01.783143+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:25:48.172753+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:13.869180+0000","last_change":"2024-04-17T05:34:13.869242+0000","last_active":"2024-04-17T05:34:13.869180+0000","last_peered":"2024-04-17T05:34:13.869180+0000","last_clean":"2024-04-17T05:34:13.869180+0000","last_became_active":"2024-04-17T05:26:57.345300+0000","last_became_peered":"2024-04-17T05:26:57.345300+0000","last_unstale":"2024-04-17T05:34:13.869180+0000","last_undegraded":"2024-04-17T05:34:13.869180+0000","last_fullsized":"2024-04-17T05:34:13.869180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:34:13.869004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:34:13.869004+0000","last_clean_scrub_stamp":"2024-04-17T05:34:13.869004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:27:21.580143+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"28'3","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:02.632902+0000","last_change":"2024-04-17T05:34:02.632965+0000","last_active":"2024-04-17T05:34:02.632902+0000","last_peered":"2024-04-17T05:34:02.632902+0000","last_clean":"2024-04-17T05:34:02.632902+0000","last_became_active":"2024-04-17T05:26:53.218355+0000","last_became_peered":"2024-04-17T05:26:53.218355+0000","last_unstale":"2024-04-17T05:34:02.632902+0000","last_undegraded":"2024-04-17T05:34:02.632902+0000","last_fullsized":"2024-04-17T05:34:02.632902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-04-17T05:34:02.632730+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-04-17T05:34:02.632730+0000","last_clean_scrub_stamp":"2024-04-17T05:34:02.632730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:06:06.805051+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'4","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:07.276578+0000","last_change":"2024-04-17T05:34:07.276637+0000","last_active":"2024-04-17T05:34:07.276578+0000","last_peered":"2024-04-17T05:34:07.276578+0000","last_clean":"2024-04-17T05:34:07.276578+0000","last_became_active":"2024-04-17T05:26:52.214633+0000","last_became_peered":"2024-04-17T05:26:52.214633+0000","last_unstale":"2024-04-17T05:34:07.276578+0000","last_undegraded":"2024-04-17T05:34:07.276578+0000","last_fullsized":"2024-04-17T05:34:07.276578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-04-17T05:34:07.276392+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-04-17T05:34:07.276392+0000","last_clean_scrub_stamp":"2024-04-17T05:34:07.276392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:45:46.100142+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:09.602700+0000","last_change":"2024-04-17T05:34:09.602766+0000","last_active":"2024-04-17T05:34:09.602700+0000","last_peered":"2024-04-17T05:34:09.602700+0000","last_clean":"2024-04-17T05:34:09.602700+0000","last_became_active":"2024-04-17T05:26:57.309175+0000","last_became_peered":"2024-04-17T05:26:57.309175+0000","last_unstale":"2024-04-17T05:34:09.602700+0000","last_undegraded":"2024-04-17T05:34:09.602700+0000","last_fullsized":"2024-04-17T05:34:09.602700+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:34:09.602512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:34:09.602512+0000","last_clean_scrub_stamp":"2024-04-17T05:34:09.602512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:24:59.148588+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"28'5","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:01.335311+0000","last_change":"2024-04-17T05:34:01.335348+0000","last_active":"2024-04-17T05:34:01.335311+0000","last_peered":"2024-04-17T05:34:01.335311+0000","last_clean":"2024-04-17T05:34:01.335311+0000","last_became_active":"2024-04-17T05:26:53.220068+0000","last_became_peered":"2024-04-17T05:26:53.220068+0000","last_unstale":"2024-04-17T05:34:01.335311+0000","last_undegraded":"2024-04-17T05:34:01.335311+0000","last_fullsized":"2024-04-17T05:34:01.335311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-04-17T05:34:01.335206+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-04-17T05:34:01.335206+0000","last_clean_scrub_stamp":"2024-04-17T05:34:01.335206+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:05:54.951370+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'4","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:06.407613+0000","last_change":"2024-04-17T05:34:06.407686+0000","last_active":"2024-04-17T05:34:06.407613+0000","last_peered":"2024-04-17T05:34:06.407613+0000","last_clean":"2024-04-17T05:34:06.407613+0000","last_became_active":"2024-04-17T05:26:52.215637+0000","last_became_peered":"2024-04-17T05:26:52.215637+0000","last_unstale":"2024-04-17T05:34:06.407613+0000","last_undegraded":"2024-04-17T05:34:06.407613+0000","last_fullsized":"2024-04-17T05:34:06.407613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-04-17T05:34:06.407430+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-04-17T05:34:06.407430+0000","last_clean_scrub_stamp":"2024-04-17T05:34:06.407430+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:42:46.069535+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:13.599757+0000","last_change":"2024-04-17T05:34:13.599872+0000","last_active":"2024-04-17T05:34:13.599757+0000","last_peered":"2024-04-17T05:34:13.599757+0000","last_clean":"2024-04-17T05:34:13.599757+0000","last_became_active":"2024-04-17T05:26:57.342205+0000","last_became_peered":"2024-04-17T05:26:57.342205+0000","last_unstale":"2024-04-17T05:34:13.599757+0000","last_undegraded":"2024-04-17T05:34:13.599757+0000","last_fullsized":"2024-04-17T05:34:13.599757+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:34:13.599496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:34:13.599496+0000","last_clean_scrub_stamp":"2024-04-17T05:34:13.599496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:43:57.260064+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:03.004351+0000","last_change":"2024-04-17T05:34:03.004413+0000","last_active":"2024-04-17T05:34:03.004351+0000","last_peered":"2024-04-17T05:34:03.004351+0000","last_clean":"2024-04-17T05:34:03.004351+0000","last_became_active":"2024-04-17T05:26:53.237901+0000","last_became_peered":"2024-04-17T05:26:53.237901+0000","last_unstale":"2024-04-17T05:34:03.004351+0000","last_undegraded":"2024-04-17T05:34:03.004351+0000","last_fullsized":"2024-04-17T05:34:03.004351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-04-17T05:34:03.004190+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-04-17T05:34:03.004190+0000","last_clean_scrub_stamp":"2024-04-17T05:34:03.004190+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:05:38.211837+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'106","reported_seq":144,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:03.846815+0000","last_change":"2024-04-17T05:34:03.846874+0000","last_active":"2024-04-17T05:34:03.846815+0000","last_peered":"2024-04-17T05:34:03.846815+0000","last_clean":"2024-04-17T05:34:03.846815+0000","last_became_active":"2024-04-17T05:26:52.213091+0000","last_became_peered":"2024-04-17T05:26:52.213091+0000","last_unstale":"2024-04-17T05:34:03.846815+0000","last_undegraded":"2024-04-17T05:34:03.846815+0000","last_fullsized":"2024-04-17T05:34:03.846815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'106","last_scrub_stamp":"2024-04-17T05:34:03.846618+0000","last_deep_scrub":"28'106","last_deep_scrub_stamp":"2024-04-17T05:34:03.846618+0000","last_clean_scrub_stamp":"2024-04-17T05:34:03.846618+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:05:39.054265+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":210,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:14.871696+0000","last_change":"2024-04-17T05:34:14.871757+0000","last_active":"2024-04-17T05:34:14.871696+0000","last_peered":"2024-04-17T05:34:14.871696+0000","last_clean":"2024-04-17T05:34:14.871696+0000","last_became_active":"2024-04-17T05:26:57.341654+0000","last_became_peered":"2024-04-17T05:26:57.341654+0000","last_unstale":"2024-04-17T05:34:14.871696+0000","last_undegraded":"2024-04-17T05:34:14.871696+0000","last_fullsized":"2024-04-17T05:34:14.871696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:34:14.871507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:34:14.871507+0000","last_clean_scrub_stamp":"2024-04-17T05:34:14.871507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:28:40.381037+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'11","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:06.791737+0000","last_change":"2024-04-17T05:34:06.791795+0000","last_active":"2024-04-17T05:34:06.791737+0000","last_peered":"2024-04-17T05:34:06.791737+0000","last_clean":"2024-04-17T05:34:06.791737+0000","last_became_active":"2024-04-17T05:26:53.220331+0000","last_became_peered":"2024-04-17T05:26:53.220331+0000","last_unstale":"2024-04-17T05:34:06.791737+0000","last_undegraded":"2024-04-17T05:34:06.791737+0000","last_fullsized":"2024-04-17T05:34:06.791737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'11","last_scrub_stamp":"2024-04-17T05:34:06.791538+0000","last_deep_scrub":"28'11","last_deep_scrub_stamp":"2024-04-17T05:34:06.791538+0000","last_clean_scrub_stamp":"2024-04-17T05:34:06.791538+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:00:54.996931+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'3","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:08.289711+0000","last_change":"2024-04-17T05:34:08.289768+0000","last_active":"2024-04-17T05:34:08.289711+0000","last_peered":"2024-04-17T05:34:08.289711+0000","last_clean":"2024-04-17T05:34:08.289711+0000","last_became_active":"2024-04-17T05:26:52.215771+0000","last_became_peered":"2024-04-17T05:26:52.215771+0000","last_unstale":"2024-04-17T05:34:08.289711+0000","last_undegraded":"2024-04-17T05:34:08.289711+0000","last_fullsized":"2024-04-17T05:34:08.289711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-04-17T05:34:08.289544+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-04-17T05:34:08.289544+0000","last_clean_scrub_stamp":"2024-04-17T05:34:08.289544+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:13:22.892688+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'5","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:14.399168+0000","last_change":"2024-04-17T05:34:14.399230+0000","last_active":"2024-04-17T05:34:14.399168+0000","last_peered":"2024-04-17T05:34:14.399168+0000","last_clean":"2024-04-17T05:34:14.399168+0000","last_became_active":"2024-04-17T05:27:39.586593+0000","last_became_peered":"2024-04-17T05:27:39.586593+0000","last_unstale":"2024-04-17T05:34:14.399168+0000","last_undegraded":"2024-04-17T05:34:14.399168+0000","last_fullsized":"2024-04-17T05:34:14.399168+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-04-17T05:34:14.398985+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-04-17T05:34:14.398985+0000","last_clean_scrub_stamp":"2024-04-17T05:34:14.398985+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:20:07.868630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:13.038618+0000","last_change":"2024-04-17T05:34:13.038684+0000","last_active":"2024-04-17T05:34:13.038618+0000","last_peered":"2024-04-17T05:34:13.038618+0000","last_clean":"2024-04-17T05:34:13.038618+0000","last_became_active":"2024-04-17T05:26:53.238516+0000","last_became_peered":"2024-04-17T05:26:53.238516+0000","last_unstale":"2024-04-17T05:34:13.038618+0000","last_undegraded":"2024-04-17T05:34:13.038618+0000","last_fullsized":"2024-04-17T05:34:13.038618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-04-17T05:34:13.038441+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-04-17T05:34:13.038441+0000","last_clean_scrub_stamp":"2024-04-17T05:34:13.038441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:07:40.887891+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:59.807334+0000","last_change":"2024-04-17T05:33:59.807354+0000","last_active":"2024-04-17T05:33:59.807334+0000","last_peered":"2024-04-17T05:33:59.807334+0000","last_clean":"2024-04-17T05:33:59.807334+0000","last_became_active":"2024-04-17T05:26:52.204529+0000","last_became_peered":"2024-04-17T05:26:52.204529+0000","last_unstale":"2024-04-17T05:33:59.807334+0000","last_undegraded":"2024-04-17T05:33:59.807334+0000","last_fullsized":"2024-04-17T05:33:59.807334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:33:59.807271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:33:59.807271+0000","last_clean_scrub_stamp":"2024-04-17T05:33:59.807271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:10:01.526077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:10.861709+0000","last_change":"2024-04-17T05:34:10.861820+0000","last_active":"2024-04-17T05:34:10.861709+0000","last_peered":"2024-04-17T05:34:10.861709+0000","last_clean":"2024-04-17T05:34:10.861709+0000","last_became_active":"2024-04-17T05:26:57.299625+0000","last_became_peered":"2024-04-17T05:26:57.299625+0000","last_unstale":"2024-04-17T05:34:10.861709+0000","last_undegraded":"2024-04-17T05:34:10.861709+0000","last_fullsized":"2024-04-17T05:34:10.861709+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:34:10.861465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:34:10.861465+0000","last_clean_scrub_stamp":"2024-04-17T05:34:10.861465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:42:29.407463+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"28'5","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:03.594493+0000","last_change":"2024-04-17T05:34:03.594550+0000","last_active":"2024-04-17T05:34:03.594493+0000","last_peered":"2024-04-17T05:34:03.594493+0000","last_clean":"2024-04-17T05:34:03.594493+0000","last_became_active":"2024-04-17T05:26:53.220763+0000","last_became_peered":"2024-04-17T05:26:53.220763+0000","last_unstale":"2024-04-17T05:34:03.594493+0000","last_undegraded":"2024-04-17T05:34:03.594493+0000","last_fullsized":"2024-04-17T05:34:03.594493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-04-17T05:34:03.594326+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-04-17T05:34:03.594326+0000","last_clean_scrub_stamp":"2024-04-17T05:34:03.594326+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:49:09.774780+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'5","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:06.034126+0000","last_change":"2024-04-17T05:34:06.034211+0000","last_active":"2024-04-17T05:34:06.034126+0000","last_peered":"2024-04-17T05:34:06.034126+0000","last_clean":"2024-04-17T05:34:06.034126+0000","last_became_active":"2024-04-17T05:26:52.199528+0000","last_became_peered":"2024-04-17T05:26:52.199528+0000","last_unstale":"2024-04-17T05:34:06.034126+0000","last_undegraded":"2024-04-17T05:34:06.034126+0000","last_fullsized":"2024-04-17T05:34:06.034126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-04-17T05:34:06.033949+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-04-17T05:34:06.033949+0000","last_clean_scrub_stamp":"2024-04-17T05:34:06.033949+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:24:55.580024+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'2","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:18.960240+0000","last_change":"2024-04-17T05:34:18.960367+0000","last_active":"2024-04-17T05:34:18.960240+0000","last_peered":"2024-04-17T05:34:18.960240+0000","last_clean":"2024-04-17T05:34:18.960240+0000","last_became_active":"2024-04-17T05:27:39.628034+0000","last_became_peered":"2024-04-17T05:27:39.628034+0000","last_unstale":"2024-04-17T05:34:18.960240+0000","last_undegraded":"2024-04-17T05:34:18.960240+0000","last_fullsized":"2024-04-17T05:34:18.960240+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-04-17T05:34:18.959992+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-04-17T05:34:18.959992+0000","last_clean_scrub_stamp":"2024-04-17T05:34:18.959992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:27:37.065109+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:07.769081+0000","last_change":"2024-04-17T05:34:07.769201+0000","last_active":"2024-04-17T05:34:07.769081+0000","last_peered":"2024-04-17T05:34:07.769081+0000","last_clean":"2024-04-17T05:34:07.769081+0000","last_became_active":"2024-04-17T05:26:53.220930+0000","last_became_peered":"2024-04-17T05:26:53.220930+0000","last_unstale":"2024-04-17T05:34:07.769081+0000","last_undegraded":"2024-04-17T05:34:07.769081+0000","last_fullsized":"2024-04-17T05:34:07.769081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-04-17T05:34:07.768870+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-04-17T05:34:07.768870+0000","last_clean_scrub_stamp":"2024-04-17T05:34:07.768870+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:01:27.613220+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'42","reported_seq":116,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:00.838542+0000","last_change":"2024-04-17T05:34:00.838610+0000","last_active":"2024-04-17T05:34:00.838542+0000","last_peered":"2024-04-17T05:34:00.838542+0000","last_clean":"2024-04-17T05:34:00.838542+0000","last_became_active":"2024-04-17T05:26:52.199804+0000","last_became_peered":"2024-04-17T05:26:52.199804+0000","last_unstale":"2024-04-17T05:34:00.838542+0000","last_undegraded":"2024-04-17T05:34:00.838542+0000","last_fullsized":"2024-04-17T05:34:00.838542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'42","last_scrub_stamp":"2024-04-17T05:34:00.838335+0000","last_deep_scrub":"28'42","last_deep_scrub_stamp":"2024-04-17T05:34:00.838335+0000","last_clean_scrub_stamp":"2024-04-17T05:34:00.838335+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:49:39.955092+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10823,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":36,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:11.875866+0000","last_change":"2024-04-17T05:34:11.875920+0000","last_active":"2024-04-17T05:34:11.875866+0000","last_peered":"2024-04-17T05:34:11.875866+0000","last_clean":"2024-04-17T05:34:11.875866+0000","last_became_active":"2024-04-17T05:26:57.301101+0000","last_became_peered":"2024-04-17T05:26:57.301101+0000","last_unstale":"2024-04-17T05:34:11.875866+0000","last_undegraded":"2024-04-17T05:34:11.875866+0000","last_fullsized":"2024-04-17T05:34:11.875866+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:34:11.875687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:34:11.875687+0000","last_clean_scrub_stamp":"2024-04-17T05:34:11.875687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:37:33.308337+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"28'5","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:58.320953+0000","last_change":"2024-04-17T05:33:58.320998+0000","last_active":"2024-04-17T05:33:58.320953+0000","last_peered":"2024-04-17T05:33:58.320953+0000","last_clean":"2024-04-17T05:33:58.320953+0000","last_became_active":"2024-04-17T05:26:53.238488+0000","last_became_peered":"2024-04-17T05:26:53.238488+0000","last_unstale":"2024-04-17T05:33:58.320953+0000","last_undegraded":"2024-04-17T05:33:58.320953+0000","last_fullsized":"2024-04-17T05:33:58.320953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-04-17T05:33:58.320826+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-04-17T05:33:58.320826+0000","last_clean_scrub_stamp":"2024-04-17T05:33:58.320826+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:49:04.501280+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'4","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:05.227008+0000","last_change":"2024-04-17T05:34:05.227166+0000","last_active":"2024-04-17T05:34:05.227008+0000","last_peered":"2024-04-17T05:34:05.227008+0000","last_clean":"2024-04-17T05:34:05.227008+0000","last_became_active":"2024-04-17T05:26:52.212838+0000","last_became_peered":"2024-04-17T05:26:52.212838+0000","last_unstale":"2024-04-17T05:34:05.227008+0000","last_undegraded":"2024-04-17T05:34:05.227008+0000","last_fullsized":"2024-04-17T05:34:05.227008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-04-17T05:34:05.226797+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-04-17T05:34:05.226797+0000","last_clean_scrub_stamp":"2024-04-17T05:34:05.226797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:09:18.354072+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:12.336631+0000","last_change":"2024-04-17T05:34:12.336715+0000","last_active":"2024-04-17T05:34:12.336631+0000","last_peered":"2024-04-17T05:34:12.336631+0000","last_clean":"2024-04-17T05:34:12.336631+0000","last_became_active":"2024-04-17T05:26:57.342008+0000","last_became_peered":"2024-04-17T05:26:57.342008+0000","last_unstale":"2024-04-17T05:34:12.336631+0000","last_undegraded":"2024-04-17T05:34:12.336631+0000","last_fullsized":"2024-04-17T05:34:12.336631+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:34:12.336444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:34:12.336444+0000","last_clean_scrub_stamp":"2024-04-17T05:34:12.336444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:14:31.831508+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:59.961753+0000","last_change":"2024-04-17T05:33:59.961795+0000","last_active":"2024-04-17T05:33:59.961753+0000","last_peered":"2024-04-17T05:33:59.961753+0000","last_clean":"2024-04-17T05:33:59.961753+0000","last_became_active":"2024-04-17T05:26:53.242778+0000","last_became_peered":"2024-04-17T05:26:53.242778+0000","last_unstale":"2024-04-17T05:33:59.961753+0000","last_undegraded":"2024-04-17T05:33:59.961753+0000","last_fullsized":"2024-04-17T05:33:59.961753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-04-17T05:33:59.961601+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-04-17T05:33:59.961601+0000","last_clean_scrub_stamp":"2024-04-17T05:33:59.961601+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:12.359904+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'4","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:05.003806+0000","last_change":"2024-04-17T05:34:05.003871+0000","last_active":"2024-04-17T05:34:05.003806+0000","last_peered":"2024-04-17T05:34:05.003806+0000","last_clean":"2024-04-17T05:34:05.003806+0000","last_became_active":"2024-04-17T05:26:52.197762+0000","last_became_peered":"2024-04-17T05:26:52.197762+0000","last_unstale":"2024-04-17T05:34:05.003806+0000","last_undegraded":"2024-04-17T05:34:05.003806+0000","last_fullsized":"2024-04-17T05:34:05.003806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-04-17T05:34:05.003639+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-04-17T05:34:05.003639+0000","last_clean_scrub_stamp":"2024-04-17T05:34:05.003639+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:05:40.211286+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":196,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:04.226880+0000","last_change":"2024-04-17T05:34:04.226957+0000","last_active":"2024-04-17T05:34:04.226880+0000","last_peered":"2024-04-17T05:34:04.226880+0000","last_clean":"2024-04-17T05:34:04.226880+0000","last_became_active":"2024-04-17T05:26:48.070585+0000","last_became_peered":"2024-04-17T05:26:48.070585+0000","last_unstale":"2024-04-17T05:34:04.226880+0000","last_undegraded":"2024-04-17T05:34:04.226880+0000","last_fullsized":"2024-04-17T05:34:04.226880+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'119","last_scrub_stamp":"2024-04-17T05:34:04.226711+0000","last_deep_scrub":"28'119","last_deep_scrub_stamp":"2024-04-17T05:34:04.226711+0000","last_clean_scrub_stamp":"2024-04-17T05:34:04.226711+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:50:37.227376+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:16.373641+0000","last_change":"2024-04-17T05:34:16.373701+0000","last_active":"2024-04-17T05:34:16.373641+0000","last_peered":"2024-04-17T05:34:16.373641+0000","last_clean":"2024-04-17T05:34:16.373641+0000","last_became_active":"2024-04-17T05:26:57.345320+0000","last_became_peered":"2024-04-17T05:26:57.345320+0000","last_unstale":"2024-04-17T05:34:16.373641+0000","last_undegraded":"2024-04-17T05:34:16.373641+0000","last_fullsized":"2024-04-17T05:34:16.373641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:34:16.373458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:34:16.373458+0000","last_clean_scrub_stamp":"2024-04-17T05:34:16.373458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:26.724457+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'5","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:19.369961+0000","last_change":"2024-04-17T05:34:19.370018+0000","last_active":"2024-04-17T05:34:19.369961+0000","last_peered":"2024-04-17T05:34:19.369961+0000","last_clean":"2024-04-17T05:34:19.369961+0000","last_became_active":"2024-04-17T05:27:39.897777+0000","last_became_peered":"2024-04-17T05:27:39.897777+0000","last_unstale":"2024-04-17T05:34:19.369961+0000","last_undegraded":"2024-04-17T05:34:19.369961+0000","last_fullsized":"2024-04-17T05:34:19.369961+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-04-17T05:34:19.369795+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-04-17T05:34:19.369795+0000","last_clean_scrub_stamp":"2024-04-17T05:34:19.369795+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:58:22.821198+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'3","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:02.842807+0000","last_change":"2024-04-17T05:34:02.842869+0000","last_active":"2024-04-17T05:34:02.842807+0000","last_peered":"2024-04-17T05:34:02.842807+0000","last_clean":"2024-04-17T05:34:02.842807+0000","last_became_active":"2024-04-17T05:26:52.208422+0000","last_became_peered":"2024-04-17T05:26:52.208422+0000","last_unstale":"2024-04-17T05:34:02.842807+0000","last_undegraded":"2024-04-17T05:34:02.842807+0000","last_fullsized":"2024-04-17T05:34:02.842807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-04-17T05:34:02.842617+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-04-17T05:34:02.842617+0000","last_clean_scrub_stamp":"2024-04-17T05:34:02.842617+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:20:35.229824+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:15.356194+0000","last_change":"2024-04-17T05:34:15.356264+0000","last_active":"2024-04-17T05:34:15.356194+0000","last_peered":"2024-04-17T05:34:15.356194+0000","last_clean":"2024-04-17T05:34:15.356194+0000","last_became_active":"2024-04-17T05:26:57.341658+0000","last_became_peered":"2024-04-17T05:26:57.341658+0000","last_unstale":"2024-04-17T05:34:15.356194+0000","last_undegraded":"2024-04-17T05:34:15.356194+0000","last_fullsized":"2024-04-17T05:34:15.356194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:34:15.355977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:34:15.355977+0000","last_clean_scrub_stamp":"2024-04-17T05:34:15.355977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:04:53.002427+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"28'7","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:14.050690+0000","last_change":"2024-04-17T05:34:14.050748+0000","last_active":"2024-04-17T05:34:14.050690+0000","last_peered":"2024-04-17T05:34:14.050690+0000","last_clean":"2024-04-17T05:34:14.050690+0000","last_became_active":"2024-04-17T05:26:53.238669+0000","last_became_peered":"2024-04-17T05:26:53.238669+0000","last_unstale":"2024-04-17T05:34:14.050690+0000","last_undegraded":"2024-04-17T05:34:14.050690+0000","last_fullsized":"2024-04-17T05:34:14.050690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-04-17T05:34:14.050514+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-04-17T05:34:14.050514+0000","last_clean_scrub_stamp":"2024-04-17T05:34:14.050514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:14:33.545577+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'5","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:58.851128+0000","last_change":"2024-04-17T05:33:58.851172+0000","last_active":"2024-04-17T05:33:58.851128+0000","last_peered":"2024-04-17T05:33:58.851128+0000","last_clean":"2024-04-17T05:33:58.851128+0000","last_became_active":"2024-04-17T05:26:52.202246+0000","last_became_peered":"2024-04-17T05:26:52.202246+0000","last_unstale":"2024-04-17T05:33:58.851128+0000","last_undegraded":"2024-04-17T05:33:58.851128+0000","last_fullsized":"2024-04-17T05:33:58.851128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-04-17T05:33:58.851034+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-04-17T05:33:58.851034+0000","last_clean_scrub_stamp":"2024-04-17T05:33:58.851034+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:49:05.031488+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:11.333947+0000","last_change":"2024-04-17T05:34:11.334001+0000","last_active":"2024-04-17T05:34:11.333947+0000","last_peered":"2024-04-17T05:34:11.333947+0000","last_clean":"2024-04-17T05:34:11.333947+0000","last_became_active":"2024-04-17T05:26:57.302457+0000","last_became_peered":"2024-04-17T05:26:57.302457+0000","last_unstale":"2024-04-17T05:34:11.333947+0000","last_undegraded":"2024-04-17T05:34:11.333947+0000","last_fullsized":"2024-04-17T05:34:11.333947+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:34:11.333773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:34:11.333773+0000","last_clean_scrub_stamp":"2024-04-17T05:34:11.333773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:07:39.183223+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"28'9","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:17.312924+0000","last_change":"2024-04-17T05:34:17.312983+0000","last_active":"2024-04-17T05:34:17.312924+0000","last_peered":"2024-04-17T05:34:17.312924+0000","last_clean":"2024-04-17T05:34:17.312924+0000","last_became_active":"2024-04-17T05:26:53.254371+0000","last_became_peered":"2024-04-17T05:26:53.254371+0000","last_unstale":"2024-04-17T05:34:17.312924+0000","last_undegraded":"2024-04-17T05:34:17.312924+0000","last_fullsized":"2024-04-17T05:34:17.312924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-04-17T05:34:17.312747+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-04-17T05:34:17.312747+0000","last_clean_scrub_stamp":"2024-04-17T05:34:17.312747+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:55:49.271391+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'4","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:01.882965+0000","last_change":"2024-04-17T05:34:01.882990+0000","last_active":"2024-04-17T05:34:01.882965+0000","last_peered":"2024-04-17T05:34:01.882965+0000","last_clean":"2024-04-17T05:34:01.882965+0000","last_became_active":"2024-04-17T05:26:52.204139+0000","last_became_peered":"2024-04-17T05:26:52.204139+0000","last_unstale":"2024-04-17T05:34:01.882965+0000","last_undegraded":"2024-04-17T05:34:01.882965+0000","last_fullsized":"2024-04-17T05:34:01.882965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-04-17T05:34:01.882902+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-04-17T05:34:01.882902+0000","last_clean_scrub_stamp":"2024-04-17T05:34:01.882902+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:06:16.463967+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:17.975871+0000","last_change":"2024-04-17T05:34:17.975986+0000","last_active":"2024-04-17T05:34:17.975871+0000","last_peered":"2024-04-17T05:34:17.975871+0000","last_clean":"2024-04-17T05:34:17.975871+0000","last_became_active":"2024-04-17T05:26:57.342006+0000","last_became_peered":"2024-04-17T05:26:57.342006+0000","last_unstale":"2024-04-17T05:34:17.975871+0000","last_undegraded":"2024-04-17T05:34:17.975871+0000","last_fullsized":"2024-04-17T05:34:17.975871+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:34:17.975643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:34:17.975643+0000","last_clean_scrub_stamp":"2024-04-17T05:34:17.975643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:36:46.534684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:15.266254+0000","last_change":"2024-04-17T05:34:15.266327+0000","last_active":"2024-04-17T05:34:15.266254+0000","last_peered":"2024-04-17T05:34:15.266254+0000","last_clean":"2024-04-17T05:34:15.266254+0000","last_became_active":"2024-04-17T05:26:53.253395+0000","last_became_peered":"2024-04-17T05:26:53.253395+0000","last_unstale":"2024-04-17T05:34:15.266254+0000","last_undegraded":"2024-04-17T05:34:15.266254+0000","last_fullsized":"2024-04-17T05:34:15.266254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-04-17T05:34:15.265955+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-04-17T05:34:15.265955+0000","last_clean_scrub_stamp":"2024-04-17T05:34:15.265955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:28:29.177326+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'6","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:00.659722+0000","last_change":"2024-04-17T05:34:00.659788+0000","last_active":"2024-04-17T05:34:00.659722+0000","last_peered":"2024-04-17T05:34:00.659722+0000","last_clean":"2024-04-17T05:34:00.659722+0000","last_became_active":"2024-04-17T05:26:52.198798+0000","last_became_peered":"2024-04-17T05:26:52.198798+0000","last_unstale":"2024-04-17T05:34:00.659722+0000","last_undegraded":"2024-04-17T05:34:00.659722+0000","last_fullsized":"2024-04-17T05:34:00.659722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-04-17T05:34:00.659543+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-04-17T05:34:00.659543+0000","last_clean_scrub_stamp":"2024-04-17T05:34:00.659543+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:19:14.166856+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:07.581205+0000","last_change":"2024-04-17T05:34:07.581271+0000","last_active":"2024-04-17T05:34:07.581205+0000","last_peered":"2024-04-17T05:34:07.581205+0000","last_clean":"2024-04-17T05:34:07.581205+0000","last_became_active":"2024-04-17T05:26:57.305415+0000","last_became_peered":"2024-04-17T05:26:57.305415+0000","last_unstale":"2024-04-17T05:34:07.581205+0000","last_undegraded":"2024-04-17T05:34:07.581205+0000","last_fullsized":"2024-04-17T05:34:07.581205+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:34:07.580884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:34:07.580884+0000","last_clean_scrub_stamp":"2024-04-17T05:34:07.580884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:10:14.140764+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"28'7","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:06.850906+0000","last_change":"2024-04-17T05:34:06.850970+0000","last_active":"2024-04-17T05:34:06.850906+0000","last_peered":"2024-04-17T05:34:06.850906+0000","last_clean":"2024-04-17T05:34:06.850906+0000","last_became_active":"2024-04-17T05:27:39.579096+0000","last_became_peered":"2024-04-17T05:27:39.579096+0000","last_unstale":"2024-04-17T05:34:06.850906+0000","last_undegraded":"2024-04-17T05:34:06.850906+0000","last_fullsized":"2024-04-17T05:34:06.850906+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-04-17T05:34:06.850727+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-04-17T05:34:06.850727+0000","last_clean_scrub_stamp":"2024-04-17T05:34:06.850727+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:22:12.321356+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"28'15","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:59.796967+0000","last_change":"2024-04-17T05:33:59.796996+0000","last_active":"2024-04-17T05:33:59.796967+0000","last_peered":"2024-04-17T05:33:59.796967+0000","last_clean":"2024-04-17T05:33:59.796967+0000","last_became_active":"2024-04-17T05:26:52.197250+0000","last_became_peered":"2024-04-17T05:26:52.197250+0000","last_unstale":"2024-04-17T05:33:59.796967+0000","last_undegraded":"2024-04-17T05:33:59.796967+0000","last_fullsized":"2024-04-17T05:33:59.796967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'15","last_scrub_stamp":"2024-04-17T05:33:59.796902+0000","last_deep_scrub":"28'15","last_deep_scrub_stamp":"2024-04-17T05:33:59.796902+0000","last_clean_scrub_stamp":"2024-04-17T05:33:59.796902+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:29:28.444689+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:10.326621+0000","last_change":"2024-04-17T05:34:10.326621+0000","last_active":"2024-04-17T05:34:10.326621+0000","last_peered":"2024-04-17T05:34:10.326621+0000","last_clean":"2024-04-17T05:34:10.326621+0000","last_became_active":"2024-04-17T05:26:57.296040+0000","last_became_peered":"2024-04-17T05:26:57.296040+0000","last_unstale":"2024-04-17T05:34:10.326621+0000","last_undegraded":"2024-04-17T05:34:10.326621+0000","last_fullsized":"2024-04-17T05:34:10.326621+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:34:10.326318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:34:10.326318+0000","last_clean_scrub_stamp":"2024-04-17T05:34:10.326318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:39:25.753791+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'9","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:07.412246+0000","last_change":"2024-04-17T05:34:07.412314+0000","last_active":"2024-04-17T05:34:07.412246+0000","last_peered":"2024-04-17T05:34:07.412246+0000","last_clean":"2024-04-17T05:34:07.412246+0000","last_became_active":"2024-04-17T05:26:53.230987+0000","last_became_peered":"2024-04-17T05:26:53.230987+0000","last_unstale":"2024-04-17T05:34:07.412246+0000","last_undegraded":"2024-04-17T05:34:07.412246+0000","last_fullsized":"2024-04-17T05:34:07.412246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-04-17T05:34:07.412036+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-04-17T05:34:07.412036+0000","last_clean_scrub_stamp":"2024-04-17T05:34:07.412036+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:27:54.010098+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'3","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:02.504094+0000","last_change":"2024-04-17T05:34:02.504188+0000","last_active":"2024-04-17T05:34:02.504094+0000","last_peered":"2024-04-17T05:34:02.504094+0000","last_clean":"2024-04-17T05:34:02.504094+0000","last_became_active":"2024-04-17T05:26:52.206401+0000","last_became_peered":"2024-04-17T05:26:52.206401+0000","last_unstale":"2024-04-17T05:34:02.504094+0000","last_undegraded":"2024-04-17T05:34:02.504094+0000","last_fullsized":"2024-04-17T05:34:02.504094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-04-17T05:34:02.503855+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-04-17T05:34:02.503855+0000","last_clean_scrub_stamp":"2024-04-17T05:34:02.503855+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:11:01.252577+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:17.859433+0000","last_change":"2024-04-17T05:34:17.859489+0000","last_active":"2024-04-17T05:34:17.859433+0000","last_peered":"2024-04-17T05:34:17.859433+0000","last_clean":"2024-04-17T05:34:17.859433+0000","last_became_active":"2024-04-17T05:26:57.346516+0000","last_became_peered":"2024-04-17T05:26:57.346516+0000","last_unstale":"2024-04-17T05:34:17.859433+0000","last_undegraded":"2024-04-17T05:34:17.859433+0000","last_fullsized":"2024-04-17T05:34:17.859433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:34:17.859258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:34:17.859258+0000","last_clean_scrub_stamp":"2024-04-17T05:34:17.859258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:27:35.964375+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"28'20","reported_seq":56,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:16.268881+0000","last_change":"2024-04-17T05:34:16.268938+0000","last_active":"2024-04-17T05:34:16.268881+0000","last_peered":"2024-04-17T05:34:16.268881+0000","last_clean":"2024-04-17T05:34:16.268881+0000","last_became_active":"2024-04-17T05:26:53.253813+0000","last_became_peered":"2024-04-17T05:26:53.253813+0000","last_unstale":"2024-04-17T05:34:16.268881+0000","last_undegraded":"2024-04-17T05:34:16.268881+0000","last_fullsized":"2024-04-17T05:34:16.268881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'20","last_scrub_stamp":"2024-04-17T05:34:16.268666+0000","last_deep_scrub":"28'20","last_deep_scrub_stamp":"2024-04-17T05:34:16.268666+0000","last_clean_scrub_stamp":"2024-04-17T05:34:16.268666+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:38:32.368937+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'8","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:06.988122+0000","last_change":"2024-04-17T05:34:06.988225+0000","last_active":"2024-04-17T05:34:06.988122+0000","last_peered":"2024-04-17T05:34:06.988122+0000","last_clean":"2024-04-17T05:34:06.988122+0000","last_became_active":"2024-04-17T05:26:52.210106+0000","last_became_peered":"2024-04-17T05:26:52.210106+0000","last_unstale":"2024-04-17T05:34:06.988122+0000","last_undegraded":"2024-04-17T05:34:06.988122+0000","last_fullsized":"2024-04-17T05:34:06.988122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-04-17T05:34:06.987817+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-04-17T05:34:06.987817+0000","last_clean_scrub_stamp":"2024-04-17T05:34:06.987817+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:57:11.114938+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:16.873841+0000","last_change":"2024-04-17T05:34:16.873899+0000","last_active":"2024-04-17T05:34:16.873841+0000","last_peered":"2024-04-17T05:34:16.873841+0000","last_clean":"2024-04-17T05:34:16.873841+0000","last_became_active":"2024-04-17T05:26:57.341999+0000","last_became_peered":"2024-04-17T05:26:57.341999+0000","last_unstale":"2024-04-17T05:34:16.873841+0000","last_undegraded":"2024-04-17T05:34:16.873841+0000","last_fullsized":"2024-04-17T05:34:16.873841+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:34:16.873666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:34:16.873666+0000","last_clean_scrub_stamp":"2024-04-17T05:34:16.873666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:27:52.110818+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:06.367258+0000","last_change":"2024-04-17T05:34:06.367323+0000","last_active":"2024-04-17T05:34:06.367258+0000","last_peered":"2024-04-17T05:34:06.367258+0000","last_clean":"2024-04-17T05:34:06.367258+0000","last_became_active":"2024-04-17T05:26:53.233202+0000","last_became_peered":"2024-04-17T05:26:53.233202+0000","last_unstale":"2024-04-17T05:34:06.367258+0000","last_undegraded":"2024-04-17T05:34:06.367258+0000","last_fullsized":"2024-04-17T05:34:06.367258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-04-17T05:34:06.367088+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-04-17T05:34:06.367088+0000","last_clean_scrub_stamp":"2024-04-17T05:34:06.367088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:51:50.816391+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'6","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:33:59.358795+0000","last_change":"2024-04-17T05:33:59.358828+0000","last_active":"2024-04-17T05:33:59.358795+0000","last_peered":"2024-04-17T05:33:59.358795+0000","last_clean":"2024-04-17T05:33:59.358795+0000","last_became_active":"2024-04-17T05:26:52.194504+0000","last_became_peered":"2024-04-17T05:26:52.194504+0000","last_unstale":"2024-04-17T05:33:59.358795+0000","last_undegraded":"2024-04-17T05:33:59.358795+0000","last_fullsized":"2024-04-17T05:33:59.358795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-04-17T05:33:59.358703+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-04-17T05:33:59.358703+0000","last_clean_scrub_stamp":"2024-04-17T05:33:59.358703+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:10:01.077509+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:16.969464+0000","last_change":"2024-04-17T05:34:16.969520+0000","last_active":"2024-04-17T05:34:16.969464+0000","last_peered":"2024-04-17T05:34:16.969464+0000","last_clean":"2024-04-17T05:34:16.969464+0000","last_became_active":"2024-04-17T05:26:57.343479+0000","last_became_peered":"2024-04-17T05:26:57.343479+0000","last_unstale":"2024-04-17T05:34:16.969464+0000","last_undegraded":"2024-04-17T05:34:16.969464+0000","last_fullsized":"2024-04-17T05:34:16.969464+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:34:16.969291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:34:16.969291+0000","last_clean_scrub_stamp":"2024-04-17T05:34:16.969291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:56:16.998816+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:14.297345+0000","last_change":"2024-04-17T05:34:14.297404+0000","last_active":"2024-04-17T05:34:14.297345+0000","last_peered":"2024-04-17T05:34:14.297345+0000","last_clean":"2024-04-17T05:34:14.297345+0000","last_became_active":"2024-04-17T05:26:53.249125+0000","last_became_peered":"2024-04-17T05:26:53.249125+0000","last_unstale":"2024-04-17T05:34:14.297345+0000","last_undegraded":"2024-04-17T05:34:14.297345+0000","last_fullsized":"2024-04-17T05:34:14.297345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-04-17T05:34:14.297173+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-04-17T05:34:14.297173+0000","last_clean_scrub_stamp":"2024-04-17T05:34:14.297173+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:05:08.587430+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'97","reported_seq":135,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:03.510379+0000","last_change":"2024-04-17T05:34:03.510513+0000","last_active":"2024-04-17T05:34:03.510379+0000","last_peered":"2024-04-17T05:34:03.510379+0000","last_clean":"2024-04-17T05:34:03.510379+0000","last_became_active":"2024-04-17T05:26:52.207696+0000","last_became_peered":"2024-04-17T05:26:52.207696+0000","last_unstale":"2024-04-17T05:34:03.510379+0000","last_undegraded":"2024-04-17T05:34:03.510379+0000","last_fullsized":"2024-04-17T05:34:03.510379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'97","last_scrub_stamp":"2024-04-17T05:34:03.510176+0000","last_deep_scrub":"28'97","last_deep_scrub_stamp":"2024-04-17T05:34:03.510176+0000","last_clean_scrub_stamp":"2024-04-17T05:34:03.510176+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:13:12.630527+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":934282,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:12.902909+0000","last_change":"2024-04-17T05:34:12.902963+0000","last_active":"2024-04-17T05:34:12.902909+0000","last_peered":"2024-04-17T05:34:12.902909+0000","last_clean":"2024-04-17T05:34:12.902909+0000","last_became_active":"2024-04-17T05:26:57.303124+0000","last_became_peered":"2024-04-17T05:26:57.303124+0000","last_unstale":"2024-04-17T05:34:12.902909+0000","last_undegraded":"2024-04-17T05:34:12.902909+0000","last_fullsized":"2024-04-17T05:34:12.902909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:34:12.902744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:34:12.902744+0000","last_clean_scrub_stamp":"2024-04-17T05:34:12.902744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:14:32.397808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'12","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:05.561671+0000","last_change":"2024-04-17T05:34:05.561740+0000","last_active":"2024-04-17T05:34:05.561671+0000","last_peered":"2024-04-17T05:34:05.561671+0000","last_clean":"2024-04-17T05:34:05.561671+0000","last_became_active":"2024-04-17T05:26:53.232624+0000","last_became_peered":"2024-04-17T05:26:53.232624+0000","last_unstale":"2024-04-17T05:34:05.561671+0000","last_undegraded":"2024-04-17T05:34:05.561671+0000","last_fullsized":"2024-04-17T05:34:05.561671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2024-04-17T05:34:05.561456+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2024-04-17T05:34:05.561456+0000","last_clean_scrub_stamp":"2024-04-17T05:34:05.561456+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:17.959759+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'27","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:00.815592+0000","last_change":"2024-04-17T05:34:00.815592+0000","last_active":"2024-04-17T05:34:00.815592+0000","last_peered":"2024-04-17T05:34:00.815592+0000","last_clean":"2024-04-17T05:34:00.815592+0000","last_became_active":"2024-04-17T05:26:52.207181+0000","last_became_peered":"2024-04-17T05:26:52.207181+0000","last_unstale":"2024-04-17T05:34:00.815592+0000","last_undegraded":"2024-04-17T05:34:00.815592+0000","last_fullsized":"2024-04-17T05:34:00.815592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'27","last_scrub_stamp":"2024-04-17T05:34:00.815370+0000","last_deep_scrub":"28'27","last_deep_scrub_stamp":"2024-04-17T05:34:00.815370+0000","last_clean_scrub_stamp":"2024-04-17T05:34:00.815370+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:16:13.213674+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:14.606560+0000","last_change":"2024-04-17T05:34:14.606626+0000","last_active":"2024-04-17T05:34:14.606560+0000","last_peered":"2024-04-17T05:34:14.606560+0000","last_clean":"2024-04-17T05:34:14.606560+0000","last_became_active":"2024-04-17T05:27:39.627825+0000","last_became_peered":"2024-04-17T05:27:39.627825+0000","last_unstale":"2024-04-17T05:34:14.606560+0000","last_undegraded":"2024-04-17T05:34:14.606560+0000","last_fullsized":"2024-04-17T05:34:14.606560+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:34:14.606378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:34:14.606378+0000","last_clean_scrub_stamp":"2024-04-17T05:34:14.606378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:07:25.861530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"28'9","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:08.384222+0000","last_change":"2024-04-17T05:34:08.384222+0000","last_active":"2024-04-17T05:34:08.384222+0000","last_peered":"2024-04-17T05:34:08.384222+0000","last_clean":"2024-04-17T05:34:08.384222+0000","last_became_active":"2024-04-17T05:26:53.241388+0000","last_became_peered":"2024-04-17T05:26:53.241388+0000","last_unstale":"2024-04-17T05:34:08.384222+0000","last_undegraded":"2024-04-17T05:34:08.384222+0000","last_fullsized":"2024-04-17T05:34:08.384222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-04-17T05:34:08.383982+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-04-17T05:34:08.383982+0000","last_clean_scrub_stamp":"2024-04-17T05:34:08.383982+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:29:36.688406+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'7","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:08.037454+0000","last_change":"2024-04-17T05:34:08.037454+0000","last_active":"2024-04-17T05:34:08.037454+0000","last_peered":"2024-04-17T05:34:08.037454+0000","last_clean":"2024-04-17T05:34:08.037454+0000","last_became_active":"2024-04-17T05:26:52.212440+0000","last_became_peered":"2024-04-17T05:26:52.212440+0000","last_unstale":"2024-04-17T05:34:08.037454+0000","last_undegraded":"2024-04-17T05:34:08.037454+0000","last_fullsized":"2024-04-17T05:34:08.037454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-04-17T05:34:08.037199+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-04-17T05:34:08.037199+0000","last_clean_scrub_stamp":"2024-04-17T05:34:08.037199+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:59:48.696550+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:12.892245+0000","last_change":"2024-04-17T05:34:12.892301+0000","last_active":"2024-04-17T05:34:12.892245+0000","last_peered":"2024-04-17T05:34:12.892245+0000","last_clean":"2024-04-17T05:34:12.892245+0000","last_became_active":"2024-04-17T05:26:57.300156+0000","last_became_peered":"2024-04-17T05:26:57.300156+0000","last_unstale":"2024-04-17T05:34:12.892245+0000","last_undegraded":"2024-04-17T05:34:12.892245+0000","last_fullsized":"2024-04-17T05:34:12.892245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:34:12.892025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:34:12.892025+0000","last_clean_scrub_stamp":"2024-04-17T05:34:12.892025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:43:42.460302+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:12.022883+0000","last_change":"2024-04-17T05:34:12.022943+0000","last_active":"2024-04-17T05:34:12.022883+0000","last_peered":"2024-04-17T05:34:12.022883+0000","last_clean":"2024-04-17T05:34:12.022883+0000","last_became_active":"2024-04-17T05:26:53.238566+0000","last_became_peered":"2024-04-17T05:26:53.238566+0000","last_unstale":"2024-04-17T05:34:12.022883+0000","last_undegraded":"2024-04-17T05:34:12.022883+0000","last_fullsized":"2024-04-17T05:34:12.022883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-04-17T05:34:12.022715+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-04-17T05:34:12.022715+0000","last_clean_scrub_stamp":"2024-04-17T05:34:12.022715+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:39:27.450188+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"28'5","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:05.431917+0000","last_change":"2024-04-17T05:34:05.431917+0000","last_active":"2024-04-17T05:34:05.431917+0000","last_peered":"2024-04-17T05:34:05.431917+0000","last_clean":"2024-04-17T05:34:05.431917+0000","last_became_active":"2024-04-17T05:26:52.214958+0000","last_became_peered":"2024-04-17T05:26:52.214958+0000","last_unstale":"2024-04-17T05:34:05.431917+0000","last_undegraded":"2024-04-17T05:34:05.431917+0000","last_fullsized":"2024-04-17T05:34:05.431917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-04-17T05:34:05.431678+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-04-17T05:34:05.431678+0000","last_clean_scrub_stamp":"2024-04-17T05:34:05.431678+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:53:39.019585+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:15.894065+0000","last_change":"2024-04-17T05:34:15.894121+0000","last_active":"2024-04-17T05:34:15.894065+0000","last_peered":"2024-04-17T05:34:15.894065+0000","last_clean":"2024-04-17T05:34:15.894065+0000","last_became_active":"2024-04-17T05:26:57.341304+0000","last_became_peered":"2024-04-17T05:26:57.341304+0000","last_unstale":"2024-04-17T05:34:15.894065+0000","last_undegraded":"2024-04-17T05:34:15.894065+0000","last_fullsized":"2024-04-17T05:34:15.894065+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:34:15.893892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:34:15.893892+0000","last_clean_scrub_stamp":"2024-04-17T05:34:15.893892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:06:19.156847+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:13.355815+0000","last_change":"2024-04-17T05:34:13.355922+0000","last_active":"2024-04-17T05:34:13.355815+0000","last_peered":"2024-04-17T05:34:13.355815+0000","last_clean":"2024-04-17T05:34:13.355815+0000","last_became_active":"2024-04-17T05:26:57.342076+0000","last_became_peered":"2024-04-17T05:26:57.342076+0000","last_unstale":"2024-04-17T05:34:13.355815+0000","last_undegraded":"2024-04-17T05:34:13.355815+0000","last_fullsized":"2024-04-17T05:34:13.355815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:34:13.355583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:34:13.355583+0000","last_clean_scrub_stamp":"2024-04-17T05:34:13.355583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:27:21.066722+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'11","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:08.798969+0000","last_change":"2024-04-17T05:34:08.798969+0000","last_active":"2024-04-17T05:34:08.798969+0000","last_peered":"2024-04-17T05:34:08.798969+0000","last_clean":"2024-04-17T05:34:08.798969+0000","last_became_active":"2024-04-17T05:26:53.228381+0000","last_became_peered":"2024-04-17T05:26:53.228381+0000","last_unstale":"2024-04-17T05:34:08.798969+0000","last_undegraded":"2024-04-17T05:34:08.798969+0000","last_fullsized":"2024-04-17T05:34:08.798969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'11","last_scrub_stamp":"2024-04-17T05:34:08.798739+0000","last_deep_scrub":"28'11","last_deep_scrub_stamp":"2024-04-17T05:34:08.798739+0000","last_clean_scrub_stamp":"2024-04-17T05:34:08.798739+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:43:52.459306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'5","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:04.008774+0000","last_change":"2024-04-17T05:34:04.008774+0000","last_active":"2024-04-17T05:34:04.008774+0000","last_peered":"2024-04-17T05:34:04.008774+0000","last_clean":"2024-04-17T05:34:04.008774+0000","last_became_active":"2024-04-17T05:26:52.193995+0000","last_became_peered":"2024-04-17T05:26:52.193995+0000","last_unstale":"2024-04-17T05:34:04.008774+0000","last_undegraded":"2024-04-17T05:34:04.008774+0000","last_fullsized":"2024-04-17T05:34:04.008774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-04-17T05:34:04.008540+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-04-17T05:34:04.008540+0000","last_clean_scrub_stamp":"2024-04-17T05:34:04.008540+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:21:13.170746+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:14.400241+0000","last_change":"2024-04-17T05:34:14.400350+0000","last_active":"2024-04-17T05:34:14.400241+0000","last_peered":"2024-04-17T05:34:14.400241+0000","last_clean":"2024-04-17T05:34:14.400241+0000","last_became_active":"2024-04-17T05:26:57.305777+0000","last_became_peered":"2024-04-17T05:26:57.305777+0000","last_unstale":"2024-04-17T05:34:14.400241+0000","last_undegraded":"2024-04-17T05:34:14.400241+0000","last_fullsized":"2024-04-17T05:34:14.400241+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:34:14.400000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:34:14.400000+0000","last_clean_scrub_stamp":"2024-04-17T05:34:14.400000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:13:51.130295+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:06.915008+0000","last_change":"2024-04-17T05:34:06.915008+0000","last_active":"2024-04-17T05:34:06.915008+0000","last_peered":"2024-04-17T05:34:06.915008+0000","last_clean":"2024-04-17T05:34:06.915008+0000","last_became_active":"2024-04-17T05:26:53.225554+0000","last_became_peered":"2024-04-17T05:26:53.225554+0000","last_unstale":"2024-04-17T05:34:06.915008+0000","last_undegraded":"2024-04-17T05:34:06.915008+0000","last_fullsized":"2024-04-17T05:34:06.915008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-04-17T05:34:06.914772+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-04-17T05:34:06.914772+0000","last_clean_scrub_stamp":"2024-04-17T05:34:06.914772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:01:26.759122+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'2","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:04.963465+0000","last_change":"2024-04-17T05:34:04.963465+0000","last_active":"2024-04-17T05:34:04.963465+0000","last_peered":"2024-04-17T05:34:04.963465+0000","last_clean":"2024-04-17T05:34:04.963465+0000","last_became_active":"2024-04-17T05:26:52.204982+0000","last_became_peered":"2024-04-17T05:26:52.204982+0000","last_unstale":"2024-04-17T05:34:04.963465+0000","last_undegraded":"2024-04-17T05:34:04.963465+0000","last_fullsized":"2024-04-17T05:34:04.963465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-04-17T05:34:04.963235+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-04-17T05:34:04.963235+0000","last_clean_scrub_stamp":"2024-04-17T05:34:04.963235+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:05:17.025331+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"28'4","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:04.451332+0000","last_change":"2024-04-17T05:34:04.451447+0000","last_active":"2024-04-17T05:34:04.451332+0000","last_peered":"2024-04-17T05:34:04.451332+0000","last_clean":"2024-04-17T05:34:04.451332+0000","last_became_active":"2024-04-17T05:26:52.211242+0000","last_became_peered":"2024-04-17T05:26:52.211242+0000","last_unstale":"2024-04-17T05:34:04.451332+0000","last_undegraded":"2024-04-17T05:34:04.451332+0000","last_fullsized":"2024-04-17T05:34:04.451332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-04-17T05:34:04.451124+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-04-17T05:34:04.451124+0000","last_clean_scrub_stamp":"2024-04-17T05:34:04.451124+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:43:44.125074+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'7","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:07.413396+0000","last_change":"2024-04-17T05:34:07.413501+0000","last_active":"2024-04-17T05:34:07.413396+0000","last_peered":"2024-04-17T05:34:07.413396+0000","last_clean":"2024-04-17T05:34:07.413396+0000","last_became_active":"2024-04-17T05:26:53.239688+0000","last_became_peered":"2024-04-17T05:26:53.239688+0000","last_unstale":"2024-04-17T05:34:07.413396+0000","last_undegraded":"2024-04-17T05:34:07.413396+0000","last_fullsized":"2024-04-17T05:34:07.413396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-04-17T05:34:07.413138+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-04-17T05:34:07.413138+0000","last_clean_scrub_stamp":"2024-04-17T05:34:07.413138+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:01:27.257488+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:05.816090+0000","last_change":"2024-04-17T05:34:05.816146+0000","last_active":"2024-04-17T05:34:05.816090+0000","last_peered":"2024-04-17T05:34:05.816090+0000","last_clean":"2024-04-17T05:34:05.816090+0000","last_became_active":"2024-04-17T05:26:57.295730+0000","last_became_peered":"2024-04-17T05:26:57.295730+0000","last_unstale":"2024-04-17T05:34:05.816090+0000","last_undegraded":"2024-04-17T05:34:05.816090+0000","last_fullsized":"2024-04-17T05:34:05.816090+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:34:05.815925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:34:05.815925+0000","last_clean_scrub_stamp":"2024-04-17T05:34:05.815925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:19:19.323238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'3","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:05.944603+0000","last_change":"2024-04-17T05:34:05.944687+0000","last_active":"2024-04-17T05:34:05.944603+0000","last_peered":"2024-04-17T05:34:05.944603+0000","last_clean":"2024-04-17T05:34:05.944603+0000","last_became_active":"2024-04-17T05:26:52.214153+0000","last_became_peered":"2024-04-17T05:26:52.214153+0000","last_unstale":"2024-04-17T05:34:05.944603+0000","last_undegraded":"2024-04-17T05:34:05.944603+0000","last_fullsized":"2024-04-17T05:34:05.944603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-04-17T05:34:05.944440+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-04-17T05:34:05.944440+0000","last_clean_scrub_stamp":"2024-04-17T05:34:05.944440+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:51:50.393743+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'7","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:01.617057+0000","last_change":"2024-04-17T05:34:01.617124+0000","last_active":"2024-04-17T05:34:01.617057+0000","last_peered":"2024-04-17T05:34:01.617057+0000","last_clean":"2024-04-17T05:34:01.617057+0000","last_became_active":"2024-04-17T05:26:53.213566+0000","last_became_peered":"2024-04-17T05:26:53.213566+0000","last_unstale":"2024-04-17T05:34:01.617057+0000","last_undegraded":"2024-04-17T05:34:01.617057+0000","last_fullsized":"2024-04-17T05:34:01.617057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-04-17T05:34:01.616880+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-04-17T05:34:01.616880+0000","last_clean_scrub_stamp":"2024-04-17T05:34:01.616880+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:15:11.132643+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:13.882107+0000","last_change":"2024-04-17T05:34:13.882161+0000","last_active":"2024-04-17T05:34:13.882107+0000","last_peered":"2024-04-17T05:34:13.882107+0000","last_clean":"2024-04-17T05:34:13.882107+0000","last_became_active":"2024-04-17T05:26:57.305115+0000","last_became_peered":"2024-04-17T05:26:57.305115+0000","last_unstale":"2024-04-17T05:34:13.882107+0000","last_undegraded":"2024-04-17T05:34:13.882107+0000","last_fullsized":"2024-04-17T05:34:13.882107+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T05:34:13.881937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T05:34:13.881937+0000","last_clean_scrub_stamp":"2024-04-17T05:34:13.881937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T14:56:45.775304+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:08.396731+0000","last_change":"2024-04-17T05:34:08.396823+0000","last_active":"2024-04-17T05:34:08.396731+0000","last_peered":"2024-04-17T05:34:08.396731+0000","last_clean":"2024-04-17T05:34:08.396731+0000","last_became_active":"2024-04-17T05:26:53.231624+0000","last_became_peered":"2024-04-17T05:26:53.231624+0000","last_unstale":"2024-04-17T05:34:08.396731+0000","last_undegraded":"2024-04-17T05:34:08.396731+0000","last_fullsized":"2024-04-17T05:34:08.396731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-04-17T05:34:08.396549+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-04-17T05:34:08.396549+0000","last_clean_scrub_stamp":"2024-04-17T05:34:08.396549+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:09:21.523825+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:03.822358+0000","last_change":"2024-04-17T05:34:03.822422+0000","last_active":"2024-04-17T05:34:03.822358+0000","last_peered":"2024-04-17T05:34:03.822358+0000","last_clean":"2024-04-17T05:34:03.822358+0000","last_became_active":"2024-04-17T05:26:53.222128+0000","last_became_peered":"2024-04-17T05:26:53.222128+0000","last_unstale":"2024-04-17T05:34:03.822358+0000","last_undegraded":"2024-04-17T05:34:03.822358+0000","last_fullsized":"2024-04-17T05:34:03.822358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-04-17T05:34:03.822182+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-04-17T05:34:03.822182+0000","last_clean_scrub_stamp":"2024-04-17T05:34:03.822182+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:34:35.461139+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:02.049872+0000","last_change":"2024-04-17T05:34:02.049933+0000","last_active":"2024-04-17T05:34:02.049872+0000","last_peered":"2024-04-17T05:34:02.049872+0000","last_clean":"2024-04-17T05:34:02.049872+0000","last_became_active":"2024-04-17T05:26:53.233708+0000","last_became_peered":"2024-04-17T05:26:53.233708+0000","last_unstale":"2024-04-17T05:34:02.049872+0000","last_undegraded":"2024-04-17T05:34:02.049872+0000","last_fullsized":"2024-04-17T05:34:02.049872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-04-17T05:34:02.049695+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-04-17T05:34:02.049695+0000","last_clean_scrub_stamp":"2024-04-17T05:34:02.049695+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:10:25.951084+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"28'5","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:05.374263+0000","last_change":"2024-04-17T05:34:05.374328+0000","last_active":"2024-04-17T05:34:05.374263+0000","last_peered":"2024-04-17T05:34:05.374263+0000","last_clean":"2024-04-17T05:34:05.374263+0000","last_became_active":"2024-04-17T05:26:53.234387+0000","last_became_peered":"2024-04-17T05:26:53.234387+0000","last_unstale":"2024-04-17T05:34:05.374263+0000","last_undegraded":"2024-04-17T05:34:05.374263+0000","last_fullsized":"2024-04-17T05:34:05.374263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-04-17T05:34:05.374090+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-04-17T05:34:05.374090+0000","last_clean_scrub_stamp":"2024-04-17T05:34:05.374090+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:57:09.501211+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:01.009451+0000","last_change":"2024-04-17T05:34:01.009510+0000","last_active":"2024-04-17T05:34:01.009451+0000","last_peered":"2024-04-17T05:34:01.009451+0000","last_clean":"2024-04-17T05:34:01.009451+0000","last_became_active":"2024-04-17T05:26:53.236476+0000","last_became_peered":"2024-04-17T05:26:53.236476+0000","last_unstale":"2024-04-17T05:34:01.009451+0000","last_undegraded":"2024-04-17T05:34:01.009451+0000","last_fullsized":"2024-04-17T05:34:01.009451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-04-17T05:34:01.009337+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-04-17T05:34:01.009337+0000","last_clean_scrub_stamp":"2024-04-17T05:34:01.009337+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:25:47.398947+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:09.813835+0000","last_change":"2024-04-17T05:34:09.813894+0000","last_active":"2024-04-17T05:34:09.813835+0000","last_peered":"2024-04-17T05:34:09.813835+0000","last_clean":"2024-04-17T05:34:09.813835+0000","last_became_active":"2024-04-17T05:26:53.231335+0000","last_became_peered":"2024-04-17T05:26:53.231335+0000","last_unstale":"2024-04-17T05:34:09.813835+0000","last_undegraded":"2024-04-17T05:34:09.813835+0000","last_fullsized":"2024-04-17T05:34:09.813835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-04-17T05:34:09.813618+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-04-17T05:34:09.813618+0000","last_clean_scrub_stamp":"2024-04-17T05:34:09.813618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:54:22.889007+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"28'13","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:09.375239+0000","last_change":"2024-04-17T05:34:09.375307+0000","last_active":"2024-04-17T05:34:09.375239+0000","last_peered":"2024-04-17T05:34:09.375239+0000","last_clean":"2024-04-17T05:34:09.375239+0000","last_became_active":"2024-04-17T05:26:53.234582+0000","last_became_peered":"2024-04-17T05:26:53.234582+0000","last_unstale":"2024-04-17T05:34:09.375239+0000","last_undegraded":"2024-04-17T05:34:09.375239+0000","last_fullsized":"2024-04-17T05:34:09.375239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'13","last_scrub_stamp":"2024-04-17T05:34:09.375005+0000","last_deep_scrub":"28'13","last_deep_scrub_stamp":"2024-04-17T05:34:09.375005+0000","last_clean_scrub_stamp":"2024-04-17T05:34:09.375005+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:12:15.297424+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'7","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:11.884249+0000","last_change":"2024-04-17T05:34:11.884305+0000","last_active":"2024-04-17T05:34:11.884249+0000","last_peered":"2024-04-17T05:34:11.884249+0000","last_clean":"2024-04-17T05:34:11.884249+0000","last_became_active":"2024-04-17T05:26:53.244910+0000","last_became_peered":"2024-04-17T05:26:53.244910+0000","last_unstale":"2024-04-17T05:34:11.884249+0000","last_undegraded":"2024-04-17T05:34:11.884249+0000","last_fullsized":"2024-04-17T05:34:11.884249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-04-17T05:34:11.884083+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-04-17T05:34:11.884083+0000","last_clean_scrub_stamp":"2024-04-17T05:34:11.884083+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:54:33.491990+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'9","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:07.839105+0000","last_change":"2024-04-17T05:34:07.839105+0000","last_active":"2024-04-17T05:34:07.839105+0000","last_peered":"2024-04-17T05:34:07.839105+0000","last_clean":"2024-04-17T05:34:07.839105+0000","last_became_active":"2024-04-17T05:27:39.626252+0000","last_became_peered":"2024-04-17T05:27:39.626252+0000","last_unstale":"2024-04-17T05:34:07.839105+0000","last_undegraded":"2024-04-17T05:34:07.839105+0000","last_fullsized":"2024-04-17T05:34:07.839105+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-04-17T05:34:07.838879+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-04-17T05:34:07.838879+0000","last_clean_scrub_stamp":"2024-04-17T05:34:07.838879+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:59:17.142331+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"28'9","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:10.878370+0000","last_change":"2024-04-17T05:34:10.878428+0000","last_active":"2024-04-17T05:34:10.878370+0000","last_peered":"2024-04-17T05:34:10.878370+0000","last_clean":"2024-04-17T05:34:10.878370+0000","last_became_active":"2024-04-17T05:26:53.236386+0000","last_became_peered":"2024-04-17T05:26:53.236386+0000","last_unstale":"2024-04-17T05:34:10.878370+0000","last_undegraded":"2024-04-17T05:34:10.878370+0000","last_fullsized":"2024-04-17T05:34:10.878370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-04-17T05:34:10.878189+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-04-17T05:34:10.878189+0000","last_clean_scrub_stamp":"2024-04-17T05:34:10.878189+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T13:37:32.310839+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"28'13","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:15.959383+0000","last_change":"2024-04-17T05:34:15.959493+0000","last_active":"2024-04-17T05:34:15.959383+0000","last_peered":"2024-04-17T05:34:15.959383+0000","last_clean":"2024-04-17T05:34:15.959383+0000","last_became_active":"2024-04-17T05:26:53.242213+0000","last_became_peered":"2024-04-17T05:26:53.242213+0000","last_unstale":"2024-04-17T05:34:15.959383+0000","last_undegraded":"2024-04-17T05:34:15.959383+0000","last_fullsized":"2024-04-17T05:34:15.959383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'13","last_scrub_stamp":"2024-04-17T05:34:15.959180+0000","last_deep_scrub":"28'13","last_deep_scrub_stamp":"2024-04-17T05:34:15.959180+0000","last_clean_scrub_stamp":"2024-04-17T05:34:15.959180+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:20:09.428826+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"28'11","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:04.411030+0000","last_change":"2024-04-17T05:34:04.411088+0000","last_active":"2024-04-17T05:34:04.411030+0000","last_peered":"2024-04-17T05:34:04.411030+0000","last_clean":"2024-04-17T05:34:04.411030+0000","last_became_active":"2024-04-17T05:26:53.230146+0000","last_became_peered":"2024-04-17T05:26:53.230146+0000","last_unstale":"2024-04-17T05:34:04.411030+0000","last_undegraded":"2024-04-17T05:34:04.411030+0000","last_fullsized":"2024-04-17T05:34:04.411030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'11","last_scrub_stamp":"2024-04-17T05:34:04.410857+0000","last_deep_scrub":"28'11","last_deep_scrub_stamp":"2024-04-17T05:34:04.410857+0000","last_clean_scrub_stamp":"2024-04-17T05:34:04.410857+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:21:18.735240+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:13.400018+0000","last_change":"2024-04-17T05:34:13.400082+0000","last_active":"2024-04-17T05:34:13.400018+0000","last_peered":"2024-04-17T05:34:13.400018+0000","last_clean":"2024-04-17T05:34:13.400018+0000","last_became_active":"2024-04-17T05:26:53.252280+0000","last_became_peered":"2024-04-17T05:26:53.252280+0000","last_unstale":"2024-04-17T05:34:13.400018+0000","last_undegraded":"2024-04-17T05:34:13.400018+0000","last_fullsized":"2024-04-17T05:34:13.400018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-04-17T05:34:13.399842+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-04-17T05:34:13.399842+0000","last_clean_scrub_stamp":"2024-04-17T05:34:13.399842+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:00:39.992860+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"28'7","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:11.257649+0000","last_change":"2024-04-17T05:34:11.257709+0000","last_active":"2024-04-17T05:34:11.257649+0000","last_peered":"2024-04-17T05:34:11.257649+0000","last_clean":"2024-04-17T05:34:11.257649+0000","last_became_active":"2024-04-17T05:26:53.242046+0000","last_became_peered":"2024-04-17T05:26:53.242046+0000","last_unstale":"2024-04-17T05:34:11.257649+0000","last_undegraded":"2024-04-17T05:34:11.257649+0000","last_fullsized":"2024-04-17T05:34:11.257649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-04-17T05:34:11.257469+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-04-17T05:34:11.257469+0000","last_clean_scrub_stamp":"2024-04-17T05:34:11.257469+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T15:13:47.987764+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"28'12","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:04.829917+0000","last_change":"2024-04-17T05:34:04.829984+0000","last_active":"2024-04-17T05:34:04.829917+0000","last_peered":"2024-04-17T05:34:04.829917+0000","last_clean":"2024-04-17T05:34:04.829917+0000","last_became_active":"2024-04-17T05:26:53.227572+0000","last_became_peered":"2024-04-17T05:26:53.227572+0000","last_unstale":"2024-04-17T05:34:04.829917+0000","last_undegraded":"2024-04-17T05:34:04.829917+0000","last_fullsized":"2024-04-17T05:34:04.829917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2024-04-17T05:34:04.829737+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2024-04-17T05:34:04.829737+0000","last_clean_scrub_stamp":"2024-04-17T05:34:04.829737+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:18:07.830954+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:10.020324+0000","last_change":"2024-04-17T05:34:10.020432+0000","last_active":"2024-04-17T05:34:10.020324+0000","last_peered":"2024-04-17T05:34:10.020324+0000","last_clean":"2024-04-17T05:34:10.020324+0000","last_became_active":"2024-04-17T05:26:53.225983+0000","last_became_peered":"2024-04-17T05:26:53.225983+0000","last_unstale":"2024-04-17T05:34:10.020324+0000","last_undegraded":"2024-04-17T05:34:10.020324+0000","last_fullsized":"2024-04-17T05:34:10.020324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-04-17T05:34:10.020036+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-04-17T05:34:10.020036+0000","last_clean_scrub_stamp":"2024-04-17T05:34:10.020036+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T09:29:38.324460+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"28'11","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:03.025655+0000","last_change":"2024-04-17T05:34:03.025714+0000","last_active":"2024-04-17T05:34:03.025655+0000","last_peered":"2024-04-17T05:34:03.025655+0000","last_clean":"2024-04-17T05:34:03.025655+0000","last_became_active":"2024-04-17T05:26:53.229888+0000","last_became_peered":"2024-04-17T05:26:53.229888+0000","last_unstale":"2024-04-17T05:34:03.025655+0000","last_undegraded":"2024-04-17T05:34:03.025655+0000","last_fullsized":"2024-04-17T05:34:03.025655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'11","last_scrub_stamp":"2024-04-17T05:34:03.025486+0000","last_deep_scrub":"28'11","last_deep_scrub_stamp":"2024-04-17T05:34:03.025486+0000","last_clean_scrub_stamp":"2024-04-17T05:34:03.025486+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:05:56.641650+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:04.834793+0000","last_change":"2024-04-17T05:34:04.834851+0000","last_active":"2024-04-17T05:34:04.834793+0000","last_peered":"2024-04-17T05:34:04.834793+0000","last_clean":"2024-04-17T05:34:04.834793+0000","last_became_active":"2024-04-17T05:26:53.208394+0000","last_became_peered":"2024-04-17T05:26:53.208394+0000","last_unstale":"2024-04-17T05:34:04.834793+0000","last_undegraded":"2024-04-17T05:34:04.834793+0000","last_fullsized":"2024-04-17T05:34:04.834793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-04-17T05:34:04.834595+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-04-17T05:34:04.834595+0000","last_clean_scrub_stamp":"2024-04-17T05:34:04.834595+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:24:54.380670+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"28'5","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:03.367993+0000","last_change":"2024-04-17T05:34:03.368057+0000","last_active":"2024-04-17T05:34:03.367993+0000","last_peered":"2024-04-17T05:34:03.367993+0000","last_clean":"2024-04-17T05:34:03.367993+0000","last_became_active":"2024-04-17T05:26:53.224314+0000","last_became_peered":"2024-04-17T05:26:53.224314+0000","last_unstale":"2024-04-17T05:34:03.367993+0000","last_undegraded":"2024-04-17T05:34:03.367993+0000","last_fullsized":"2024-04-17T05:34:03.367993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-04-17T05:34:03.367765+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-04-17T05:34:03.367765+0000","last_clean_scrub_stamp":"2024-04-17T05:34:03.367765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:05:38.575412+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"28'10","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:09.878299+0000","last_change":"2024-04-17T05:34:09.878299+0000","last_active":"2024-04-17T05:34:09.878299+0000","last_peered":"2024-04-17T05:34:09.878299+0000","last_clean":"2024-04-17T05:34:09.878299+0000","last_became_active":"2024-04-17T05:26:53.233885+0000","last_became_peered":"2024-04-17T05:26:53.233885+0000","last_unstale":"2024-04-17T05:34:09.878299+0000","last_undegraded":"2024-04-17T05:34:09.878299+0000","last_fullsized":"2024-04-17T05:34:09.878299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-04-17T05:34:09.878118+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-04-17T05:34:09.878118+0000","last_clean_scrub_stamp":"2024-04-17T05:34:09.878118+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:10:47.698326+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:04.558612+0000","last_change":"2024-04-17T05:34:04.558612+0000","last_active":"2024-04-17T05:34:04.558612+0000","last_peered":"2024-04-17T05:34:04.558612+0000","last_clean":"2024-04-17T05:34:04.558612+0000","last_became_active":"2024-04-17T05:26:53.232809+0000","last_became_peered":"2024-04-17T05:26:53.232809+0000","last_unstale":"2024-04-17T05:34:04.558612+0000","last_undegraded":"2024-04-17T05:34:04.558612+0000","last_fullsized":"2024-04-17T05:34:04.558612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-04-17T05:34:04.558367+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-04-17T05:34:04.558367+0000","last_clean_scrub_stamp":"2024-04-17T05:34:04.558367+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T10:10:06.277174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:12.426370+0000","last_change":"2024-04-17T05:34:12.426442+0000","last_active":"2024-04-17T05:34:12.426370+0000","last_peered":"2024-04-17T05:34:12.426370+0000","last_clean":"2024-04-17T05:34:12.426370+0000","last_became_active":"2024-04-17T05:26:53.245051+0000","last_became_peered":"2024-04-17T05:26:53.245051+0000","last_unstale":"2024-04-17T05:34:12.426370+0000","last_undegraded":"2024-04-17T05:34:12.426370+0000","last_fullsized":"2024-04-17T05:34:12.426370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-04-17T05:34:12.426192+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-04-17T05:34:12.426192+0000","last_clean_scrub_stamp":"2024-04-17T05:34:12.426192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T08:31:21.866591+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"28'16","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:10.387065+0000","last_change":"2024-04-17T05:34:10.387065+0000","last_active":"2024-04-17T05:34:10.387065+0000","last_peered":"2024-04-17T05:34:10.387065+0000","last_clean":"2024-04-17T05:34:10.387065+0000","last_became_active":"2024-04-17T05:26:53.241108+0000","last_became_peered":"2024-04-17T05:26:53.241108+0000","last_unstale":"2024-04-17T05:34:10.387065+0000","last_undegraded":"2024-04-17T05:34:10.387065+0000","last_fullsized":"2024-04-17T05:34:10.387065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'16","last_scrub_stamp":"2024-04-17T05:34:10.386824+0000","last_deep_scrub":"28'16","last_deep_scrub_stamp":"2024-04-17T05:34:10.386824+0000","last_clean_scrub_stamp":"2024-04-17T05:34:10.386824+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:45:49.210574+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"28'9","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:18.355177+0000","last_change":"2024-04-17T05:34:18.355237+0000","last_active":"2024-04-17T05:34:18.355177+0000","last_peered":"2024-04-17T05:34:18.355177+0000","last_clean":"2024-04-17T05:34:18.355177+0000","last_became_active":"2024-04-17T05:27:39.897830+0000","last_became_peered":"2024-04-17T05:27:39.897830+0000","last_unstale":"2024-04-17T05:34:18.355177+0000","last_undegraded":"2024-04-17T05:34:18.355177+0000","last_fullsized":"2024-04-17T05:34:18.355177+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-04-17T05:34:18.354969+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-04-17T05:34:18.354969+0000","last_clean_scrub_stamp":"2024-04-17T05:34:18.354969+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:09:35.636698+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'6","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:01.983620+0000","last_change":"2024-04-17T05:34:01.983687+0000","last_active":"2024-04-17T05:34:01.983620+0000","last_peered":"2024-04-17T05:34:01.983620+0000","last_clean":"2024-04-17T05:34:01.983620+0000","last_became_active":"2024-04-17T05:26:53.243625+0000","last_became_peered":"2024-04-17T05:26:53.243625+0000","last_unstale":"2024-04-17T05:34:01.983620+0000","last_undegraded":"2024-04-17T05:34:01.983620+0000","last_fullsized":"2024-04-17T05:34:01.983620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-04-17T05:34:01.983487+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-04-17T05:34:01.983487+0000","last_clean_scrub_stamp":"2024-04-17T05:34:01.983487+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:21:11.145693+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"28'5","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:12.268687+0000","last_change":"2024-04-17T05:34:12.268744+0000","last_active":"2024-04-17T05:34:12.268687+0000","last_peered":"2024-04-17T05:34:12.268687+0000","last_clean":"2024-04-17T05:34:12.268687+0000","last_became_active":"2024-04-17T05:26:53.246286+0000","last_became_peered":"2024-04-17T05:26:53.246286+0000","last_unstale":"2024-04-17T05:34:12.268687+0000","last_undegraded":"2024-04-17T05:34:12.268687+0000","last_fullsized":"2024-04-17T05:34:12.268687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-04-17T05:34:12.268507+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-04-17T05:34:12.268507+0000","last_clean_scrub_stamp":"2024-04-17T05:34:12.268507+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:04:49.914957+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'5","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:11.050623+0000","last_change":"2024-04-17T05:34:11.050682+0000","last_active":"2024-04-17T05:34:11.050623+0000","last_peered":"2024-04-17T05:34:11.050623+0000","last_clean":"2024-04-17T05:34:11.050623+0000","last_became_active":"2024-04-17T05:26:53.228706+0000","last_became_peered":"2024-04-17T05:26:53.228706+0000","last_unstale":"2024-04-17T05:34:11.050623+0000","last_undegraded":"2024-04-17T05:34:11.050623+0000","last_fullsized":"2024-04-17T05:34:11.050623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-04-17T05:34:11.050444+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-04-17T05:34:11.050444+0000","last_clean_scrub_stamp":"2024-04-17T05:34:11.050444+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:07:22.305597+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'6","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:03.228070+0000","last_change":"2024-04-17T05:34:03.228130+0000","last_active":"2024-04-17T05:34:03.228070+0000","last_peered":"2024-04-17T05:34:03.228070+0000","last_clean":"2024-04-17T05:34:03.228070+0000","last_became_active":"2024-04-17T05:26:53.244595+0000","last_became_peered":"2024-04-17T05:26:53.244595+0000","last_unstale":"2024-04-17T05:34:03.228070+0000","last_undegraded":"2024-04-17T05:34:03.228070+0000","last_fullsized":"2024-04-17T05:34:03.228070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-04-17T05:34:03.227898+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-04-17T05:34:03.227898+0000","last_clean_scrub_stamp":"2024-04-17T05:34:03.227898+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T11:10:36.242499+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"28'6","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:15.006193+0000","last_change":"2024-04-17T05:34:15.006301+0000","last_active":"2024-04-17T05:34:15.006193+0000","last_peered":"2024-04-17T05:34:15.006193+0000","last_clean":"2024-04-17T05:34:15.006193+0000","last_became_active":"2024-04-17T05:26:53.241292+0000","last_became_peered":"2024-04-17T05:26:53.241292+0000","last_unstale":"2024-04-17T05:34:15.006193+0000","last_undegraded":"2024-04-17T05:34:15.006193+0000","last_fullsized":"2024-04-17T05:34:15.006193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-04-17T05:34:15.005964+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-04-17T05:34:15.005964+0000","last_clean_scrub_stamp":"2024-04-17T05:34:15.005964+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T16:27:22.717104+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"28'8","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:02.383879+0000","last_change":"2024-04-17T05:34:02.383900+0000","last_active":"2024-04-17T05:34:02.383879+0000","last_peered":"2024-04-17T05:34:02.383879+0000","last_clean":"2024-04-17T05:34:02.383879+0000","last_became_active":"2024-04-17T05:26:53.220445+0000","last_became_peered":"2024-04-17T05:26:53.220445+0000","last_unstale":"2024-04-17T05:34:02.383879+0000","last_undegraded":"2024-04-17T05:34:02.383879+0000","last_fullsized":"2024-04-17T05:34:02.383879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-04-17T05:34:02.383808+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-04-17T05:34:02.383808+0000","last_clean_scrub_stamp":"2024-04-17T05:34:02.383808+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:21:11.546013+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'4","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:05.840814+0000","last_change":"2024-04-17T05:34:05.840882+0000","last_active":"2024-04-17T05:34:05.840814+0000","last_peered":"2024-04-17T05:34:05.840814+0000","last_clean":"2024-04-17T05:34:05.840814+0000","last_became_active":"2024-04-17T05:26:53.214591+0000","last_became_peered":"2024-04-17T05:26:53.214591+0000","last_unstale":"2024-04-17T05:34:05.840814+0000","last_undegraded":"2024-04-17T05:34:05.840814+0000","last_fullsized":"2024-04-17T05:34:05.840814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-04-17T05:34:05.840624+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-04-17T05:34:05.840624+0000","last_clean_scrub_stamp":"2024-04-17T05:34:05.840624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T12:05:17.902719+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"28'10","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-17T05:34:13.265536+0000","last_change":"2024-04-17T05:34:13.265646+0000","last_active":"2024-04-17T05:34:13.265536+0000","last_peered":"2024-04-17T05:34:13.265536+0000","last_clean":"2024-04-17T05:34:13.265536+0000","last_became_active":"2024-04-17T05:26:53.248143+0000","last_became_peered":"2024-04-17T05:26:53.248143+0000","last_unstale":"2024-04-17T05:34:13.265536+0000","last_undegraded":"2024-04-17T05:34:13.265536+0000","last_fullsized":"2024-04-17T05:34:13.265536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-04-17T05:34:13.265269+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-04-17T05:34:13.265269+0000","last_clean_scrub_stamp":"2024-04-17T05:34:13.265269+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T17:23:23.616268+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":945903,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":397,"num_write_kb":1123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1949696,"data_stored":1891806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":406,"ondisk_log_size":406,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542239,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":897024,"data_stored":713306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542238,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1241088,"data_stored":1056638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542239,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":122446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542238,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":122482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542240,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1253376,"data_stored":1067461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542238,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":133179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542239,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":122516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542238,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":905216,"data_stored":713362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":10823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":954368,"data_stored":945105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":942080,"data_stored":934282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T05:34:23.345 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-17T05:34:23.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.585+0000 7fe756600640 1 Processor -- start 2024-04-17T05:34:23.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.585+0000 7fe756600640 1 -- start start 2024-04-17T05:34:23.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.586+0000 7fe756600640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe7500b4f00 0x7fe75014a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:23.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.586+0000 7fe756600640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe75006e050 con 0x7fe75006dc70 2024-04-17T05:34:23.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.586+0000 7fe756600640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7500b4700 con 0x7fe75014aca0 2024-04-17T05:34:23.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.586+0000 7fe756600640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7fe75014b7b0 con 0x7fe7500b4f00 2024-04-17T05:34:23.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.587+0000 7fe755200640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe75006dc70 0x7fe75006cdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40442/0 (socket says 172.21.15.123:40442) 2024-04-17T05:34:23.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.587+0000 7fe755200640 1 -- 172.21.15.123:0/3751442592 learned_addr learned my addr 172.21.15.123:0/3751442592 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:34:23.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.587+0000 7fe74fe00640 1 --2- 172.21.15.123:0/3751442592 >> v2:172.21.15.164:3300/0 conn(0x7fe7500b4f00 0x7fe75014a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:23.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.587+0000 7fe74f400640 1 -- 172.21.15.123:0/3751442592 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2285088636 0 0) 0x7fe75006e050 con 0x7fe75006dc70 2024-04-17T05:34:23.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.587+0000 7fe74f400640 1 -- 172.21.15.123:0/3751442592 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe738003520 con 0x7fe75006dc70 2024-04-17T05:34:23.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.588+0000 7fe74f400640 1 -- 172.21.15.123:0/3751442592 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3949367713 0 0) 0x7fe738003520 con 0x7fe75006dc70 2024-04-17T05:34:23.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.588+0000 7fe74f400640 1 -- 172.21.15.123:0/3751442592 >> v2:172.21.15.164:3300/0 conn(0x7fe7500b4f00 msgr2=0x7fe75014a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:23.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.588+0000 7fe74f400640 1 --2- 172.21.15.123:0/3751442592 >> v2:172.21.15.164:3300/0 conn(0x7fe7500b4f00 0x7fe75014a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:23.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.588+0000 7fe74f400640 1 -- 172.21.15.123:0/3751442592 >> v1:172.21.15.164:6789/0 conn(0x7fe75014aca0 legacy=0x7fe75014b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:23.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.588+0000 7fe74f400640 1 -- 172.21.15.123:0/3751442592 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe75014b930 con 0x7fe75006dc70 2024-04-17T05:34:23.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.588+0000 7fe74f400640 1 -- 172.21.15.123:0/3751442592 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1042962670 0 0) 0x7fe744001670 con 0x7fe75006dc70 2024-04-17T05:34:23.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.588+0000 7fe74f400640 1 -- 172.21.15.123:0/3751442592 >> v1:172.21.15.123:6789/0 conn(0x7fe75006dc70 legacy=0x7fe75006cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:23.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.588+0000 7fe74f400640 1 --2- 172.21.15.123:0/3751442592 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe738003a00 0x7fe738003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:23.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.588+0000 7fe74f400640 1 --2- 172.21.15.123:0/3751442592 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe738004800 0x7fe738004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:23.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.588+0000 7fe74f400640 1 --2- 172.21.15.123:0/3751442592 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7380052e0 0x7fe73800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:23.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.588+0000 7fe74f400640 1 -- 172.21.15.123:0/3751442592 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe75014b7b0 con 0x7fe7380052e0 2024-04-17T05:34:23.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.588+0000 7fe74f400640 1 -- 172.21.15.123:0/3751442592 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe73800c1e0 con 0x7fe738003a00 2024-04-17T05:34:23.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.588+0000 7fe74f400640 1 -- 172.21.15.123:0/3751442592 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fe73800c3e0 con 0x7fe738004800 2024-04-17T05:34:23.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.588+0000 7fe755c00640 1 --2- 172.21.15.123:0/3751442592 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7380052e0 0x7fe73800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:23.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.588+0000 7fe74fe00640 1 --2- 172.21.15.123:0/3751442592 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe738004800 0x7fe738004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:23.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.588+0000 7fe755200640 1 --2- 172.21.15.123:0/3751442592 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe738003a00 0x7fe738003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:23.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.588+0000 7fe755c00640 1 -- 172.21.15.123:0/3751442592 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe738004800 msgr2=0x7fe738004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:23.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.588+0000 7fe755c00640 1 --2- 172.21.15.123:0/3751442592 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe738004800 0x7fe738004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:23.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.588+0000 7fe755c00640 1 -- 172.21.15.123:0/3751442592 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe738003a00 msgr2=0x7fe738003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:23.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.589+0000 7fe755c00640 1 --2- 172.21.15.123:0/3751442592 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe738003a00 0x7fe738003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:23.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.589+0000 7fe755c00640 1 -- 172.21.15.123:0/3751442592 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe738003520 con 0x7fe7380052e0 2024-04-17T05:34:23.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.589+0000 7fe74fe00640 1 --2- 172.21.15.123:0/3751442592 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe738004800 0x7fe738004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:34:23.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.589+0000 7fe755200640 1 --2- 172.21.15.123:0/3751442592 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe738003a00 0x7fe738003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:34:23.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.589+0000 7fe755c00640 1 -- 172.21.15.123:0/3751442592 reap_dead start 2024-04-17T05:34:23.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.590+0000 7fe755c00640 1 --2- 172.21.15.123:0/3751442592 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7380052e0 0x7fe73800b9c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe748001e50 tx=0x7fe738005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d3b272cb84d793 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:23.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.590+0000 7fe74f400640 1 -- 172.21.15.123:0/3751442592 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe748001a70 con 0x7fe7380052e0 2024-04-17T05:34:23.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.590+0000 7fe74f400640 1 -- 172.21.15.123:0/3751442592 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe748003b90 con 0x7fe7380052e0 2024-04-17T05:34:23.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.590+0000 7fe74f400640 1 -- 172.21.15.123:0/3751442592 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7480050d0 con 0x7fe7380052e0 2024-04-17T05:34:23.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.590+0000 7fe756600640 1 -- 172.21.15.123:0/3751442592 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7380052e0 msgr2=0x7fe73800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:23.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.590+0000 7fe756600640 1 --2- 172.21.15.123:0/3751442592 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7380052e0 0x7fe73800b9c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe748001e50 tx=0x7fe738005830 comp rx=0 tx=0).stop 2024-04-17T05:34:23.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.591+0000 7fe756600640 1 -- 172.21.15.123:0/3751442592 shutdown_connections 2024-04-17T05:34:23.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.591+0000 7fe756600640 1 --2- 172.21.15.123:0/3751442592 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7380052e0 0x7fe73800b9c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:23.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.591+0000 7fe756600640 1 -- 172.21.15.123:0/3751442592 >> 172.21.15.123:0/3751442592 conn(0x7fe75006c430 msgr2=0x7fe7500b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:23.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.591+0000 7fe756600640 1 -- 172.21.15.123:0/3751442592 shutdown_connections 2024-04-17T05:34:23.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.591+0000 7fe756600640 1 -- 172.21.15.123:0/3751442592 wait complete. 2024-04-17T05:34:23.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.592+0000 7fe756600640 1 Processor -- start 2024-04-17T05:34:23.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.592+0000 7fe756600640 1 -- start start 2024-04-17T05:34:23.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.593+0000 7fe756600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7380052e0 0x7fe750071600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:23.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.593+0000 7fe756600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe750071b40 0x7fe7500700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:23.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.593+0000 7fe756600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe7500b3360 0x7fe750070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:23.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.593+0000 7fe756600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe75014a760 con 0x7fe750071b40 2024-04-17T05:34:23.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.593+0000 7fe756600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe7500b41a0 con 0x7fe7380052e0 2024-04-17T05:34:23.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.593+0000 7fe756600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fe75014a8e0 con 0x7fe7500b3360 2024-04-17T05:34:23.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.593+0000 7fe74fe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe750071b40 0x7fe7500700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:23.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.593+0000 7fe74fe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe750071b40 0x7fe7500700c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60802/0 (socket says 172.21.15.123:60802) 2024-04-17T05:34:23.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.593+0000 7fe74fe00640 1 -- 172.21.15.123:0/2554964084 learned_addr learned my addr 172.21.15.123:0/2554964084 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:34:23.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.594+0000 7fe755200640 1 --2- 172.21.15.123:0/2554964084 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7380052e0 0x7fe750071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:23.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.594+0000 7fe755c00640 1 --2- 172.21.15.123:0/2554964084 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe7500b3360 0x7fe750070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:23.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.594+0000 7fe74fe00640 1 -- 172.21.15.123:0/2554964084 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe7500b3360 msgr2=0x7fe750070600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:23.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.594+0000 7fe74fe00640 1 --2- 172.21.15.123:0/2554964084 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe7500b3360 0x7fe750070600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:23.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.594+0000 7fe74fe00640 1 -- 172.21.15.123:0/2554964084 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7380052e0 msgr2=0x7fe750071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:23.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.594+0000 7fe74fe00640 1 --2- 172.21.15.123:0/2554964084 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7380052e0 0x7fe750071600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:23.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.594+0000 7fe74fe00640 1 -- 172.21.15.123:0/2554964084 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7501e0a70 con 0x7fe750071b40 2024-04-17T05:34:23.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.594+0000 7fe74fe00640 1 --2- 172.21.15.123:0/2554964084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe750071b40 0x7fe7500700c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe73c0108b0 tx=0x7fe73c010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:23.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.594+0000 7fe74cc00640 1 -- 172.21.15.123:0/2554964084 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe73c00f040 con 0x7fe750071b40 2024-04-17T05:34:23.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.594+0000 7fe74cc00640 1 -- 172.21.15.123:0/2554964084 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe73c00eb60 con 0x7fe750071b40 2024-04-17T05:34:23.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.594+0000 7fe74cc00640 1 -- 172.21.15.123:0/2554964084 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe73c01c400 con 0x7fe750071b40 2024-04-17T05:34:23.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.594+0000 7fe756600640 1 -- 172.21.15.123:0/2554964084 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7501e0d50 con 0x7fe750071b40 2024-04-17T05:34:23.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.595+0000 7fe756600640 1 -- 172.21.15.123:0/2554964084 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7501425c0 con 0x7fe750071b40 2024-04-17T05:34:23.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.596+0000 7fe756600640 1 -- 172.21.15.123:0/2554964084 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe750075b30 con 0x7fe750071b40 2024-04-17T05:34:23.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.597+0000 7fe74cc00640 1 -- 172.21.15.123:0/2554964084 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe73c01c5a0 con 0x7fe750071b40 2024-04-17T05:34:23.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.597+0000 7fe74cc00640 1 --2- 172.21.15.123:0/2554964084 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe73006c920 0x7fe73006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:23.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.598+0000 7fe74cc00640 1 -- 172.21.15.123:0/2554964084 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fe73c08c660 con 0x7fe750071b40 2024-04-17T05:34:23.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.598+0000 7fe755200640 1 --2- 172.21.15.123:0/2554964084 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe73006c920 0x7fe73006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:23.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.599+0000 7fe755200640 1 --2- 172.21.15.123:0/2554964084 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe73006c920 0x7fe73006ede0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe744007810 tx=0x7fe744000f30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:23.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.603+0000 7fe74cc00640 1 -- 172.21.15.123:0/2554964084 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fe73c018030 con 0x7fe750071b40 2024-04-17T05:34:23.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.807+0000 7fe756600640 1 -- 172.21.15.123:0/2554964084 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fe7500b44c0 con 0x7fe750071b40 2024-04-17T05:34:23.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.813+0000 7fe74cc00640 1 -- 172.21.15.123:0/2554964084 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7fe73c05a660 con 0x7fe750071b40 2024-04-17T05:34:23.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.814+0000 7fe74cc00640 1 -- 172.21.15.123:0/2554964084 <== mon.0 v2:172.21.15.123:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe73c059f60 con 0x7fe750071b40 2024-04-17T05:34:23.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.817+0000 7fe756600640 1 -- 172.21.15.123:0/2554964084 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe73006c920 msgr2=0x7fe73006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:23.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.817+0000 7fe756600640 1 --2- 172.21.15.123:0/2554964084 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe73006c920 0x7fe73006ede0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe744007810 tx=0x7fe744000f30 comp rx=0 tx=0).stop 2024-04-17T05:34:23.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.817+0000 7fe756600640 1 -- 172.21.15.123:0/2554964084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe750071b40 msgr2=0x7fe7500700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:23.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.817+0000 7fe756600640 1 --2- 172.21.15.123:0/2554964084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe750071b40 0x7fe7500700c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe73c0108b0 tx=0x7fe73c010d70 comp rx=0 tx=0).stop 2024-04-17T05:34:23.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.817+0000 7fe756600640 1 -- 172.21.15.123:0/2554964084 shutdown_connections 2024-04-17T05:34:23.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.817+0000 7fe756600640 1 --2- 172.21.15.123:0/2554964084 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fe73006c920 0x7fe73006ede0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:23.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.817+0000 7fe756600640 1 --2- 172.21.15.123:0/2554964084 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe7500b3360 0x7fe750070600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:23.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.817+0000 7fe756600640 1 --2- 172.21.15.123:0/2554964084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe750071b40 0x7fe7500700c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:23.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.817+0000 7fe756600640 1 --2- 172.21.15.123:0/2554964084 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe7380052e0 0x7fe750071600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:23.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.817+0000 7fe756600640 1 -- 172.21.15.123:0/2554964084 >> 172.21.15.123:0/2554964084 conn(0x7fe75006c430 msgr2=0x7fe750149bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:23.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.817+0000 7fe756600640 1 -- 172.21.15.123:0/2554964084 shutdown_connections 2024-04-17T05:34:23.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:23.817+0000 7fe756600640 1 -- 172.21.15.123:0/2554964084 wait complete. 2024-04-17T05:34:23.833 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-17T05:34:23.833 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T05:34:24.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.040+0000 7f98bf200640 1 Processor -- start 2024-04-17T05:34:24.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.040+0000 7f98bf200640 1 -- start start 2024-04-17T05:34:24.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.041+0000 7f98bf200640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f98c00ba6a0 0x7f98c00b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:24.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.041+0000 7f98bf200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f98c0141a00 0x7f98c0141e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:24.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.041+0000 7f98bf200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98c0148240 con 0x7f98c00b9a80 2024-04-17T05:34:24.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.041+0000 7f98bf200640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f98c00b5e10 con 0x7f98c00ba6a0 2024-04-17T05:34:24.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.041+0000 7f98bf200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f98c00b71d0 con 0x7f98c0141a00 2024-04-17T05:34:24.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.041+0000 7f98b7e00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f98c00b9a80 0x7f98c0147b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40446/0 (socket says 172.21.15.123:40446) 2024-04-17T05:34:24.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.041+0000 7f98b7e00640 1 -- 172.21.15.123:0/1893869232 learned_addr learned my addr 172.21.15.123:0/1893869232 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:34:24.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.042+0000 7f98bde00640 1 --2- 172.21.15.123:0/1893869232 >> v2:172.21.15.164:3300/0 conn(0x7f98c00ba6a0 0x7f98c00b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:24.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.042+0000 7f98be800640 1 --2- 172.21.15.123:0/1893869232 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f98c0141a00 0x7f98c0141e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:24.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.042+0000 7f98bd400640 1 -- 172.21.15.123:0/1893869232 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3777764774 0 0) 0x7f98c0148240 con 0x7f98c00b9a80 2024-04-17T05:34:24.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.042+0000 7f98bd400640 1 -- 172.21.15.123:0/1893869232 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98a4003520 con 0x7f98c00b9a80 2024-04-17T05:34:24.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.042+0000 7f98bd400640 1 -- 172.21.15.123:0/1893869232 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3062318454 0 0) 0x7f98a4003520 con 0x7f98c00b9a80 2024-04-17T05:34:24.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.042+0000 7f98bd400640 1 -- 172.21.15.123:0/1893869232 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f98c0141a00 msgr2=0x7f98c0141e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:24.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.042+0000 7f98bd400640 1 --2- 172.21.15.123:0/1893869232 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f98c0141a00 0x7f98c0141e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:24.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.042+0000 7f98bd400640 1 -- 172.21.15.123:0/1893869232 >> v2:172.21.15.164:3300/0 conn(0x7f98c00ba6a0 msgr2=0x7f98c00b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:24.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.042+0000 7f98bd400640 1 --2- 172.21.15.123:0/1893869232 >> v2:172.21.15.164:3300/0 conn(0x7f98c00ba6a0 0x7f98c00b48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:24.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.042+0000 7f98bd400640 1 -- 172.21.15.123:0/1893869232 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98c00b57e0 con 0x7f98c00b9a80 2024-04-17T05:34:24.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.042+0000 7f98bd400640 1 -- 172.21.15.123:0/1893869232 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1042962670 0 0) 0x7f98a8001670 con 0x7f98c00b9a80 2024-04-17T05:34:24.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.042+0000 7f98bd400640 1 -- 172.21.15.123:0/1893869232 >> v1:172.21.15.123:6789/0 conn(0x7f98c00b9a80 legacy=0x7f98c0147b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:24.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.042+0000 7f98bd400640 1 --2- 172.21.15.123:0/1893869232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98a40039b0 0x7f98a4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:24.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.042+0000 7f98bd400640 1 --2- 172.21.15.123:0/1893869232 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98a4004800 0x7f98a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:24.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.043+0000 7f98bd400640 1 --2- 172.21.15.123:0/1893869232 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f98c0141a00 0x7f98a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:24.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.043+0000 7f98bd400640 1 -- 172.21.15.123:0/1893869232 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f98c00b5e10 con 0x7f98a40039b0 2024-04-17T05:34:24.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.043+0000 7f98bd400640 1 -- 172.21.15.123:0/1893869232 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f98c00b71d0 con 0x7f98a4004800 2024-04-17T05:34:24.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.043+0000 7f98bd400640 1 -- 172.21.15.123:0/1893869232 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f98a400b9c0 con 0x7f98c0141a00 2024-04-17T05:34:24.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.043+0000 7f98bde00640 1 --2- 172.21.15.123:0/1893869232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98a40039b0 0x7f98a4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:24.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.043+0000 7f98b7e00640 1 --2- 172.21.15.123:0/1893869232 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98a4004800 0x7f98a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:24.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.043+0000 7f98be800640 1 --2- 172.21.15.123:0/1893869232 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f98c0141a00 0x7f98a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:24.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.043+0000 7f98bde00640 1 -- 172.21.15.123:0/1893869232 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f98c0141a00 msgr2=0x7f98a40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:24.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.043+0000 7f98bde00640 1 --2- 172.21.15.123:0/1893869232 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f98c0141a00 0x7f98a40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:24.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.043+0000 7f98bde00640 1 -- 172.21.15.123:0/1893869232 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98a4004800 msgr2=0x7f98a4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:24.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.043+0000 7f98bde00640 1 --2- 172.21.15.123:0/1893869232 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98a4004800 0x7f98a4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:24.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.043+0000 7f98bde00640 1 -- 172.21.15.123:0/1893869232 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a4003520 con 0x7f98a40039b0 2024-04-17T05:34:24.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.043+0000 7f98be800640 1 --2- 172.21.15.123:0/1893869232 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f98c0141a00 0x7f98a40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:34:24.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.044+0000 7f98bde00640 1 --2- 172.21.15.123:0/1893869232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98a40039b0 0x7f98a4003dd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f98b0009af0 tx=0x7f98a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2488d42e14218812 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:24.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.045+0000 7f98bd400640 1 -- 172.21.15.123:0/1893869232 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b0039070 con 0x7f98a40039b0 2024-04-17T05:34:24.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.045+0000 7f98bd400640 1 -- 172.21.15.123:0/1893869232 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f98b002c710 con 0x7f98a40039b0 2024-04-17T05:34:24.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.045+0000 7f98bd400640 1 -- 172.21.15.123:0/1893869232 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b0009690 con 0x7f98a40039b0 2024-04-17T05:34:24.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.045+0000 7f98bf200640 1 -- 172.21.15.123:0/1893869232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98a40039b0 msgr2=0x7f98a4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:24.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.045+0000 7f98bf200640 1 --2- 172.21.15.123:0/1893869232 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98a40039b0 0x7f98a4003dd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f98b0009af0 tx=0x7f98a4005830 comp rx=0 tx=0).stop 2024-04-17T05:34:24.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.045+0000 7f98be800640 1 -- 172.21.15.123:0/1893869232 reap_dead start 2024-04-17T05:34:24.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.045+0000 7f98bf200640 1 -- 172.21.15.123:0/1893869232 shutdown_connections 2024-04-17T05:34:24.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.045+0000 7f98bf200640 1 -- 172.21.15.123:0/1893869232 >> 172.21.15.123:0/1893869232 conn(0x7f98c006bda0 msgr2=0x7f98c006c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:24.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.045+0000 7f98bf200640 1 -- 172.21.15.123:0/1893869232 shutdown_connections 2024-04-17T05:34:24.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.045+0000 7f98bf200640 1 -- 172.21.15.123:0/1893869232 wait complete. 2024-04-17T05:34:24.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.047+0000 7f98bf200640 1 Processor -- start 2024-04-17T05:34:24.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.047+0000 7f98bf200640 1 -- start start 2024-04-17T05:34:24.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.048+0000 7f98bf200640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f98a40039b0 0x7f98c01d1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:24.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.048+0000 7f98bf200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98c01d22d0 0x7f98c01d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:24.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.048+0000 7f98bf200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98c01d07e0 0x7f98c013d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:24.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.048+0000 7f98bf200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f98c00b62a0 con 0x7f98c01d22d0 2024-04-17T05:34:24.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.048+0000 7f98bf200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f98c00b5a80 con 0x7f98c01d07e0 2024-04-17T05:34:24.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.048+0000 7f98bf200640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f98c00b6420 con 0x7f98a40039b0 2024-04-17T05:34:24.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.048+0000 7f98b7e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98c01d22d0 0x7f98c01d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:24.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.048+0000 7f98b7e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98c01d22d0 0x7f98c01d02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60824/0 (socket says 172.21.15.123:60824) 2024-04-17T05:34:24.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.048+0000 7f98b7e00640 1 -- 172.21.15.123:0/1193878857 learned_addr learned my addr 172.21.15.123:0/1193878857 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:34:24.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.048+0000 7f98bde00640 1 --2- 172.21.15.123:0/1193878857 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f98a40039b0 0x7f98c01d1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:24.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.048+0000 7f98be800640 1 --2- 172.21.15.123:0/1193878857 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98c01d07e0 0x7f98c013d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:24.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.049+0000 7f98b7e00640 1 -- 172.21.15.123:0/1193878857 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f98a40039b0 msgr2=0x7f98c01d1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:24.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.049+0000 7f98b7e00640 1 --2- 172.21.15.123:0/1193878857 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f98a40039b0 0x7f98c01d1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:24.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.049+0000 7f98b7e00640 1 -- 172.21.15.123:0/1193878857 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98c01d07e0 msgr2=0x7f98c013d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:24.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.049+0000 7f98b7e00640 1 --2- 172.21.15.123:0/1193878857 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98c01d07e0 0x7f98c013d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:24.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.049+0000 7f98b7e00640 1 -- 172.21.15.123:0/1193878857 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98c01d0c40 con 0x7f98c01d22d0 2024-04-17T05:34:24.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.049+0000 7f98be800640 1 --2- 172.21.15.123:0/1193878857 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98c01d07e0 0x7f98c013d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:34:24.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.049+0000 7f98b7e00640 1 --2- 172.21.15.123:0/1193878857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98c01d22d0 0x7f98c01d02a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f98a8001200 tx=0x7f98a800ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:24.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.049+0000 7f98b6000640 1 -- 172.21.15.123:0/1193878857 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a800ee00 con 0x7f98c01d22d0 2024-04-17T05:34:24.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.049+0000 7f98b6000640 1 -- 172.21.15.123:0/1193878857 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f98a8018070 con 0x7f98c01d22d0 2024-04-17T05:34:24.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.049+0000 7f98b6000640 1 -- 172.21.15.123:0/1193878857 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a800cad0 con 0x7f98c01d22d0 2024-04-17T05:34:24.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.049+0000 7f98bf200640 1 -- 172.21.15.123:0/1193878857 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98c01d2b00 con 0x7f98c01d22d0 2024-04-17T05:34:24.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.049+0000 7f98bf200640 1 -- 172.21.15.123:0/1193878857 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98c01d3710 con 0x7f98c01d22d0 2024-04-17T05:34:24.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.051+0000 7f98bf200640 1 -- 172.21.15.123:0/1193878857 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98c00759b0 con 0x7f98c01d22d0 2024-04-17T05:34:24.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.052+0000 7f98b6000640 1 -- 172.21.15.123:0/1193878857 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f98a800cc70 con 0x7f98c01d22d0 2024-04-17T05:34:24.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.052+0000 7f98b6000640 1 --2- 172.21.15.123:0/1193878857 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f989c06c8f0 0x7f989c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:24.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.053+0000 7f98b6000640 1 -- 172.21.15.123:0/1193878857 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f98a808bdf0 con 0x7f98c01d22d0 2024-04-17T05:34:24.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.053+0000 7f98bde00640 1 --2- 172.21.15.123:0/1193878857 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f989c06c8f0 0x7f989c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:24.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.054+0000 7f98bde00640 1 --2- 172.21.15.123:0/1193878857 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f989c06c8f0 0x7f989c06edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f98b0036000 tx=0x7f98b0030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:24.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.057+0000 7f98b6000640 1 -- 172.21.15.123:0/1193878857 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f98a8059df0 con 0x7f98c01d22d0 2024-04-17T05:34:24.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.295+0000 7f98bf200640 1 -- 172.21.15.123:0/1193878857 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f98c0147890 con 0x7f98c01d22d0 2024-04-17T05:34:24.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.297+0000 7f98b6000640 1 -- 172.21.15.123:0/1193878857 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+3550 (secure 0 0 0) 0x7f98a80596f0 con 0x7f98c01d22d0 2024-04-17T05:34:24.295 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:34:24.295 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/515699398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":515699398},{"type":"v1","addr":"172.21.15.123:6833","nonce":515699398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T05:26:52.642446+0000","modified":"2024-04-17T05:27:18.881148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4243},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4243":{"gid":4243,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/1946746019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1946746019},{"type":"v1","addr":"172.21.15.164:6835","nonce":1946746019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4243,"qdb_cluster":[4243]},"id":1}]} 2024-04-17T05:34:24.295 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 9 2024-04-17T05:34:24.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.299+0000 7f98bf200640 1 -- 172.21.15.123:0/1193878857 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f989c06c8f0 msgr2=0x7f989c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:24.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.299+0000 7f98bf200640 1 --2- 172.21.15.123:0/1193878857 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f989c06c8f0 0x7f989c06edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f98b0036000 tx=0x7f98b0030000 comp rx=0 tx=0).stop 2024-04-17T05:34:24.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.299+0000 7f98bf200640 1 -- 172.21.15.123:0/1193878857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98c01d22d0 msgr2=0x7f98c01d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:24.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.299+0000 7f98bf200640 1 --2- 172.21.15.123:0/1193878857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98c01d22d0 0x7f98c01d02a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f98a8001200 tx=0x7f98a800ec10 comp rx=0 tx=0).stop 2024-04-17T05:34:24.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.299+0000 7f98bf200640 1 -- 172.21.15.123:0/1193878857 shutdown_connections 2024-04-17T05:34:24.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.299+0000 7f98bf200640 1 --2- 172.21.15.123:0/1193878857 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f98c01d07e0 0x7f98c013d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:24.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.299+0000 7f98bf200640 1 --2- 172.21.15.123:0/1193878857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98c01d22d0 0x7f98c01d02a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:24.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.299+0000 7f98bf200640 1 --2- 172.21.15.123:0/1193878857 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f989c06c8f0 0x7f989c06edb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:24.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.299+0000 7f98bf200640 1 --2- 172.21.15.123:0/1193878857 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f98a40039b0 0x7f98c01d1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:24.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.299+0000 7f98bf200640 1 -- 172.21.15.123:0/1193878857 >> 172.21.15.123:0/1193878857 conn(0x7f98c006bda0 msgr2=0x7f98c0146950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:24.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.300+0000 7f98bf200640 1 -- 172.21.15.123:0/1193878857 shutdown_connections 2024-04-17T05:34:24.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.300+0000 7f98bf200640 1 -- 172.21.15.123:0/1193878857 wait complete. 2024-04-17T05:34:24.317 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T05:34:24.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.529+0000 7f091ce00640 1 Processor -- start 2024-04-17T05:34:24.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.530+0000 7f091ce00640 1 -- start start 2024-04-17T05:34:24.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.531+0000 7f091ce00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f09180b2ad0 0x7f0918148de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:24.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.531+0000 7f091ce00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0918070940 0x7f0918149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:24.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.531+0000 7f091ce00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f091813f1f0 0x7f091813f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:24.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.531+0000 7f091ce00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f09180b2eb0 con 0x7f09180b2ad0 2024-04-17T05:34:24.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.531+0000 7f091ce00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7f0918071cf0 con 0x7f0918070940 2024-04-17T05:34:24.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.531+0000 7f091ce00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f09180b4fa0 con 0x7f091813f1f0 2024-04-17T05:34:24.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.531+0000 7f0917400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f09180b2ad0 0x7f0918148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:24.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.531+0000 7f0917400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f09180b2ad0 0x7f0918148de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60838/0 (socket says 172.21.15.123:60838) 2024-04-17T05:34:24.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.531+0000 7f0917400640 1 -- 172.21.15.123:0/617878568 learned_addr learned my addr 172.21.15.123:0/617878568 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:34:24.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.532+0000 7f0917400640 1 -- 172.21.15.123:0/617878568 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f091813f1f0 msgr2=0x7f091813f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:24.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.532+0000 7f0917400640 1 --2- 172.21.15.123:0/617878568 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f091813f1f0 0x7f091813f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:24.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.532+0000 7f0917400640 1 -- 172.21.15.123:0/617878568 >> v2:172.21.15.164:3300/0 conn(0x7f0918070940 msgr2=0x7f0918149320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:24.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.532+0000 7f0917400640 1 --2- 172.21.15.123:0/617878568 >> v2:172.21.15.164:3300/0 conn(0x7f0918070940 0x7f0918149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:24.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.532+0000 7f0917400640 1 -- 172.21.15.123:0/617878568 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09180b5280 con 0x7f09180b2ad0 2024-04-17T05:34:24.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.533+0000 7f0917400640 1 --2- 172.21.15.123:0/617878568 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09180b2ad0 0x7f0918148de0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f09180b3090 tx=0x7f090802b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90c9ed9f2ef96d05 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:24.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.533+0000 7f0916a00640 1 -- 172.21.15.123:0/617878568 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0908038070 con 0x7f09180b2ad0 2024-04-17T05:34:24.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.533+0000 7f0916a00640 1 -- 172.21.15.123:0/617878568 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0908033620 con 0x7f09180b2ad0 2024-04-17T05:34:24.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.533+0000 7f0916a00640 1 -- 172.21.15.123:0/617878568 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0908033a10 con 0x7f09180b2ad0 2024-04-17T05:34:24.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.534+0000 7f091ce00640 1 -- 172.21.15.123:0/617878568 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09180b2ad0 msgr2=0x7f0918148de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:24.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.534+0000 7f091ce00640 1 --2- 172.21.15.123:0/617878568 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09180b2ad0 0x7f0918148de0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f09180b3090 tx=0x7f090802b7d0 comp rx=0 tx=0).stop 2024-04-17T05:34:24.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.534+0000 7f091ce00640 1 -- 172.21.15.123:0/617878568 shutdown_connections 2024-04-17T05:34:24.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.534+0000 7f091ce00640 1 --2- 172.21.15.123:0/617878568 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f091813f1f0 0x7f091813f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:24.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.534+0000 7f091ce00640 1 --2- 172.21.15.123:0/617878568 >> v2:172.21.15.164:3300/0 conn(0x7f0918070940 0x7f0918149320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:24.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.534+0000 7f091ce00640 1 --2- 172.21.15.123:0/617878568 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09180b2ad0 0x7f0918148de0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:24.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.534+0000 7f091ce00640 1 -- 172.21.15.123:0/617878568 >> 172.21.15.123:0/617878568 conn(0x7f09180b9150 msgr2=0x7f09180b9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:24.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.534+0000 7f091ce00640 1 -- 172.21.15.123:0/617878568 shutdown_connections 2024-04-17T05:34:24.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.534+0000 7f091ce00640 1 -- 172.21.15.123:0/617878568 wait complete. 2024-04-17T05:34:24.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.536+0000 7f091ce00640 1 Processor -- start 2024-04-17T05:34:24.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.536+0000 7f091ce00640 1 -- start start 2024-04-17T05:34:24.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.537+0000 7f091ce00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0918070940 0x7f09180aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:24.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.537+0000 7f091ce00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09180b2ad0 0x7f09181e0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:24.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.537+0000 7f091ce00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f091813f1f0 0x7f09181e0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:24.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.537+0000 7f091ce00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f091813fb80 con 0x7f09180b2ad0 2024-04-17T05:34:24.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.538+0000 7f091ce00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f09180b3560 con 0x7f091813f1f0 2024-04-17T05:34:24.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.538+0000 7f091ce00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f091813fd00 con 0x7f0918070940 2024-04-17T05:34:24.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.538+0000 7f090fe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09180b2ad0 0x7f09181e0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:24.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.538+0000 7f090fe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09180b2ad0 0x7f09181e0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60848/0 (socket says 172.21.15.123:60848) 2024-04-17T05:34:24.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.538+0000 7f090fe00640 1 -- 172.21.15.123:0/1397148244 learned_addr learned my addr 172.21.15.123:0/1397148244 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:34:24.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.538+0000 7f0917400640 1 --2- 172.21.15.123:0/1397148244 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0918070940 0x7f09180aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:24.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.538+0000 7f0917e00640 1 --2- 172.21.15.123:0/1397148244 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f091813f1f0 0x7f09181e0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:24.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.538+0000 7f090fe00640 1 -- 172.21.15.123:0/1397148244 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0918070940 msgr2=0x7f09180aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:24.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.538+0000 7f090fe00640 1 --2- 172.21.15.123:0/1397148244 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0918070940 0x7f09180aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:24.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.538+0000 7f090fe00640 1 -- 172.21.15.123:0/1397148244 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f091813f1f0 msgr2=0x7f09181e0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:24.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.538+0000 7f090fe00640 1 --2- 172.21.15.123:0/1397148244 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f091813f1f0 0x7f09181e0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:24.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.538+0000 7f090fe00640 1 -- 172.21.15.123:0/1397148244 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09180b0320 con 0x7f09180b2ad0 2024-04-17T05:34:24.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.539+0000 7f090fe00640 1 --2- 172.21.15.123:0/1397148244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09180b2ad0 0x7f09181e0610 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f090000b450 tx=0x7f090000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:24.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.539+0000 7f090f400640 1 -- 172.21.15.123:0/1397148244 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0900015020 con 0x7f09180b2ad0 2024-04-17T05:34:24.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.539+0000 7f090f400640 1 -- 172.21.15.123:0/1397148244 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0900011890 con 0x7f09180b2ad0 2024-04-17T05:34:24.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.539+0000 7f091ce00640 1 -- 172.21.15.123:0/1397148244 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09180b0b50 con 0x7f09180b2ad0 2024-04-17T05:34:24.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.539+0000 7f090f400640 1 -- 172.21.15.123:0/1397148244 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0900011ca0 con 0x7f09180b2ad0 2024-04-17T05:34:24.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.539+0000 7f091ce00640 1 -- 172.21.15.123:0/1397148244 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09180b10d0 con 0x7f09180b2ad0 2024-04-17T05:34:24.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.540+0000 7f091ce00640 1 -- 172.21.15.123:0/1397148244 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09180759b0 con 0x7f09180b2ad0 2024-04-17T05:34:24.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.541+0000 7f090f400640 1 -- 172.21.15.123:0/1397148244 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0900018020 con 0x7f09180b2ad0 2024-04-17T05:34:24.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.542+0000 7f090f400640 1 --2- 172.21.15.123:0/1397148244 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f08f406c8f0 0x7f08f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:24.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.542+0000 7f090f400640 1 -- 172.21.15.123:0/1397148244 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f090008c110 con 0x7f09180b2ad0 2024-04-17T05:34:24.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.543+0000 7f0917400640 1 --2- 172.21.15.123:0/1397148244 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f08f406c8f0 0x7f08f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:24.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.544+0000 7f0917400640 1 --2- 172.21.15.123:0/1397148244 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f08f406c8f0 0x7f08f406edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0908035000 tx=0x7f0908008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:24.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.547+0000 7f090f400640 1 -- 172.21.15.123:0/1397148244 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f090001f020 con 0x7f09180b2ad0 2024-04-17T05:34:24.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.781+0000 7f091ce00640 1 -- 172.21.15.123:0/1397148244 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f091813ed80 con 0x7f09180b2ad0 2024-04-17T05:34:24.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.782+0000 7f090f400640 1 -- 172.21.15.123:0/1397148244 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+3550 (secure 0 0 0) 0x7f090000d040 con 0x7f09180b2ad0 2024-04-17T05:34:24.780 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:34:24.781 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/515699398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":515699398},{"type":"v1","addr":"172.21.15.123:6833","nonce":515699398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T05:26:52.642446+0000","modified":"2024-04-17T05:27:18.881148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4243},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4243":{"gid":4243,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.164:6835/1946746019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1946746019},{"type":"v1","addr":"172.21.15.164:6835","nonce":1946746019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4243,"qdb_cluster":[4243]},"id":1}]} 2024-04-17T05:34:24.781 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 9 2024-04-17T05:34:24.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.785+0000 7f091ce00640 1 -- 172.21.15.123:0/1397148244 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f08f406c8f0 msgr2=0x7f08f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:24.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.785+0000 7f091ce00640 1 --2- 172.21.15.123:0/1397148244 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f08f406c8f0 0x7f08f406edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0908035000 tx=0x7f0908008030 comp rx=0 tx=0).stop 2024-04-17T05:34:24.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.785+0000 7f091ce00640 1 -- 172.21.15.123:0/1397148244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09180b2ad0 msgr2=0x7f09181e0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:24.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.785+0000 7f091ce00640 1 --2- 172.21.15.123:0/1397148244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09180b2ad0 0x7f09181e0610 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f090000b450 tx=0x7f090000b910 comp rx=0 tx=0).stop 2024-04-17T05:34:24.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.785+0000 7f091ce00640 1 -- 172.21.15.123:0/1397148244 shutdown_connections 2024-04-17T05:34:24.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.785+0000 7f091ce00640 1 --2- 172.21.15.123:0/1397148244 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f091813f1f0 0x7f09181e0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:24.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.785+0000 7f091ce00640 1 --2- 172.21.15.123:0/1397148244 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09180b2ad0 0x7f09181e0610 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:24.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.785+0000 7f091ce00640 1 --2- 172.21.15.123:0/1397148244 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f08f406c8f0 0x7f08f406edb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:24.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.785+0000 7f091ce00640 1 --2- 172.21.15.123:0/1397148244 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f0918070940 0x7f09180aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:24.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.785+0000 7f091ce00640 1 -- 172.21.15.123:0/1397148244 >> 172.21.15.123:0/1397148244 conn(0x7f09180b9150 msgr2=0x7f0918070220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:24.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.785+0000 7f091ce00640 1 -- 172.21.15.123:0/1397148244 shutdown_connections 2024-04-17T05:34:24.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:24.785+0000 7f091ce00640 1 -- 172.21.15.123:0/1397148244 wait complete. 2024-04-17T05:34:24.801 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T05:34:25.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.008+0000 7fbadb000640 1 Processor -- start 2024-04-17T05:34:25.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.008+0000 7fbadb000640 1 -- start start 2024-04-17T05:34:25.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.009+0000 7fbadb000640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fbad40b3dc0 0x7fbad4147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:25.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.009+0000 7fbadb000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbad413eaf0 0x7fbad414f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:25.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.009+0000 7fbadb000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbad40b5910 con 0x7fbad4148420 2024-04-17T05:34:25.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.009+0000 7fbadb000640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7fbad40b2c80 con 0x7fbad40b3dc0 2024-04-17T05:34:25.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.009+0000 7fbadb000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fbad40708c0 con 0x7fbad413eaf0 2024-04-17T05:34:25.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.010+0000 7fbad9200640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fbad4148420 0x7fbad413e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56438/0 (socket says 172.21.15.123:56438) 2024-04-17T05:34:25.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.010+0000 7fbad9200640 1 -- 172.21.15.123:0/14711262 learned_addr learned my addr 172.21.15.123:0/14711262 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-17T05:34:25.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.010+0000 7fbad9c00640 1 --2- 172.21.15.123:0/14711262 >> v2:172.21.15.164:3300/0 conn(0x7fbad40b3dc0 0x7fbad4147ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:25.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.010+0000 7fbada600640 1 --2- 172.21.15.123:0/14711262 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbad413eaf0 0x7fbad414f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:25.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.010+0000 7fbad3e00640 1 -- 172.21.15.123:0/14711262 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3082709184 0 0) 0x7fbad40b5910 con 0x7fbad4148420 2024-04-17T05:34:25.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.010+0000 7fbad3e00640 1 -- 172.21.15.123:0/14711262 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbabc003520 con 0x7fbad4148420 2024-04-17T05:34:25.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.010+0000 7fbad3e00640 1 -- 172.21.15.123:0/14711262 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2453641895 0 0) 0x7fbabc003520 con 0x7fbad4148420 2024-04-17T05:34:25.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.010+0000 7fbad3e00640 1 -- 172.21.15.123:0/14711262 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbad413eaf0 msgr2=0x7fbad414f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:25.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.010+0000 7fbad3e00640 1 --2- 172.21.15.123:0/14711262 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbad413eaf0 0x7fbad414f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:25.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.010+0000 7fbad3e00640 1 -- 172.21.15.123:0/14711262 >> v2:172.21.15.164:3300/0 conn(0x7fbad40b3dc0 msgr2=0x7fbad4147ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:25.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.010+0000 7fbad3e00640 1 --2- 172.21.15.123:0/14711262 >> v2:172.21.15.164:3300/0 conn(0x7fbad40b3dc0 0x7fbad4147ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:25.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.010+0000 7fbad3e00640 1 -- 172.21.15.123:0/14711262 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad40b1870 con 0x7fbad4148420 2024-04-17T05:34:25.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.010+0000 7fbad3e00640 1 -- 172.21.15.123:0/14711262 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1042962670 0 0) 0x7fbac0001690 con 0x7fbad4148420 2024-04-17T05:34:25.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.011+0000 7fbad3e00640 1 -- 172.21.15.123:0/14711262 >> v1:172.21.15.123:6789/0 conn(0x7fbad4148420 legacy=0x7fbad413e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:25.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.011+0000 7fbad3e00640 1 --2- 172.21.15.123:0/14711262 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbabc0039b0 0x7fbabc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:25.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.011+0000 7fbad3e00640 1 --2- 172.21.15.123:0/14711262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbabc004800 0x7fbabc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:25.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.011+0000 7fbad3e00640 1 --2- 172.21.15.123:0/14711262 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbad413eaf0 0x7fbabc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:25.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.011+0000 7fbad3e00640 1 -- 172.21.15.123:0/14711262 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbad40b2c80 con 0x7fbabc004800 2024-04-17T05:34:25.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.011+0000 7fbad3e00640 1 -- 172.21.15.123:0/14711262 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fbad40708c0 con 0x7fbabc0039b0 2024-04-17T05:34:25.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.011+0000 7fbad3e00640 1 -- 172.21.15.123:0/14711262 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fbabc00dc00 con 0x7fbad413eaf0 2024-04-17T05:34:25.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.011+0000 7fbad9200640 1 --2- 172.21.15.123:0/14711262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbabc004800 0x7fbabc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:25.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.011+0000 7fbada600640 1 --2- 172.21.15.123:0/14711262 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbad413eaf0 0x7fbabc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:25.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.011+0000 7fbad9c00640 1 --2- 172.21.15.123:0/14711262 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbabc0039b0 0x7fbabc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:25.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.011+0000 7fbad9200640 1 -- 172.21.15.123:0/14711262 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbad413eaf0 msgr2=0x7fbabc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:25.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.011+0000 7fbad9200640 1 --2- 172.21.15.123:0/14711262 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbad413eaf0 0x7fbabc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:25.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.011+0000 7fbad9200640 1 -- 172.21.15.123:0/14711262 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbabc0039b0 msgr2=0x7fbabc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:25.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.011+0000 7fbad9200640 1 --2- 172.21.15.123:0/14711262 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbabc0039b0 0x7fbabc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:25.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.011+0000 7fbad9200640 1 -- 172.21.15.123:0/14711262 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbabc003520 con 0x7fbabc004800 2024-04-17T05:34:25.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.011+0000 7fbad9c00640 1 --2- 172.21.15.123:0/14711262 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbabc0039b0 0x7fbabc003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:34:25.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.012+0000 7fbad9200640 1 --2- 172.21.15.123:0/14711262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbabc004800 0x7fbabc004c80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbac000c210 tx=0x7fbabc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b470b66dd60b70f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:25.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.013+0000 7fbad3e00640 1 -- 172.21.15.123:0/14711262 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac0007d70 con 0x7fbabc004800 2024-04-17T05:34:25.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.013+0000 7fbad3e00640 1 -- 172.21.15.123:0/14711262 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fbac0030070 con 0x7fbabc004800 2024-04-17T05:34:25.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.013+0000 7fbad3e00640 1 -- 172.21.15.123:0/14711262 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac002cd80 con 0x7fbabc004800 2024-04-17T05:34:25.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.013+0000 7fbadb000640 1 -- 172.21.15.123:0/14711262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbabc004800 msgr2=0x7fbabc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:25.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.013+0000 7fbadb000640 1 --2- 172.21.15.123:0/14711262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbabc004800 0x7fbabc004c80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbac000c210 tx=0x7fbabc005830 comp rx=0 tx=0).stop 2024-04-17T05:34:25.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.013+0000 7fbada600640 1 -- 172.21.15.123:0/14711262 reap_dead start 2024-04-17T05:34:25.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.013+0000 7fbadb000640 1 -- 172.21.15.123:0/14711262 shutdown_connections 2024-04-17T05:34:25.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.013+0000 7fbadb000640 1 -- 172.21.15.123:0/14711262 >> 172.21.15.123:0/14711262 conn(0x7fbad40b9150 msgr2=0x7fbad40b9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:25.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.013+0000 7fbadb000640 1 -- 172.21.15.123:0/14711262 shutdown_connections 2024-04-17T05:34:25.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.013+0000 7fbadb000640 1 -- 172.21.15.123:0/14711262 wait complete. 2024-04-17T05:34:25.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.015+0000 7fbadb000640 1 Processor -- start 2024-04-17T05:34:25.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.015+0000 7fbadb000640 1 -- start start 2024-04-17T05:34:25.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.016+0000 7fbadb000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbabc004800 0x7fbad40b8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:25.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.016+0000 7fbadb000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbad41cfed0 0x7fbad41cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:25.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.016+0000 7fbadb000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbad41cf620 0x7fbad413b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:25.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.016+0000 7fbadb000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbad40b2ed0 con 0x7fbabc004800 2024-04-17T05:34:25.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.016+0000 7fbadb000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fbad4148880 con 0x7fbad41cf620 2024-04-17T05:34:25.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.016+0000 7fbadb000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fbad40b1b10 con 0x7fbad41cfed0 2024-04-17T05:34:25.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.016+0000 7fbad9c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbabc004800 0x7fbad40b8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:25.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.016+0000 7fbad9c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbabc004800 0x7fbad40b8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35792/0 (socket says 172.21.15.123:35792) 2024-04-17T05:34:25.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.016+0000 7fbad9c00640 1 -- 172.21.15.123:0/2234534830 learned_addr learned my addr 172.21.15.123:0/2234534830 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:34:25.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.016+0000 7fbada600640 1 --2- 172.21.15.123:0/2234534830 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbad41cf620 0x7fbad413b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:25.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.017+0000 7fbad9200640 1 --2- 172.21.15.123:0/2234534830 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbad41cfed0 0x7fbad41cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:25.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.017+0000 7fbad9c00640 1 -- 172.21.15.123:0/2234534830 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbad41cfed0 msgr2=0x7fbad41cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:25.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.017+0000 7fbad9c00640 1 --2- 172.21.15.123:0/2234534830 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbad41cfed0 0x7fbad41cf0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:25.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.017+0000 7fbad9c00640 1 -- 172.21.15.123:0/2234534830 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbad41cf620 msgr2=0x7fbad413b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:25.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.017+0000 7fbad9c00640 1 --2- 172.21.15.123:0/2234534830 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbad41cf620 0x7fbad413b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:25.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.017+0000 7fbad9c00640 1 -- 172.21.15.123:0/2234534830 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad41cfab0 con 0x7fbabc004800 2024-04-17T05:34:25.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.017+0000 7fbada600640 1 --2- 172.21.15.123:0/2234534830 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbad41cf620 0x7fbad413b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:34:25.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.017+0000 7fbad9c00640 1 --2- 172.21.15.123:0/2234534830 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbabc004800 0x7fbad40b8210 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fbac80108b0 tx=0x7fbac8010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:25.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.017+0000 7fbad1600640 1 -- 172.21.15.123:0/2234534830 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac800f040 con 0x7fbabc004800 2024-04-17T05:34:25.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.017+0000 7fbad1600640 1 -- 172.21.15.123:0/2234534830 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fbac800eb00 con 0x7fbabc004800 2024-04-17T05:34:25.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.017+0000 7fbadb000640 1 -- 172.21.15.123:0/2234534830 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbad4141da0 con 0x7fbabc004800 2024-04-17T05:34:25.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.017+0000 7fbad1600640 1 -- 172.21.15.123:0/2234534830 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac801c400 con 0x7fbabc004800 2024-04-17T05:34:25.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.017+0000 7fbadb000640 1 -- 172.21.15.123:0/2234534830 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbad40b8a10 con 0x7fbabc004800 2024-04-17T05:34:25.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.018+0000 7fbadb000640 1 -- 172.21.15.123:0/2234534830 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbad40759b0 con 0x7fbabc004800 2024-04-17T05:34:25.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.019+0000 7fbad1600640 1 -- 172.21.15.123:0/2234534830 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbac801c5a0 con 0x7fbabc004800 2024-04-17T05:34:25.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.020+0000 7fbad1600640 1 --2- 172.21.15.123:0/2234534830 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fbab406c920 0x7fbab406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:25.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.020+0000 7fbad1600640 1 -- 172.21.15.123:0/2234534830 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fbac808c680 con 0x7fbabc004800 2024-04-17T05:34:25.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.021+0000 7fbad9200640 1 --2- 172.21.15.123:0/2234534830 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fbab406c920 0x7fbab406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:25.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.022+0000 7fbad9200640 1 --2- 172.21.15.123:0/2234534830 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fbab406c920 0x7fbab406ede0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbac0034000 tx=0x7fbac0009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:25.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.025+0000 7fbad1600640 1 -- 172.21.15.123:0/2234534830 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fbac8018030 con 0x7fbabc004800 2024-04-17T05:34:25.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.227+0000 7fbadb000640 1 -- 172.21.15.123:0/2234534830 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbad413cd30 con 0x7fbabc004800 2024-04-17T05:34:25.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.229+0000 7fbad1600640 1 -- 172.21.15.123:0/2234534830 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18960 (secure 0 0 0) 0x7fbac805a5f0 con 0x7fbabc004800 2024-04-17T05:34:25.228 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-17T05:34:25.228 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":28,"fsid":"0787c5c0-e77a-4102-a899-30db48b19c68","created":"2024-04-17T05:26:33.031507+0000","modified":"2024-04-17T05:27:39.558127+0000","last_up_change":"2024-04-17T05:26:44.988433+0000","last_in_change":"2024-04-17T05:26:36.682131+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T05:26:46.329778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T05:26:50.600195+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T05:26:51.626498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T05:26:55.264044+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"15c87cdb-9415-45a6-a2a6-ea6bec9daece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6801","nonce":840753170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6803","nonce":840753170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6807","nonce":840753170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":840753170},{"type":"v1","addr":"172.21.15.123:6805","nonce":840753170}]},"public_addr":"172.21.15.123:6801/840753170","cluster_addr":"172.21.15.123:6803/840753170","heartbeat_back_addr":"172.21.15.123:6807/840753170","heartbeat_front_addr":"172.21.15.123:6805/840753170","state":["exists","up"]},{"osd":1,"uuid":"281751b5-486d-4845-b4aa-b308bf7cec62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6819","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6822","nonce":2231878927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6827","nonce":2231878927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6831","nonce":2231878927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":2231878927},{"type":"v1","addr":"172.21.15.123:6829","nonce":2231878927}]},"public_addr":"172.21.15.123:6822/2231878927","cluster_addr":"172.21.15.123:6827/2231878927","heartbeat_back_addr":"172.21.15.123:6831/2231878927","heartbeat_front_addr":"172.21.15.123:6829/2231878927","state":["exists","up"]},{"osd":2,"uuid":"b42257d3-bd20-4db5-aa37-1bf5c512d0f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6817","nonce":754360844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6820","nonce":754360844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6825","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6826","nonce":754360844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6821","nonce":754360844},{"type":"v1","addr":"172.21.15.123:6823","nonce":754360844}]},"public_addr":"172.21.15.123:6817/754360844","cluster_addr":"172.21.15.123:6820/754360844","heartbeat_back_addr":"172.21.15.123:6826/754360844","heartbeat_front_addr":"172.21.15.123:6823/754360844","state":["exists","up"]},{"osd":3,"uuid":"0f26b891-bbe6-478e-8dee-78e69bb48cf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6809","nonce":2898088574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6811","nonce":2898088574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6815","nonce":2898088574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2898088574},{"type":"v1","addr":"172.21.15.123:6813","nonce":2898088574}]},"public_addr":"172.21.15.123:6809/2898088574","cluster_addr":"172.21.15.123:6811/2898088574","heartbeat_back_addr":"172.21.15.123:6815/2898088574","heartbeat_front_addr":"172.21.15.123:6813/2898088574","state":["exists","up"]},{"osd":4,"uuid":"43e59318-2740-4625-9d64-eec1fd43c322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6801","nonce":606484349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6804","nonce":606484349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6812","nonce":606484349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":606484349},{"type":"v1","addr":"172.21.15.164:6808","nonce":606484349}]},"public_addr":"172.21.15.164:6801/606484349","cluster_addr":"172.21.15.164:6804/606484349","heartbeat_back_addr":"172.21.15.164:6812/606484349","heartbeat_front_addr":"172.21.15.164:6808/606484349","state":["exists","up"]},{"osd":5,"uuid":"aaa3acf4-4adc-4337-aba3-363851d35310","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6805","nonce":1376989593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6809","nonce":1376989593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6815","nonce":1376989593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":1376989593},{"type":"v1","addr":"172.21.15.164:6813","nonce":1376989593}]},"public_addr":"172.21.15.164:6805/1376989593","cluster_addr":"172.21.15.164:6809/1376989593","heartbeat_back_addr":"172.21.15.164:6815/1376989593","heartbeat_front_addr":"172.21.15.164:6813/1376989593","state":["exists","up"]},{"osd":6,"uuid":"6f765b27-7377-4d81-9192-23a965651145","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6817","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6821","nonce":1594306924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6823","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6826","nonce":1594306924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6831","nonce":1594306924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1594306924},{"type":"v1","addr":"172.21.15.164:6829","nonce":1594306924}]},"public_addr":"172.21.15.164:6821/1594306924","cluster_addr":"172.21.15.164:6826/1594306924","heartbeat_back_addr":"172.21.15.164:6831/1594306924","heartbeat_front_addr":"172.21.15.164:6829/1594306924","state":["exists","up"]},{"osd":7,"uuid":"5547394b-ec2f-4311-846d-369af4b1acf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6818","nonce":295402697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6819","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6820","nonce":295402697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6825","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6827","nonce":295402697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":295402697},{"type":"v1","addr":"172.21.15.164:6824","nonce":295402697}]},"public_addr":"172.21.15.164:6818/295402697","cluster_addr":"172.21.15.164:6820/295402697","heartbeat_back_addr":"172.21.15.164:6827/295402697","heartbeat_front_addr":"172.21.15.164:6824/295402697","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.034807+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.022201+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.751897+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:41.850533+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.083608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.047524+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.314753+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T05:26:42.413586+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T05:34:25.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.232+0000 7fbadb000640 1 -- 172.21.15.123:0/2234534830 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fbab406c920 msgr2=0x7fbab406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:25.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.232+0000 7fbadb000640 1 --2- 172.21.15.123:0/2234534830 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fbab406c920 0x7fbab406ede0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbac0034000 tx=0x7fbac0009030 comp rx=0 tx=0).stop 2024-04-17T05:34:25.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.232+0000 7fbadb000640 1 -- 172.21.15.123:0/2234534830 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbabc004800 msgr2=0x7fbad40b8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:25.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.232+0000 7fbadb000640 1 --2- 172.21.15.123:0/2234534830 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbabc004800 0x7fbad40b8210 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fbac80108b0 tx=0x7fbac8010d70 comp rx=0 tx=0).stop 2024-04-17T05:34:25.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.232+0000 7fbadb000640 1 -- 172.21.15.123:0/2234534830 shutdown_connections 2024-04-17T05:34:25.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.232+0000 7fbadb000640 1 --2- 172.21.15.123:0/2234534830 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbad41cf620 0x7fbad413b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:25.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.232+0000 7fbadb000640 1 --2- 172.21.15.123:0/2234534830 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fbab406c920 0x7fbab406ede0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:25.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.232+0000 7fbadb000640 1 --2- 172.21.15.123:0/2234534830 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbad41cfed0 0x7fbad41cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:25.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.232+0000 7fbadb000640 1 --2- 172.21.15.123:0/2234534830 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbabc004800 0x7fbad40b8210 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:25.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.232+0000 7fbadb000640 1 -- 172.21.15.123:0/2234534830 >> 172.21.15.123:0/2234534830 conn(0x7fbad40b9150 msgr2=0x7fbad40b9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:25.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.233+0000 7fbadb000640 1 -- 172.21.15.123:0/2234534830 shutdown_connections 2024-04-17T05:34:25.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.233+0000 7fbadb000640 1 -- 172.21.15.123:0/2234534830 wait complete. 2024-04-17T05:34:25.250 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-17T05:34:25.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.467+0000 7faec9400640 1 Processor -- start 2024-04-17T05:34:25.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.468+0000 7faec9400640 1 -- start start 2024-04-17T05:34:25.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.469+0000 7faec9400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faec40b6b80 0x7faec40b7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:25.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.469+0000 7faec9400640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7faec4141f80 0x7faec406e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:25.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.469+0000 7faec9400640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faec40b6f60 con 0x7faec40b5f00 2024-04-17T05:34:25.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.469+0000 7faec9400640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7faec40b1ce0 con 0x7faec4141f80 2024-04-17T05:34:25.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.469+0000 7faec9400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7faec40b1fc0 con 0x7faec40b6b80 2024-04-17T05:34:25.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.470+0000 7faec8a00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7faec4141f80 0x7faec406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:25.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.470+0000 7faec3e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faec40b6b80 0x7faec40b7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:25.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.470+0000 7faec8a00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7faec4141f80 0x7faec406e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.123:43402/0 (socket says 172.21.15.123:43402) 2024-04-17T05:34:25.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.470+0000 7faec3400640 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7faec40b5f00 0x7faec4141870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.123:57438/0 (socket says 172.21.15.123:57438) 2024-04-17T05:34:25.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.470+0000 7faec8a00640 1 -- 172.21.15.123:0/2865616333 learned_addr learned my addr 172.21.15.123:0/2865616333 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:34:25.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.471+0000 7faec3e00640 1 -- 172.21.15.123:0/2865616333 >> v2:172.21.15.164:3300/0 conn(0x7faec4141f80 msgr2=0x7faec406e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:25.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.471+0000 7faec3e00640 1 --2- 172.21.15.123:0/2865616333 >> v2:172.21.15.164:3300/0 conn(0x7faec4141f80 0x7faec406e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:25.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.471+0000 7faec3e00640 1 -- 172.21.15.123:0/2865616333 >> v1:172.21.15.164:6789/0 conn(0x7faec40b5f00 legacy=0x7faec4141870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:25.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.471+0000 7faec3e00640 1 -- 172.21.15.123:0/2865616333 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec40b22a0 con 0x7faec40b6b80 2024-04-17T05:34:25.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.471+0000 7faec8a00640 1 --2- 172.21.15.123:0/2865616333 >> v2:172.21.15.164:3300/0 conn(0x7faec4141f80 0x7faec406e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T05:34:25.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.471+0000 7faec2a00640 1 -- 172.21.15.123:0/2865616333 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3115593369 0 0) 0x7faec40b6f60 con 0x7faec40b5f00 2024-04-17T05:34:25.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.472+0000 7faec3e00640 1 --2- 172.21.15.123:0/2865616333 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faec40b6b80 0x7faec40b7410 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faeb4009d90 tx=0x7faeb402be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b3a2a54a27a1927 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:25.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.473+0000 7faec2a00640 1 -- 172.21.15.123:0/2865616333 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb4039070 con 0x7faec40b6b80 2024-04-17T05:34:25.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.473+0000 7faec2a00640 1 -- 172.21.15.123:0/2865616333 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7faeb402cbc0 con 0x7faec40b6b80 2024-04-17T05:34:25.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.473+0000 7faec2a00640 1 -- 172.21.15.123:0/2865616333 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb4034440 con 0x7faec40b6b80 2024-04-17T05:34:25.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.474+0000 7faec9400640 1 -- 172.21.15.123:0/2865616333 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faec40b6b80 msgr2=0x7faec40b7410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:25.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.474+0000 7faec9400640 1 --2- 172.21.15.123:0/2865616333 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faec40b6b80 0x7faec40b7410 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faeb4009d90 tx=0x7faeb402be10 comp rx=0 tx=0).stop 2024-04-17T05:34:25.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.474+0000 7faec9400640 1 -- 172.21.15.123:0/2865616333 shutdown_connections 2024-04-17T05:34:25.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.474+0000 7faec9400640 1 --2- 172.21.15.123:0/2865616333 >> v2:172.21.15.164:3300/0 conn(0x7faec4141f80 0x7faec406e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:25.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.474+0000 7faec9400640 1 --2- 172.21.15.123:0/2865616333 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faec40b6b80 0x7faec40b7410 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:25.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.474+0000 7faec9400640 1 -- 172.21.15.123:0/2865616333 >> 172.21.15.123:0/2865616333 conn(0x7faec40bb210 msgr2=0x7faec40bb620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:25.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.474+0000 7faec9400640 1 -- 172.21.15.123:0/2865616333 shutdown_connections 2024-04-17T05:34:25.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.474+0000 7faec9400640 1 -- 172.21.15.123:0/2865616333 wait complete. 2024-04-17T05:34:25.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.475+0000 7faec9400640 1 Processor -- start 2024-04-17T05:34:25.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.476+0000 7faec9400640 1 -- start start 2024-04-17T05:34:25.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.476+0000 7faec9400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faec40b5f00 0x7faec413fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:25.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.476+0000 7faec9400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faec40b6b80 0x7faec41dd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:25.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.476+0000 7faec9400640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faec4141f80 0x7faec413a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:25.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.476+0000 7faec9400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7faec406efe0 con 0x7faec40b6b80 2024-04-17T05:34:25.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.476+0000 7faec9400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7faec406ee60 con 0x7faec40b5f00 2024-04-17T05:34:25.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.476+0000 7faec9400640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7faec406f160 con 0x7faec4141f80 2024-04-17T05:34:25.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.477+0000 7faec3400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faec40b6b80 0x7faec41dd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:25.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.477+0000 7faec3400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faec40b6b80 0x7faec41dd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35806/0 (socket says 172.21.15.123:35806) 2024-04-17T05:34:25.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.477+0000 7faec3400640 1 -- 172.21.15.123:0/2303399524 learned_addr learned my addr 172.21.15.123:0/2303399524 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:34:25.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.477+0000 7faec8a00640 1 --2- 172.21.15.123:0/2303399524 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faec4141f80 0x7faec413a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:25.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.477+0000 7faec3e00640 1 --2- 172.21.15.123:0/2303399524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faec40b5f00 0x7faec413fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:25.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.477+0000 7faec3400640 1 -- 172.21.15.123:0/2303399524 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faec4141f80 msgr2=0x7faec413a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:25.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.477+0000 7faec3400640 1 --2- 172.21.15.123:0/2303399524 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faec4141f80 0x7faec413a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:25.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.477+0000 7faec3400640 1 -- 172.21.15.123:0/2303399524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faec40b5f00 msgr2=0x7faec413fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:25.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.477+0000 7faec3400640 1 --2- 172.21.15.123:0/2303399524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faec40b5f00 0x7faec413fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:25.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.477+0000 7faec3400640 1 -- 172.21.15.123:0/2303399524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec4143d40 con 0x7faec40b6b80 2024-04-17T05:34:25.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.477+0000 7faec3e00640 1 --2- 172.21.15.123:0/2303399524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faec40b5f00 0x7faec413fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:34:25.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.477+0000 7faec8a00640 1 --2- 172.21.15.123:0/2303399524 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faec4141f80 0x7faec413a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:34:25.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.477+0000 7faec3400640 1 --2- 172.21.15.123:0/2303399524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faec40b6b80 0x7faec41dd250 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7faeac00c3e0 tx=0x7faeac00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:25.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.478+0000 7faebbe00640 1 -- 172.21.15.123:0/2303399524 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeac0074e0 con 0x7faec40b6b80 2024-04-17T05:34:25.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.478+0000 7faebbe00640 1 -- 172.21.15.123:0/2303399524 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7faeac0047e0 con 0x7faec40b6b80 2024-04-17T05:34:25.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.478+0000 7faebbe00640 1 -- 172.21.15.123:0/2303399524 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeac004bf0 con 0x7faec40b6b80 2024-04-17T05:34:25.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.478+0000 7faec9400640 1 -- 172.21.15.123:0/2303399524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faec40b3870 con 0x7faec40b6b80 2024-04-17T05:34:25.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.478+0000 7faec9400640 1 -- 172.21.15.123:0/2303399524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faec4144fc0 con 0x7faec40b6b80 2024-04-17T05:34:25.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.479+0000 7faec9400640 1 -- 172.21.15.123:0/2303399524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faec4144de0 con 0x7faec40b6b80 2024-04-17T05:34:25.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.480+0000 7faebbe00640 1 -- 172.21.15.123:0/2303399524 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faeac011070 con 0x7faec40b6b80 2024-04-17T05:34:25.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.481+0000 7faebbe00640 1 --2- 172.21.15.123:0/2303399524 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7faea006c8f0 0x7faea006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:25.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.482+0000 7faebbe00640 1 -- 172.21.15.123:0/2303399524 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7faeac08bb30 con 0x7faec40b6b80 2024-04-17T05:34:25.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.482+0000 7faec3e00640 1 --2- 172.21.15.123:0/2303399524 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7faea006c8f0 0x7faea006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:25.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.483+0000 7faec3e00640 1 --2- 172.21.15.123:0/2303399524 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7faea006c8f0 0x7faea006edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7faeb4036000 tx=0x7faeb4030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:25.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.486+0000 7faebbe00640 1 -- 172.21.15.123:0/2303399524 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7faec4144de0 con 0x7faec40b6b80 2024-04-17T05:34:25.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.731+0000 7faec9400640 1 -- 172.21.15.123:0/2303399524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7faec4075b30 con 0x7faec40b6b80 2024-04-17T05:34:25.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.737+0000 7faebbe00640 1 -- 172.21.15.123:0/2303399524 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7faec4143d40 con 0x7faec40b6b80 2024-04-17T05:34:25.735 INFO:teuthology.orchestra.run.smithi123.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-17T05:34:25.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.740+0000 7faec9400640 1 -- 172.21.15.123:0/2303399524 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7faea006c8f0 msgr2=0x7faea006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:25.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.740+0000 7faec9400640 1 --2- 172.21.15.123:0/2303399524 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7faea006c8f0 0x7faea006edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7faeb4036000 tx=0x7faeb4030000 comp rx=0 tx=0).stop 2024-04-17T05:34:25.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.740+0000 7faec9400640 1 -- 172.21.15.123:0/2303399524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faec40b6b80 msgr2=0x7faec41dd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:25.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.740+0000 7faec9400640 1 --2- 172.21.15.123:0/2303399524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faec40b6b80 0x7faec41dd250 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7faeac00c3e0 tx=0x7faeac00c8a0 comp rx=0 tx=0).stop 2024-04-17T05:34:25.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.740+0000 7faec9400640 1 -- 172.21.15.123:0/2303399524 shutdown_connections 2024-04-17T05:34:25.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.740+0000 7faec9400640 1 --2- 172.21.15.123:0/2303399524 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7faea006c8f0 0x7faea006edb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:25.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.740+0000 7faec9400640 1 --2- 172.21.15.123:0/2303399524 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7faec4141f80 0x7faec413a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:25.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.740+0000 7faec9400640 1 --2- 172.21.15.123:0/2303399524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faec40b6b80 0x7faec41dd250 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:25.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.740+0000 7faec9400640 1 --2- 172.21.15.123:0/2303399524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faec40b5f00 0x7faec413fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:25.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.740+0000 7faec9400640 1 -- 172.21.15.123:0/2303399524 >> 172.21.15.123:0/2303399524 conn(0x7faec40bb210 msgr2=0x7faec413d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:25.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.740+0000 7faec9400640 1 -- 172.21.15.123:0/2303399524 shutdown_connections 2024-04-17T05:34:25.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.740+0000 7faec9400640 1 -- 172.21.15.123:0/2303399524 wait complete. 2024-04-17T05:34:25.760 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-17T05:34:25.861 INFO:tasks.ceph.mds.b.smithi164.stdout:starting mds.b at 2024-04-17T05:34:25.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.975+0000 7f7199800640 1 Processor -- start 2024-04-17T05:34:25.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.975+0000 7f7199800640 1 -- start start 2024-04-17T05:34:25.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.976+0000 7f7199800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f71940b6200 0x7f7194148150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:25.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.976+0000 7f7199800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7194148690 0x7f7194141780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:25.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.976+0000 7f7199800640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71940b65e0 con 0x7f7194141cc0 2024-04-17T05:34:25.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.976+0000 7f7199800640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f7194147cc0 con 0x7f71940b6200 2024-04-17T05:34:25.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.976+0000 7f7199800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f719414bcc0 con 0x7f7194148690 2024-04-17T05:34:25.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.977+0000 7f7193e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f71940b6200 0x7f7194148150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:25.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.977+0000 7f7193e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f71940b6200 0x7f7194148150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35808/0 (socket says 172.21.15.123:35808) 2024-04-17T05:34:25.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.977+0000 7f7193e00640 1 -- 172.21.15.123:0/1175738913 learned_addr learned my addr 172.21.15.123:0/1175738913 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:34:25.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.977+0000 7f7193400640 1 --2- 172.21.15.123:0/1175738913 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7194148690 0x7f7194141780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:25.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.977+0000 7f7193e00640 1 -- 172.21.15.123:0/1175738913 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7194148690 msgr2=0x7f7194141780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:25.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.977+0000 7f7193e00640 1 --2- 172.21.15.123:0/1175738913 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7194148690 0x7f7194141780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:25.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.977+0000 7f7193e00640 1 -- 172.21.15.123:0/1175738913 >> v1:172.21.15.164:6789/0 conn(0x7f7194141cc0 legacy=0x7f719414af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:25.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.977+0000 7f7193e00640 1 -- 172.21.15.123:0/1175738913 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71940b7d00 con 0x7f71940b6200 2024-04-17T05:34:25.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.978+0000 7f7193e00640 1 --2- 172.21.15.123:0/1175738913 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71940b6200 0x7f7194148150 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7184009870 tx=0x7f718402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39ade151a690d62b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:25.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.978+0000 7f7192a00640 1 -- 172.21.15.123:0/1175738913 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71840317c0 con 0x7f71940b6200 2024-04-17T05:34:25.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.979+0000 7f7192a00640 1 -- 172.21.15.123:0/1175738913 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7184037070 con 0x7f71940b6200 2024-04-17T05:34:25.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.979+0000 7f7192a00640 1 -- 172.21.15.123:0/1175738913 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7184031ba0 con 0x7f71940b6200 2024-04-17T05:34:25.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.979+0000 7f7199800640 1 -- 172.21.15.123:0/1175738913 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71940b6200 msgr2=0x7f7194148150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:25.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.979+0000 7f7199800640 1 --2- 172.21.15.123:0/1175738913 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71940b6200 0x7f7194148150 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7184009870 tx=0x7f718402b860 comp rx=0 tx=0).stop 2024-04-17T05:34:25.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.979+0000 7f7199800640 1 -- 172.21.15.123:0/1175738913 shutdown_connections 2024-04-17T05:34:25.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.979+0000 7f7199800640 1 --2- 172.21.15.123:0/1175738913 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7194148690 0x7f7194141780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:25.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.979+0000 7f7199800640 1 --2- 172.21.15.123:0/1175738913 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71940b6200 0x7f7194148150 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:25.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.979+0000 7f7199800640 1 -- 172.21.15.123:0/1175738913 >> 172.21.15.123:0/1175738913 conn(0x7f71940bdbe0 msgr2=0x7f71940b9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:25.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.979+0000 7f7199800640 1 -- 172.21.15.123:0/1175738913 shutdown_connections 2024-04-17T05:34:25.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.979+0000 7f7199800640 1 -- 172.21.15.123:0/1175738913 wait complete. 2024-04-17T05:34:25.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.981+0000 7f7199800640 1 Processor -- start 2024-04-17T05:34:25.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.981+0000 7f7199800640 1 -- start start 2024-04-17T05:34:25.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.982+0000 7f7199800640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f71940b6200 0x7f71941410a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:25.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.982+0000 7f7199800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7194141cc0 0x7f71941402a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:25.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.982+0000 7f7199800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7194148690 0x7f719413a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:25.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.982+0000 7f7199800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f719414b7f0 con 0x7f7194141cc0 2024-04-17T05:34:25.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.982+0000 7f7199800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f719414b670 con 0x7f7194148690 2024-04-17T05:34:25.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.982+0000 7f7199800640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f719414b970 con 0x7f71940b6200 2024-04-17T05:34:25.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.982+0000 7f7193400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7194141cc0 0x7f71941402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:25.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.982+0000 7f7193400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7194141cc0 0x7f71941402a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35812/0 (socket says 172.21.15.123:35812) 2024-04-17T05:34:25.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.982+0000 7f7193400640 1 -- 172.21.15.123:0/3475809484 learned_addr learned my addr 172.21.15.123:0/3475809484 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:34:25.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.982+0000 7f7198e00640 1 --2- 172.21.15.123:0/3475809484 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7194148690 0x7f719413a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:25.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.982+0000 7f7193e00640 1 --2- 172.21.15.123:0/3475809484 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f71940b6200 0x7f71941410a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:25.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.983+0000 7f7193400640 1 -- 172.21.15.123:0/3475809484 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f71940b6200 msgr2=0x7f71941410a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:25.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.983+0000 7f7193400640 1 --2- 172.21.15.123:0/3475809484 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f71940b6200 0x7f71941410a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:25.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.983+0000 7f7193400640 1 -- 172.21.15.123:0/3475809484 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7194148690 msgr2=0x7f719413a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:25.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.983+0000 7f7193400640 1 --2- 172.21.15.123:0/3475809484 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7194148690 0x7f719413a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:25.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.983+0000 7f7193400640 1 -- 172.21.15.123:0/3475809484 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7194142190 con 0x7f7194141cc0 2024-04-17T05:34:25.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.983+0000 7f7193e00640 1 --2- 172.21.15.123:0/3475809484 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f71940b6200 0x7f71941410a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:34:25.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.983+0000 7f7193400640 1 --2- 172.21.15.123:0/3475809484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7194141cc0 0x7f71941402a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f718000c820 tx=0x7f718000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:25.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.983+0000 7f718be00640 1 -- 172.21.15.123:0/3475809484 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7180015070 con 0x7f7194141cc0 2024-04-17T05:34:25.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.983+0000 7f718be00640 1 -- 172.21.15.123:0/3475809484 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7180004240 con 0x7f7194141cc0 2024-04-17T05:34:25.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.983+0000 7f718be00640 1 -- 172.21.15.123:0/3475809484 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718000ce10 con 0x7f7194141cc0 2024-04-17T05:34:25.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.983+0000 7f7199800640 1 -- 172.21.15.123:0/3475809484 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7194142470 con 0x7f7194141cc0 2024-04-17T05:34:25.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.983+0000 7f7199800640 1 -- 172.21.15.123:0/3475809484 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71941407e0 con 0x7f7194141cc0 2024-04-17T05:34:25.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.985+0000 7f7199800640 1 -- 172.21.15.123:0/3475809484 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7194075b30 con 0x7f7194141cc0 2024-04-17T05:34:25.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.985+0000 7f718be00640 1 -- 172.21.15.123:0/3475809484 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7180007830 con 0x7f7194141cc0 2024-04-17T05:34:25.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.986+0000 7f718be00640 1 --2- 172.21.15.123:0/3475809484 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f717406c8f0 0x7f717406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:25.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.986+0000 7f718be00640 1 -- 172.21.15.123:0/3475809484 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6850+0+0 (secure 0 0 0) 0x7f718008c260 con 0x7f7194141cc0 2024-04-17T05:34:25.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.987+0000 7f7193e00640 1 --2- 172.21.15.123:0/3475809484 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f717406c8f0 0x7f717406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:25.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.988+0000 7f7193e00640 1 --2- 172.21.15.123:0/3475809484 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f717406c8f0 0x7f717406edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7184036000 tx=0x7f7184008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:25.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:25.991+0000 7f718be00640 1 -- 172.21.15.123:0/3475809484 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f718005a200 con 0x7f7194141cc0 2024-04-17T05:34:26.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:26.233+0000 7f7199800640 1 -- 172.21.15.123:0/3475809484 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f719413b040 con 0x7f7194141cc0 2024-04-17T05:34:26.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:26.840+0000 7f718be00640 1 -- 172.21.15.123:0/3475809484 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f7180059b00 con 0x7f7194141cc0 2024-04-17T05:34:26.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:26.843+0000 7f7199800640 1 -- 172.21.15.123:0/3475809484 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f717406c8f0 msgr2=0x7f717406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:26.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:26.843+0000 7f7199800640 1 --2- 172.21.15.123:0/3475809484 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f717406c8f0 0x7f717406edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7184036000 tx=0x7f7184008030 comp rx=0 tx=0).stop 2024-04-17T05:34:26.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:26.843+0000 7f7199800640 1 -- 172.21.15.123:0/3475809484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7194141cc0 msgr2=0x7f71941402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:26.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:26.843+0000 7f7199800640 1 --2- 172.21.15.123:0/3475809484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7194141cc0 0x7f71941402a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f718000c820 tx=0x7f718000cce0 comp rx=0 tx=0).stop 2024-04-17T05:34:26.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:26.844+0000 7f7199800640 1 -- 172.21.15.123:0/3475809484 shutdown_connections 2024-04-17T05:34:26.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:26.844+0000 7f7199800640 1 --2- 172.21.15.123:0/3475809484 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7194148690 0x7f719413a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:26.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:26.844+0000 7f7199800640 1 --2- 172.21.15.123:0/3475809484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7194141cc0 0x7f71941402a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:26.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:26.844+0000 7f7199800640 1 --2- 172.21.15.123:0/3475809484 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f717406c8f0 0x7f717406edb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:26.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:26.844+0000 7f7199800640 1 --2- 172.21.15.123:0/3475809484 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f71940b6200 0x7f71941410a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:26.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:26.844+0000 7f7199800640 1 -- 172.21.15.123:0/3475809484 >> 172.21.15.123:0/3475809484 conn(0x7f71940bdbe0 msgr2=0x7f719406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:26.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:26.844+0000 7f7199800640 1 -- 172.21.15.123:0/3475809484 shutdown_connections 2024-04-17T05:34:26.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:26.844+0000 7f7199800640 1 -- 172.21.15.123:0/3475809484 wait complete. 2024-04-17T05:34:26.866 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-17T05:34:27.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.082+0000 7fef37e00640 1 Processor -- start 2024-04-17T05:34:27.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.082+0000 7fef37e00640 1 -- start start 2024-04-17T05:34:27.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.083+0000 7fef37e00640 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fef380b9b00 0x7fef380b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:27.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.083+0000 7fef37e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fef3813e3f0 0x7fef3813e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:27.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.083+0000 7fef37e00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef380b9ee0 con 0x7fef381446d0 2024-04-17T05:34:27.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.083+0000 7fef37e00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fef3813eda0 con 0x7fef3813e3f0 2024-04-17T05:34:27.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.083+0000 7fef37e00640 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 -- 0x7fef38070ac0 con 0x7fef380b9b00 2024-04-17T05:34:27.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.084+0000 7fef2e000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fef3813e3f0 0x7fef3813e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:27.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.084+0000 7fef2e000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fef3813e3f0 0x7fef3813e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35820/0 (socket says 172.21.15.123:35820) 2024-04-17T05:34:27.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.084+0000 7fef2e000640 1 -- 172.21.15.123:0/178595283 learned_addr learned my addr 172.21.15.123:0/178595283 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:34:27.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.084+0000 7fef37400640 1 --1- 172.21.15.123:0/178595283 >> v1:172.21.15.123:6789/0 conn(0x7fef381446d0 0x7fef38144ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56440/0 (socket says 172.21.15.123:56440) 2024-04-17T05:34:27.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.084+0000 7fef36a00640 1 --2- 172.21.15.123:0/178595283 >> v2:172.21.15.164:3300/0 conn(0x7fef380b9b00 0x7fef380b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:27.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.084+0000 7fef2e000640 1 -- 172.21.15.123:0/178595283 >> v2:172.21.15.164:3300/0 conn(0x7fef380b9b00 msgr2=0x7fef380b2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:27.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.084+0000 7fef2e000640 1 --2- 172.21.15.123:0/178595283 >> v2:172.21.15.164:3300/0 conn(0x7fef380b9b00 0x7fef380b2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:27.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.084+0000 7fef2e000640 1 -- 172.21.15.123:0/178595283 >> v1:172.21.15.123:6789/0 conn(0x7fef381446d0 legacy=0x7fef38144ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:27.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.084+0000 7fef2e000640 1 -- 172.21.15.123:0/178595283 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef380b1c40 con 0x7fef3813e3f0 2024-04-17T05:34:27.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.085+0000 7fef2e000640 1 --2- 172.21.15.123:0/178595283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef3813e3f0 0x7fef3813e860 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fef3806e9b0 tx=0x7fef2002b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66613251550d3b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:27.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.085+0000 7fef36000640 1 -- 172.21.15.123:0/178595283 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef20034070 con 0x7fef3813e3f0 2024-04-17T05:34:27.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.086+0000 7fef36000640 1 -- 172.21.15.123:0/178595283 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fef20030850 con 0x7fef3813e3f0 2024-04-17T05:34:27.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.086+0000 7fef36000640 1 -- 172.21.15.123:0/178595283 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef20030c40 con 0x7fef3813e3f0 2024-04-17T05:34:27.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.086+0000 7fef37e00640 1 -- 172.21.15.123:0/178595283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef3813e3f0 msgr2=0x7fef3813e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:27.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.086+0000 7fef37e00640 1 --2- 172.21.15.123:0/178595283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef3813e3f0 0x7fef3813e860 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fef3806e9b0 tx=0x7fef2002b990 comp rx=0 tx=0).stop 2024-04-17T05:34:27.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.086+0000 7fef37e00640 1 -- 172.21.15.123:0/178595283 shutdown_connections 2024-04-17T05:34:27.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.086+0000 7fef37e00640 1 --2- 172.21.15.123:0/178595283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef3813e3f0 0x7fef3813e860 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:27.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.086+0000 7fef37e00640 1 --2- 172.21.15.123:0/178595283 >> v2:172.21.15.164:3300/0 conn(0x7fef380b9b00 0x7fef380b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:27.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.086+0000 7fef37e00640 1 -- 172.21.15.123:0/178595283 >> 172.21.15.123:0/178595283 conn(0x7fef3806c100 msgr2=0x7fef380b9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:27.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.086+0000 7fef37e00640 1 -- 172.21.15.123:0/178595283 shutdown_connections 2024-04-17T05:34:27.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.086+0000 7fef37e00640 1 -- 172.21.15.123:0/178595283 wait complete. 2024-04-17T05:34:27.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.088+0000 7fef37e00640 1 Processor -- start 2024-04-17T05:34:27.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.088+0000 7fef37e00640 1 -- start start 2024-04-17T05:34:27.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.089+0000 7fef37e00640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef380b9b00 0x7fef380af100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:27.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.089+0000 7fef37e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef3813e3f0 0x7fef381e05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:27.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.089+0000 7fef37e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef381446d0 0x7fef3813b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:27.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.089+0000 7fef37e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fef380b18a0 con 0x7fef381446d0 2024-04-17T05:34:27.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.089+0000 7fef37e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fef380b32a0 con 0x7fef3813e3f0 2024-04-17T05:34:27.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.089+0000 7fef37e00640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fef380b1a20 con 0x7fef380b9b00 2024-04-17T05:34:27.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.089+0000 7fef37400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef381446d0 0x7fef3813b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:27.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.089+0000 7fef37400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef381446d0 0x7fef3813b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35836/0 (socket says 172.21.15.123:35836) 2024-04-17T05:34:27.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.089+0000 7fef37400640 1 -- 172.21.15.123:0/2600779170 learned_addr learned my addr 172.21.15.123:0/2600779170 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:34:27.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.089+0000 7fef37400640 1 -- 172.21.15.123:0/2600779170 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef380b9b00 msgr2=0x7fef380af100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:27.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.089+0000 7fef37400640 1 --2- 172.21.15.123:0/2600779170 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef380b9b00 0x7fef380af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:27.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.089+0000 7fef2e000640 1 --2- 172.21.15.123:0/2600779170 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef3813e3f0 0x7fef381e05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:27.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.090+0000 7fef37400640 1 -- 172.21.15.123:0/2600779170 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef3813e3f0 msgr2=0x7fef381e05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:27.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.090+0000 7fef37400640 1 --2- 172.21.15.123:0/2600779170 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef3813e3f0 0x7fef381e05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:27.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.090+0000 7fef37400640 1 -- 172.21.15.123:0/2600779170 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef38146650 con 0x7fef381446d0 2024-04-17T05:34:27.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.090+0000 7fef37400640 1 --2- 172.21.15.123:0/2600779170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef381446d0 0x7fef3813b2c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fef3000c760 tx=0x7fef3000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:27.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.090+0000 7fef2fe00640 1 -- 172.21.15.123:0/2600779170 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef30017070 con 0x7fef381446d0 2024-04-17T05:34:27.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.090+0000 7fef2fe00640 1 -- 172.21.15.123:0/2600779170 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fef3000a640 con 0x7fef381446d0 2024-04-17T05:34:27.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.090+0000 7fef2fe00640 1 -- 172.21.15.123:0/2600779170 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3000a9f0 con 0x7fef381446d0 2024-04-17T05:34:27.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.090+0000 7fef37e00640 1 -- 172.21.15.123:0/2600779170 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef38146930 con 0x7fef381446d0 2024-04-17T05:34:27.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.090+0000 7fef37e00640 1 -- 172.21.15.123:0/2600779170 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef38147170 con 0x7fef381446d0 2024-04-17T05:34:27.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.092+0000 7fef37e00640 1 -- 172.21.15.123:0/2600779170 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef380b3870 con 0x7fef381446d0 2024-04-17T05:34:27.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.092+0000 7fef2fe00640 1 -- 172.21.15.123:0/2600779170 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fef3001a070 con 0x7fef381446d0 2024-04-17T05:34:27.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.093+0000 7fef2fe00640 1 --2- 172.21.15.123:0/2600779170 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fef1406c920 0x7fef1406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:27.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.093+0000 7fef2fe00640 1 -- 172.21.15.123:0/2600779170 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6850+0+0 (secure 0 0 0) 0x7fef3008b590 con 0x7fef381446d0 2024-04-17T05:34:27.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.094+0000 7fef36a00640 1 --2- 172.21.15.123:0/2600779170 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fef1406c920 0x7fef1406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:27.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.095+0000 7fef36a00640 1 --2- 172.21.15.123:0/2600779170 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fef1406c920 0x7fef1406ede0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fef280098f0 tx=0x7fef28008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:27.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.098+0000 7fef2fe00640 1 -- 172.21.15.123:0/2600779170 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fef380b3870 con 0x7fef381446d0 2024-04-17T05:34:27.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.300+0000 7fef37e00640 1 -- 172.21.15.123:0/2600779170 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fef38075b30 con 0x7fef381446d0 2024-04-17T05:34:27.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.844+0000 7fef2fe00640 1 -- 172.21.15.123:0/2600779170 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) ==== 181+0+0 (secure 0 0 0) 0x7fef30058e50 con 0x7fef381446d0 2024-04-17T05:34:27.843 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' removed 2024-04-17T05:34:27.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.848+0000 7fef37e00640 1 -- 172.21.15.123:0/2600779170 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fef1406c920 msgr2=0x7fef1406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:27.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.848+0000 7fef37e00640 1 --2- 172.21.15.123:0/2600779170 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fef1406c920 0x7fef1406ede0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fef280098f0 tx=0x7fef28008040 comp rx=0 tx=0).stop 2024-04-17T05:34:27.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.848+0000 7fef37e00640 1 -- 172.21.15.123:0/2600779170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef381446d0 msgr2=0x7fef3813b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:27.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.848+0000 7fef37e00640 1 --2- 172.21.15.123:0/2600779170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef381446d0 0x7fef3813b2c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fef3000c760 tx=0x7fef3000cc20 comp rx=0 tx=0).stop 2024-04-17T05:34:27.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.848+0000 7fef37e00640 1 -- 172.21.15.123:0/2600779170 shutdown_connections 2024-04-17T05:34:27.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.848+0000 7fef37e00640 1 --2- 172.21.15.123:0/2600779170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef381446d0 0x7fef3813b2c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:27.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.848+0000 7fef37e00640 1 --2- 172.21.15.123:0/2600779170 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef3813e3f0 0x7fef381e05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:27.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.848+0000 7fef37e00640 1 --2- 172.21.15.123:0/2600779170 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fef1406c920 0x7fef1406ede0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:27.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.848+0000 7fef37e00640 1 --2- 172.21.15.123:0/2600779170 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fef380b9b00 0x7fef380af100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:27.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.848+0000 7fef37e00640 1 -- 172.21.15.123:0/2600779170 >> 172.21.15.123:0/2600779170 conn(0x7fef3806c100 msgr2=0x7fef380afb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:27.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.849+0000 7fef37e00640 1 -- 172.21.15.123:0/2600779170 shutdown_connections 2024-04-17T05:34:27.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:27.849+0000 7fef37e00640 1 -- 172.21.15.123:0/2600779170 wait complete. 2024-04-17T05:34:27.874 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-17T05:34:28.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.088+0000 7f9e14600640 1 Processor -- start 2024-04-17T05:34:28.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.089+0000 7f9e14600640 1 -- start start 2024-04-17T05:34:28.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.090+0000 7f9e14600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9e0c14bac0 0x7f9e0c141e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:28.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.090+0000 7f9e14600640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e0c0badb0 con 0x7f9e0c1419b0 2024-04-17T05:34:28.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.090+0000 7f9e14600640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e0c0b55b0 con 0x7f9e0c0ba9d0 2024-04-17T05:34:28.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.090+0000 7f9e14600640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f9e0c0b76c0 con 0x7f9e0c14bac0 2024-04-17T05:34:28.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.090+0000 7f9e12600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9e0c14bac0 0x7f9e0c141e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:28.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.090+0000 7f9e12600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9e0c14bac0 0x7f9e0c141e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35850/0 (socket says 172.21.15.123:35850) 2024-04-17T05:34:28.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.090+0000 7f9e12600640 1 -- 172.21.15.123:0/3507196667 learned_addr learned my addr 172.21.15.123:0/3507196667 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:34:28.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.091+0000 7f9e12600640 1 -- 172.21.15.123:0/3507196667 >> v1:172.21.15.164:6789/0 conn(0x7f9e0c0ba9d0 legacy=0x7f9e0c0b5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:28.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.091+0000 7f9e12600640 1 -- 172.21.15.123:0/3507196667 >> v1:172.21.15.123:6789/0 conn(0x7f9e0c1419b0 legacy=0x7f9e0c14b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:28.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.091+0000 7f9e12600640 1 -- 172.21.15.123:0/3507196667 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e0c0b5890 con 0x7f9e0c14bac0 2024-04-17T05:34:28.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.092+0000 7f9e12600640 1 --2- 172.21.15.123:0/3507196667 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e0c14bac0 0x7f9e0c141e40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9e04009e50 tx=0x7f9e0402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=662517048181a5d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:28.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.092+0000 7f9e0be00640 1 -- 172.21.15.123:0/3507196667 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0402c9f0 con 0x7f9e0c14bac0 2024-04-17T05:34:28.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.092+0000 7f9e0be00640 1 -- 172.21.15.123:0/3507196667 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9e0402cb90 con 0x7f9e0c14bac0 2024-04-17T05:34:28.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.092+0000 7f9e0be00640 1 -- 172.21.15.123:0/3507196667 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e040343f0 con 0x7f9e0c14bac0 2024-04-17T05:34:28.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.093+0000 7f9e14600640 1 -- 172.21.15.123:0/3507196667 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e0c14bac0 msgr2=0x7f9e0c141e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:28.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.093+0000 7f9e14600640 1 --2- 172.21.15.123:0/3507196667 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e0c14bac0 0x7f9e0c141e40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9e04009e50 tx=0x7f9e0402be50 comp rx=0 tx=0).stop 2024-04-17T05:34:28.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.093+0000 7f9e14600640 1 -- 172.21.15.123:0/3507196667 shutdown_connections 2024-04-17T05:34:28.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.093+0000 7f9e14600640 1 --2- 172.21.15.123:0/3507196667 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e0c14bac0 0x7f9e0c141e40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:28.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.093+0000 7f9e14600640 1 -- 172.21.15.123:0/3507196667 >> 172.21.15.123:0/3507196667 conn(0x7f9e0c0bdf10 msgr2=0x7f9e0c0b9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:28.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.093+0000 7f9e14600640 1 -- 172.21.15.123:0/3507196667 shutdown_connections 2024-04-17T05:34:28.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.093+0000 7f9e14600640 1 -- 172.21.15.123:0/3507196667 wait complete. 2024-04-17T05:34:28.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.095+0000 7f9e14600640 1 Processor -- start 2024-04-17T05:34:28.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.095+0000 7f9e14600640 1 -- start start 2024-04-17T05:34:28.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.095+0000 7f9e14600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e0c0ba9d0 0x7f9e0c142a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:28.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.096+0000 7f9e14600640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e0c1419b0 0x7f9e0c1dd970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:28.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.096+0000 7f9e14600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e0c14bac0 0x7f9e0c133530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:28.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.096+0000 7f9e14600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0c153690 con 0x7f9e0c14bac0 2024-04-17T05:34:28.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.096+0000 7f9e14600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0c153510 con 0x7f9e0c0ba9d0 2024-04-17T05:34:28.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.096+0000 7f9e14600640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7f9e0c153810 con 0x7f9e0c1419b0 2024-04-17T05:34:28.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.096+0000 7f9e12600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e0c14bac0 0x7f9e0c133530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:28.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.096+0000 7f9e12600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e0c14bac0 0x7f9e0c133530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35860/0 (socket says 172.21.15.123:35860) 2024-04-17T05:34:28.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.096+0000 7f9e12600640 1 -- 172.21.15.123:0/3737600555 learned_addr learned my addr 172.21.15.123:0/3737600555 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:34:28.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.096+0000 7f9e12600640 1 -- 172.21.15.123:0/3737600555 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e0c1419b0 msgr2=0x7f9e0c1dd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:28.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.096+0000 7f9e12600640 1 --2- 172.21.15.123:0/3737600555 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e0c1419b0 0x7f9e0c1dd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:28.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.096+0000 7f9e12600640 1 -- 172.21.15.123:0/3737600555 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e0c0ba9d0 msgr2=0x7f9e0c142a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:28.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.096+0000 7f9e12600640 1 --2- 172.21.15.123:0/3737600555 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e0c0ba9d0 0x7f9e0c142a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:28.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.096+0000 7f9e12600640 1 -- 172.21.15.123:0/3737600555 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e0c1432e0 con 0x7f9e0c14bac0 2024-04-17T05:34:28.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.097+0000 7f9e12600640 1 --2- 172.21.15.123:0/3737600555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e0c14bac0 0x7f9e0c133530 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9e04036040 tx=0x7f9e04004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:28.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.097+0000 7f9e09600640 1 -- 172.21.15.123:0/3737600555 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e04043020 con 0x7f9e0c14bac0 2024-04-17T05:34:28.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.097+0000 7f9e09600640 1 -- 172.21.15.123:0/3737600555 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9e0403e450 con 0x7f9e0c14bac0 2024-04-17T05:34:28.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.097+0000 7f9e09600640 1 -- 172.21.15.123:0/3737600555 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0403e880 con 0x7f9e0c14bac0 2024-04-17T05:34:28.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.097+0000 7f9e14600640 1 -- 172.21.15.123:0/3737600555 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e0c144570 con 0x7f9e0c14bac0 2024-04-17T05:34:28.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.097+0000 7f9e14600640 1 -- 172.21.15.123:0/3737600555 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e0c144ce0 con 0x7f9e0c14bac0 2024-04-17T05:34:28.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.098+0000 7f9e14600640 1 -- 172.21.15.123:0/3737600555 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e0c0b7b50 con 0x7f9e0c14bac0 2024-04-17T05:34:28.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.099+0000 7f9e09600640 1 -- 172.21.15.123:0/3737600555 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9e04046020 con 0x7f9e0c14bac0 2024-04-17T05:34:28.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.100+0000 7f9e09600640 1 --2- 172.21.15.123:0/3737600555 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f9df006c8f0 0x7f9df006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:28.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.100+0000 7f9e09600640 1 -- 172.21.15.123:0/3737600555 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6412+0+0 (secure 0 0 0) 0x7f9e040ae830 con 0x7f9e0c14bac0 2024-04-17T05:34:28.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.101+0000 7f9e11c00640 1 --2- 172.21.15.123:0/3737600555 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f9df006c8f0 0x7f9df006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:28.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.102+0000 7f9e11c00640 1 --2- 172.21.15.123:0/3737600555 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f9df006c8f0 0x7f9df006edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c0bb580 tx=0x7f9e000079b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:28.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.105+0000 7f9e09600640 1 -- 172.21.15.123:0/3737600555 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f9e0c0b7b50 con 0x7f9e0c14bac0 2024-04-17T05:34:28.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.300+0000 7f9e14600640 1 -- 172.21.15.123:0/3737600555 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9e0c141760 con 0x7f9e0c14bac0 2024-04-17T05:34:28.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.870+0000 7f9e09600640 1 -- 172.21.15.123:0/3737600555 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) ==== 169+0+0 (secure 0 0 0) 0x7f9e0404d030 con 0x7f9e0c14bac0 2024-04-17T05:34:28.869 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' removed 2024-04-17T05:34:28.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.874+0000 7f9e14600640 1 -- 172.21.15.123:0/3737600555 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f9df006c8f0 msgr2=0x7f9df006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:28.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.874+0000 7f9e14600640 1 --2- 172.21.15.123:0/3737600555 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f9df006c8f0 0x7f9df006edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c0bb580 tx=0x7f9e000079b0 comp rx=0 tx=0).stop 2024-04-17T05:34:28.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.874+0000 7f9e14600640 1 -- 172.21.15.123:0/3737600555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e0c14bac0 msgr2=0x7f9e0c133530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:28.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.874+0000 7f9e14600640 1 --2- 172.21.15.123:0/3737600555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e0c14bac0 0x7f9e0c133530 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9e04036040 tx=0x7f9e04004a40 comp rx=0 tx=0).stop 2024-04-17T05:34:28.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.874+0000 7f9e14600640 1 -- 172.21.15.123:0/3737600555 shutdown_connections 2024-04-17T05:34:28.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.874+0000 7f9e14600640 1 --2- 172.21.15.123:0/3737600555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e0c14bac0 0x7f9e0c133530 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:28.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.874+0000 7f9e14600640 1 --2- 172.21.15.123:0/3737600555 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7f9df006c8f0 0x7f9df006edb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:28.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.874+0000 7f9e14600640 1 --2- 172.21.15.123:0/3737600555 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e0c1419b0 0x7f9e0c1dd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:28.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.874+0000 7f9e14600640 1 --2- 172.21.15.123:0/3737600555 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e0c0ba9d0 0x7f9e0c142a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:28.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.874+0000 7f9e14600640 1 -- 172.21.15.123:0/3737600555 >> 172.21.15.123:0/3737600555 conn(0x7f9e0c0bdf10 msgr2=0x7f9e0c0676c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:28.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.875+0000 7f9e14600640 1 -- 172.21.15.123:0/3737600555 shutdown_connections 2024-04-17T05:34:28.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:28.875+0000 7f9e14600640 1 -- 172.21.15.123:0/3737600555 wait complete. 2024-04-17T05:34:28.901 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-17T05:34:29.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.111+0000 7fb3b7000640 1 Processor -- start 2024-04-17T05:34:29.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.111+0000 7fb3b7000640 1 -- start start 2024-04-17T05:34:29.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.113+0000 7fb3b7000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb3b00b3fd0 0x7fb3b00b3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:29.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.113+0000 7fb3b7000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3b0070cc0 con 0x7fb3b013ed00 2024-04-17T05:34:29.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.113+0000 7fb3b7000640 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3b00b43b0 con 0x7fb3b00b1ba0 2024-04-17T05:34:29.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.113+0000 7fb3b7000640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb3b00b2680 con 0x7fb3b00b3fd0 2024-04-17T05:34:29.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.113+0000 7fb3afe00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb3b00b3fd0 0x7fb3b00b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:29.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.113+0000 7fb3afe00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb3b00b3fd0 0x7fb3b00b3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35864/0 (socket says 172.21.15.123:35864) 2024-04-17T05:34:29.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.113+0000 7fb3afe00640 1 -- 172.21.15.123:0/2599408378 learned_addr learned my addr 172.21.15.123:0/2599408378 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:34:29.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.113+0000 7fb3b5000640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb3b013ed00 0x7fb3b0144810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56460/0 (socket says 172.21.15.123:56460) 2024-04-17T05:34:29.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.114+0000 7fb3afe00640 1 -- 172.21.15.123:0/2599408378 >> v1:172.21.15.164:6789/0 conn(0x7fb3b00b1ba0 legacy=0x7fb3b013e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T05:34:29.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.114+0000 7fb3afe00640 1 -- 172.21.15.123:0/2599408378 >> v1:172.21.15.123:6789/0 conn(0x7fb3b013ed00 legacy=0x7fb3b0144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:29.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.114+0000 7fb3afe00640 1 -- 172.21.15.123:0/2599408378 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b00b2030 con 0x7fb3b00b3fd0 2024-04-17T05:34:29.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.115+0000 7fb3afe00640 1 --2- 172.21.15.123:0/2599408378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3b00b3fd0 0x7fb3b00b3370 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0009870 tx=0x7fb3a002dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=761fb65bdf7d8c01 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:29.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.115+0000 7fb3af400640 1 -- 172.21.15.123:0/2599408378 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a003b070 con 0x7fb3b00b3fd0 2024-04-17T05:34:29.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.115+0000 7fb3af400640 1 -- 172.21.15.123:0/2599408378 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb3a002e960 con 0x7fb3b00b3fd0 2024-04-17T05:34:29.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.115+0000 7fb3af400640 1 -- 172.21.15.123:0/2599408378 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a002ed50 con 0x7fb3b00b3fd0 2024-04-17T05:34:29.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.116+0000 7fb3b7000640 1 -- 172.21.15.123:0/2599408378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3b00b3fd0 msgr2=0x7fb3b00b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:29.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.116+0000 7fb3b7000640 1 --2- 172.21.15.123:0/2599408378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3b00b3fd0 0x7fb3b00b3370 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0009870 tx=0x7fb3a002dbb0 comp rx=0 tx=0).stop 2024-04-17T05:34:29.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.116+0000 7fb3b7000640 1 -- 172.21.15.123:0/2599408378 shutdown_connections 2024-04-17T05:34:29.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.116+0000 7fb3b7000640 1 --2- 172.21.15.123:0/2599408378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3b00b3fd0 0x7fb3b00b3370 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:29.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.116+0000 7fb3b7000640 1 -- 172.21.15.123:0/2599408378 >> 172.21.15.123:0/2599408378 conn(0x7fb3b006c2f0 msgr2=0x7fb3b00b9360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:29.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.116+0000 7fb3b7000640 1 -- 172.21.15.123:0/2599408378 shutdown_connections 2024-04-17T05:34:29.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.116+0000 7fb3b7000640 1 -- 172.21.15.123:0/2599408378 wait complete. 2024-04-17T05:34:29.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.117+0000 7fb3b7000640 1 Processor -- start 2024-04-17T05:34:29.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.117+0000 7fb3b7000640 1 -- start start 2024-04-17T05:34:29.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.118+0000 7fb3b7000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb3b00b3fd0 0x7fb3b00afd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:29.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.118+0000 7fb3b7000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3b013ed00 0x7fb3b01dd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:29.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.118+0000 7fb3b7000640 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb3b0141e70 0x7fb3b01d7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:29.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.118+0000 7fb3b7000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b01450a0 con 0x7fb3b013ed00 2024-04-17T05:34:29.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.118+0000 7fb3b7000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b0144f20 con 0x7fb3b00b3fd0 2024-04-17T05:34:29.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.118+0000 7fb3b7000640 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 -- 0x7fb3b0145220 con 0x7fb3b0141e70 2024-04-17T05:34:29.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.118+0000 7fb3a7400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3b013ed00 0x7fb3b01dd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:29.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.118+0000 7fb3a7400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3b013ed00 0x7fb3b01dd330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35874/0 (socket says 172.21.15.123:35874) 2024-04-17T05:34:29.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.118+0000 7fb3a7400640 1 -- 172.21.15.123:0/1376706441 learned_addr learned my addr 172.21.15.123:0/1376706441 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-17T05:34:29.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.119+0000 7fb3afe00640 1 --2- 172.21.15.123:0/1376706441 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb3b00b3fd0 0x7fb3b00afd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:29.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.119+0000 7fb3a7400640 1 -- 172.21.15.123:0/1376706441 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb3b0141e70 msgr2=0x7fb3b01d7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:29.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.119+0000 7fb3b5000640 1 --2- 172.21.15.123:0/1376706441 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb3b0141e70 0x7fb3b01d7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:29.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.119+0000 7fb3a7400640 1 --2- 172.21.15.123:0/1376706441 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb3b0141e70 0x7fb3b01d7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:29.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.119+0000 7fb3a7400640 1 -- 172.21.15.123:0/1376706441 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb3b00b3fd0 msgr2=0x7fb3b00afd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:29.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.119+0000 7fb3a7400640 1 --2- 172.21.15.123:0/1376706441 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb3b00b3fd0 0x7fb3b00afd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:29.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.119+0000 7fb3a7400640 1 -- 172.21.15.123:0/1376706441 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b0140ff0 con 0x7fb3b013ed00 2024-04-17T05:34:29.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.119+0000 7fb3afe00640 1 --2- 172.21.15.123:0/1376706441 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb3b00b3fd0 0x7fb3b00afd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T05:34:29.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.119+0000 7fb3a7400640 1 --2- 172.21.15.123:0/1376706441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3b013ed00 0x7fb3b01dd330 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb39800c3f0 tx=0x7fb39800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:29.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.119+0000 7fb3acc00640 1 -- 172.21.15.123:0/1376706441 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb398007020 con 0x7fb3b013ed00 2024-04-17T05:34:29.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.119+0000 7fb3acc00640 1 -- 172.21.15.123:0/1376706441 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb3980071c0 con 0x7fb3b013ed00 2024-04-17T05:34:29.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.119+0000 7fb3acc00640 1 -- 172.21.15.123:0/1376706441 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3980075b0 con 0x7fb3b013ed00 2024-04-17T05:34:29.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.120+0000 7fb3b7000640 1 -- 172.21.15.123:0/1376706441 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3b01412d0 con 0x7fb3b013ed00 2024-04-17T05:34:29.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.120+0000 7fb3b7000640 1 -- 172.21.15.123:0/1376706441 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3b0140c80 con 0x7fb3b013ed00 2024-04-17T05:34:29.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.121+0000 7fb3b7000640 1 -- 172.21.15.123:0/1376706441 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3b0068a40 con 0x7fb3b013ed00 2024-04-17T05:34:29.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.122+0000 7fb3acc00640 1 -- 172.21.15.123:0/1376706441 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb398019020 con 0x7fb3b013ed00 2024-04-17T05:34:29.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.122+0000 7fb3acc00640 1 --2- 172.21.15.123:0/1376706441 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fb38c06c8f0 0x7fb38c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T05:34:29.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.123+0000 7fb3acc00640 1 -- 172.21.15.123:0/1376706441 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5853+0+0 (secure 0 0 0) 0x7fb39808b450 con 0x7fb3b013ed00 2024-04-17T05:34:29.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.123+0000 7fb3afe00640 1 --2- 172.21.15.123:0/1376706441 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fb38c06c8f0 0x7fb38c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T05:34:29.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.124+0000 7fb3afe00640 1 --2- 172.21.15.123:0/1376706441 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fb38c06c8f0 0x7fb38c06edb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0038000 tx=0x7fb3a0032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T05:34:29.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.127+0000 7fb3acc00640 1 -- 172.21.15.123:0/1376706441 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fb398059750 con 0x7fb3b013ed00 2024-04-17T05:34:29.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.330+0000 7fb3b7000640 1 -- 172.21.15.123:0/1376706441 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb3b013db90 con 0x7fb3b013ed00 2024-04-17T05:34:29.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.885+0000 7fb3acc00640 1 -- 172.21.15.123:0/1376706441 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) ==== 178+0+0 (secure 0 0 0) 0x7fb398059050 con 0x7fb3b013ed00 2024-04-17T05:34:29.883 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data_ec' removed 2024-04-17T05:34:29.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.888+0000 7fb3b7000640 1 -- 172.21.15.123:0/1376706441 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fb38c06c8f0 msgr2=0x7fb38c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:29.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.888+0000 7fb3b7000640 1 --2- 172.21.15.123:0/1376706441 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fb38c06c8f0 0x7fb38c06edb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0038000 tx=0x7fb3a0032000 comp rx=0 tx=0).stop 2024-04-17T05:34:29.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.888+0000 7fb3b7000640 1 -- 172.21.15.123:0/1376706441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3b013ed00 msgr2=0x7fb3b01dd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T05:34:29.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.888+0000 7fb3b7000640 1 --2- 172.21.15.123:0/1376706441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3b013ed00 0x7fb3b01dd330 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb39800c3f0 tx=0x7fb39800c8b0 comp rx=0 tx=0).stop 2024-04-17T05:34:29.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.888+0000 7fb3b7000640 1 -- 172.21.15.123:0/1376706441 shutdown_connections 2024-04-17T05:34:29.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.888+0000 7fb3b7000640 1 --2- 172.21.15.123:0/1376706441 >> [v2:172.21.15.164:6832/4204006015,v1:172.21.15.164:6833/4204006015] conn(0x7fb38c06c8f0 0x7fb38c06edb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:29.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.888+0000 7fb3b7000640 1 --2- 172.21.15.123:0/1376706441 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb3b0141e70 0x7fb3b01d7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:29.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.888+0000 7fb3b7000640 1 --2- 172.21.15.123:0/1376706441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3b013ed00 0x7fb3b01dd330 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:29.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.888+0000 7fb3b7000640 1 --2- 172.21.15.123:0/1376706441 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb3b00b3fd0 0x7fb3b00afd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T05:34:29.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.888+0000 7fb3b7000640 1 -- 172.21.15.123:0/1376706441 >> 172.21.15.123:0/1376706441 conn(0x7fb3b006c2f0 msgr2=0x7fb3b00b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T05:34:29.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.889+0000 7fb3b7000640 1 -- 172.21.15.123:0/1376706441 shutdown_connections 2024-04-17T05:34:29.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-17T05:34:29.889+0000 7fb3b7000640 1 -- 172.21.15.123:0/1376706441 wait complete. 2024-04-17T05:34:29.911 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-17T05:34:29.911 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-17T05:34:29.911 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T05:34:29.945 INFO:tasks.ceph.mds.a:Stopped 2024-04-17T05:34:29.946 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-17T05:34:29.946 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T05:34:29.967 INFO:tasks.ceph.mds.b:Stopped 2024-04-17T05:34:29.967 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-17T05:34:29.967 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-17T05:34:29.967 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T05:34:30.037 INFO:tasks.ceph.osd.0:Stopped 2024-04-17T05:34:30.037 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-17T05:34:30.037 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T05:34:30.097 INFO:tasks.ceph.osd.1:Stopped 2024-04-17T05:34:30.098 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-17T05:34:30.098 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T05:34:30.158 INFO:tasks.ceph.osd.2:Stopped 2024-04-17T05:34:30.158 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-17T05:34:30.158 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T05:34:30.215 INFO:tasks.ceph.osd.3:Stopped 2024-04-17T05:34:30.215 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-17T05:34:30.215 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T05:34:30.261 INFO:tasks.ceph.osd.4:Stopped 2024-04-17T05:34:30.261 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-17T05:34:30.262 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T05:34:30.309 INFO:tasks.ceph.osd.5:Stopped 2024-04-17T05:34:30.309 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-17T05:34:30.309 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T05:34:30.367 INFO:tasks.ceph.osd.6:Stopped 2024-04-17T05:34:30.367 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-17T05:34:30.367 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T05:34:30.434 INFO:tasks.ceph.osd.7:Stopped 2024-04-17T05:34:30.434 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-17T05:34:30.435 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-17T05:34:30.435 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T05:34:30.514 INFO:tasks.ceph.mgr.y:Stopped 2024-04-17T05:34:30.515 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-17T05:34:30.515 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T05:34:30.598 INFO:tasks.ceph.mgr.x:Stopped 2024-04-17T05:34:30.598 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-17T05:34:30.598 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-17T05:34:30.598 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T05:34:30.633 INFO:tasks.ceph.mon.a:Stopped 2024-04-17T05:34:30.633 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-17T05:34:30.633 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T05:34:30.663 INFO:tasks.ceph.mon.b:Stopped 2024-04-17T05:34:30.663 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-17T05:34:30.663 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T05:34:30.742 INFO:tasks.ceph.mon.c:Stopped 2024-04-17T05:34:30.742 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-17T05:34:30.742 DEBUG:teuthology.orchestra.run.smithi123:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-17T05:34:30.872 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi123.front.sepia.ceph.com 2024-04-17T05:34:30.873 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-17T05:34:31.197 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi123.front.sepia.ceph.com 2024-04-17T05:34:31.197 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-17T05:34:31.341 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi123.front.sepia.ceph.com 2024-04-17T05:34:31.341 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-17T05:34:31.472 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi123.front.sepia.ceph.com 2024-04-17T05:34:31.472 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-17T05:34:31.634 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi164.front.sepia.ceph.com 2024-04-17T05:34:31.634 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-17T05:34:31.842 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi164.front.sepia.ceph.com 2024-04-17T05:34:31.842 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-17T05:34:31.993 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi164.front.sepia.ceph.com 2024-04-17T05:34:31.994 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-17T05:34:32.170 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi164.front.sepia.ceph.com 2024-04-17T05:34:32.170 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-17T05:34:32.349 INFO:tasks.ceph:Archiving mon data... 2024-04-17T05:34:32.350 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659843/data/mon.a.tgz 2024-04-17T05:34:32.350 DEBUG:teuthology.orchestra.run.smithi123:> mktemp 2024-04-17T05:34:32.410 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/tmp.zreGSAStnQ 2024-04-17T05:34:32.410 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.zreGSAStnQ 2024-04-17T05:34:32.605 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0666 /tmp/tmp.zreGSAStnQ 2024-04-17T05:34:32.781 DEBUG:teuthology.orchestra.remote:smithi123:/tmp/tmp.zreGSAStnQ is 339KB 2024-04-17T05:34:32.894 DEBUG:teuthology.orchestra.run.smithi123:> rm -fr /tmp/tmp.zreGSAStnQ 2024-04-17T05:34:32.952 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659843/data/mon.b.tgz 2024-04-17T05:34:32.952 DEBUG:teuthology.orchestra.run.smithi164:> mktemp 2024-04-17T05:34:33.009 INFO:teuthology.orchestra.run.smithi164.stdout:/tmp/tmp.Y0yu6d2k9a 2024-04-17T05:34:33.009 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Y0yu6d2k9a 2024-04-17T05:34:33.220 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0666 /tmp/tmp.Y0yu6d2k9a 2024-04-17T05:34:33.357 DEBUG:teuthology.orchestra.remote:smithi164:/tmp/tmp.Y0yu6d2k9a is 453KB 2024-04-17T05:34:33.464 DEBUG:teuthology.orchestra.run.smithi164:> rm -fr /tmp/tmp.Y0yu6d2k9a 2024-04-17T05:34:33.519 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659843/data/mon.c.tgz 2024-04-17T05:34:33.519 DEBUG:teuthology.orchestra.run.smithi164:> mktemp 2024-04-17T05:34:33.568 INFO:teuthology.orchestra.run.smithi164.stdout:/tmp/tmp.A0SVEnmDkb 2024-04-17T05:34:33.568 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.A0SVEnmDkb 2024-04-17T05:34:33.760 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0666 /tmp/tmp.A0SVEnmDkb 2024-04-17T05:34:33.914 DEBUG:teuthology.orchestra.remote:smithi164:/tmp/tmp.A0SVEnmDkb is 453KB 2024-04-17T05:34:34.018 DEBUG:teuthology.orchestra.run.smithi164:> rm -fr /tmp/tmp.A0SVEnmDkb 2024-04-17T05:34:34.076 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-17T05:34:34.076 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-17T05:34:34.084 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-17T05:34:34.254 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-17T05:34:34.311 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-17T05:34:34.311 INFO:tasks.ceph:Archiving crash dumps... 2024-04-17T05:34:34.312 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659843/remote/smithi123/crash 2024-04-17T05:34:34.313 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-17T05:34:34.413 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659843/remote/smithi164/crash 2024-04-17T05:34:34.414 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-17T05:34:34.504 INFO:tasks.ceph:Shutting down logrotate 2024-04-17T05:34:34.504 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:34:34.511 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T05:34:34.672 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-17T05:34:34.790 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-17T05:34:34.890 INFO:tasks.ceph:Compressing logs... 2024-04-17T05:34:34.890 DEBUG:teuthology.orchestra.run.smithi123:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-17T05:34:34.898 DEBUG:teuthology.orchestra.run.smithi164:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-17T05:34:34.990 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-17T05:34:34.991 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36899.log 2024-04-17T05:34:34.992 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36779.log 2024-04-17T05:34:34.993 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36899.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-17T05:34:34.993 INFO:teuthology.orchestra.run.smithi164.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36899.log.gz 2024-04-17T05:34:34.994 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36779.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-17T05:34:34.995 INFO:teuthology.orchestra.run.smithi164.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36779.log.gz 2024-04-17T05:34:34.996 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36979.log 2024-04-17T05:34:34.996 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45826.log 2024-04-17T05:34:34.997 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-17T05:34:34.997 INFO:teuthology.orchestra.run.smithi164.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-17T05:34:34.998 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44770.log 2024-04-17T05:34:34.999 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36819.log 2024-04-17T05:34:34.999 INFO:teuthology.orchestra.run.smithi164.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36979.log.gz 2024-04-17T05:34:34.999 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43441.log 2024-04-17T05:34:35.000 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-17T05:34:35.000 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44770.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-17T05:34:35.001 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36819.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36819.log.gz 2024-04-17T05:34:35.001 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-17T05:34:35.002 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42528.log 2024-04-17T05:34:35.003 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-mon.a.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45826.log.gz 2024-04-17T05:34:35.003 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42390.log 2024-04-17T05:34:35.003 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36859.log 2024-04-17T05:34:35.004 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45115.log 2024-04-17T05:34:35.004 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36939.log 2024-04-17T05:34:35.005 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44440.log 2024-04-17T05:34:35.006 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44790.log 2024-04-17T05:34:35.006 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37019.log 2024-04-17T05:34:35.006 INFO:teuthology.orchestra.run.smithi164.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36859.log.gz 2024-04-17T05:34:35.007 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42294.log 2024-04-17T05:34:35.008 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36939.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-17T05:34:35.008 INFO:teuthology.orchestra.run.smithi164.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36939.log.gz 2024-04-17T05:34:35.008 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44780.log 2024-04-17T05:34:35.009 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50669.log 2024-04-17T05:34:35.009 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.37019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37059.log 2024-04-17T05:34:35.009 INFO:teuthology.orchestra.run.smithi164.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37019.log.gz 2024-04-17T05:34:35.010 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42570.log 2024-04-17T05:34:35.011 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-17T05:34:35.011 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42656.log 2024-04-17T05:34:35.011 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50669.log.gz 2024-04-17T05:34:35.012 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.37059.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37059.log.gz 2024-04-17T05:34:35.012 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45123.log 2024-04-17T05:34:35.013 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51148.log 2024-04-17T05:34:35.014 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-17T05:34:35.014 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49264.log 2024-04-17T05:34:35.015 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.51148.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51148.log.gz 2024-04-17T05:34:35.015 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45658.log 2024-04-17T05:34:35.015 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44440.log.gz 2024-04-17T05:34:35.016 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-17T05:34:35.017 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.49264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49894.log 2024-04-17T05:34:35.017 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49264.log.gz 2024-04-17T05:34:35.017 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-mon.b.log: 92.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-17T05:34:35.018 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50459.log 2024-04-17T05:34:35.018 INFO:teuthology.orchestra.run.smithi123.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45658.log.gz 2024-04-17T05:34:35.023 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.49894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45413.log 2024-04-17T05:34:35.023 INFO:teuthology.orchestra.run.smithi123.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49894.log.gz 2024-04-17T05:34:35.024 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50417.log 2024-04-17T05:34:35.024 INFO:teuthology.orchestra.run.smithi123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50459.log.gz 2024-04-17T05:34:35.024 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51064.log 2024-04-17T05:34:35.024 INFO:teuthology.orchestra.run.smithi123.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44770.log.gz 2024-04-17T05:34:35.024 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50417.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44780.log.gz 2024-04-17T05:34:35.024 INFO:teuthology.orchestra.run.smithi123.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50417.log.gz 2024-04-17T05:34:35.024 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45115.log.gz 2024-04-17T05:34:35.024 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44790.log.gz -- replaced with /var/log/ceph/ceph-client.admin.45123.log.gz 2024-04-17T05:34:35.024 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-04-17T05:34:35.024 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42348.log 2024-04-17T05:34:35.024 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45413.log.gz 2024-04-17T05:34:35.024 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.51064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50501.log 2024-04-17T05:34:35.024 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51064.log.gz 2024-04-17T05:34:35.024 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46120.log 2024-04-17T05:34:35.026 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50938.log 2024-04-17T05:34:35.026 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50501.log.gz 2024-04-17T05:34:35.026 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42294.log.gz 2024-04-17T05:34:35.026 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42348.log.gz 2024-04-17T05:34:35.026 INFO:teuthology.orchestra.run.smithi123.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42390.log.gz 2024-04-17T05:34:35.026 INFO:teuthology.orchestra.run.smithi123.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42570.log.gz 2024-04-17T05:34:35.026 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42528.log.gz 2024-04-17T05:34:35.026 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46511.log 2024-04-17T05:34:35.027 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50814.log 2024-04-17T05:34:35.027 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50938.log.gz 2024-04-17T05:34:35.028 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44092.log 2024-04-17T05:34:35.028 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44398.log 2024-04-17T05:34:35.029 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50814.log.gz 2024-04-17T05:34:35.029 INFO:teuthology.orchestra.run.smithi123.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.43441.log.gz 2024-04-17T05:34:35.030 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36892.log 2024-04-17T05:34:35.030 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44788.log 2024-04-17T05:34:35.031 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36892.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44398.log.gz 2024-04-17T05:34:35.031 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45868.log 2024-04-17T05:34:35.032 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42740.log 2024-04-17T05:34:35.033 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44788.log.gz 2024-04-17T05:34:35.033 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44482.log 2024-04-17T05:34:35.034 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42188.log 2024-04-17T05:34:35.034 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45868.log.gz 2024-04-17T05:34:35.035 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45700.log 2024-04-17T05:34:35.036 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42612.log 2024-04-17T05:34:35.036 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44482.log.gz 2024-04-17T05:34:35.037 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45700.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30707.log 2024-04-17T05:34:35.037 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43966.log 2024-04-17T05:34:35.038 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42656.log.gz 2024-04-17T05:34:35.038 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44008.log 2024-04-17T05:34:35.039 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph.tmp-client.admin.30707.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42740.log.gz 2024-04-17T05:34:35.039 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30707.log.gz 2024-04-17T05:34:35.039 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43966.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46120.log.gz 2024-04-17T05:34:35.040 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42782.log 2024-04-17T05:34:35.040 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44008.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46511.log.gz 2024-04-17T05:34:35.040 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43614.log 2024-04-17T05:34:35.041 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42782.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-17T05:34:35.041 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42188.log.gz 2024-04-17T05:34:35.042 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42908.log 2024-04-17T05:34:35.042 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45700.log.gz -- replaced with /var/log/ceph/ceph-client.admin.42612.log.gz 2024-04-17T05:34:35.042 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-04-17T05:34:35.043 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph.audit.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42782.log.gz 2024-04-17T05:34:35.043 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46246.log 2024-04-17T05:34:35.044 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42908.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43614.log.gz 2024-04-17T05:34:35.044 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46381.log 2024-04-17T05:34:35.045 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49742.log 2024-04-17T05:34:35.046 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45910.log 2024-04-17T05:34:35.046 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.49742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49700.log 2024-04-17T05:34:35.047 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49742.log.gz 2024-04-17T05:34:35.047 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45461.log 2024-04-17T05:34:35.049 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.49700.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43966.log.gz 2024-04-17T05:34:35.049 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.44008.log.gz -5 2024-04-17T05:34:35.049 INFO:teuthology.orchestra.run.smithi123.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45404.log 2024-04-17T05:34:35.049 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49700.log.gz 2024-04-17T05:34:35.049 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44092.log.gz 2024-04-17T05:34:35.049 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45461.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42908.log.gz 2024-04-17T05:34:35.050 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42484.log 2024-04-17T05:34:35.050 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45404.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46246.log.gz 2024-04-17T05:34:35.050 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49306.log 2024-04-17T05:34:35.051 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44356.log 2024-04-17T05:34:35.052 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.49306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50711.log 2024-04-17T05:34:35.052 INFO:teuthology.orchestra.run.smithi123.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49306.log.gz 2024-04-17T05:34:35.053 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42440.log 2024-04-17T05:34:35.054 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50332.log 2024-04-17T05:34:35.054 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50711.log.gz 2024-04-17T05:34:35.054 INFO:teuthology.orchestra.run.smithi123.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.46381.log.gz 2024-04-17T05:34:35.055 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50246.log 2024-04-17T05:34:35.055 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45910.log.gz 2024-04-17T05:34:35.056 INFO:teuthology.orchestra.run.smithi123.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45461.log.gz 2024-04-17T05:34:35.057 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43782.log 2024-04-17T05:34:35.057 INFO:teuthology.orchestra.run.smithi123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50332.log.gz 2024-04-17T05:34:35.057 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42484.log.gz 2024-04-17T05:34:35.057 INFO:teuthology.orchestra.run.smithi123.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44356.log.gz 2024-04-17T05:34:35.057 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50246.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42440.log.gz 2024-04-17T05:34:35.058 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50980.log 2024-04-17T05:34:35.058 INFO:teuthology.orchestra.run.smithi123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50246.log.gz 2024-04-17T05:34:35.058 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43782.log: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-17T05:34:35.058 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42950.log 2024-04-17T05:34:35.059 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50112.log 2024-04-17T05:34:35.059 INFO:teuthology.orchestra.run.smithi123.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50980.log.gz 2024-04-17T05:34:35.060 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44566.log 2024-04-17T05:34:35.061 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50199.log 2024-04-17T05:34:35.061 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50112.log.gz 2024-04-17T05:34:35.062 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45784.log 2024-04-17T05:34:35.062 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49474.log 2024-04-17T05:34:35.063 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50199.log.gz 2024-04-17T05:34:35.063 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45784.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-17T05:34:35.064 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.49474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51190.log 2024-04-17T05:34:35.065 INFO:teuthology.orchestra.run.smithi123.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49474.log.gz 2024-04-17T05:34:35.065 INFO:teuthology.orchestra.run.smithi123.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43782.log.gz 2024-04-17T05:34:35.066 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50070.log 2024-04-17T05:34:35.067 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.51190.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.42950.log.gz 2024-04-17T05:34:35.067 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45118.log 2024-04-17T05:34:35.067 INFO:teuthology.orchestra.run.smithi123.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44566.log.gz 2024-04-17T05:34:35.067 INFO:teuthology.orchestra.run.smithi123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51190.log.gz 2024-04-17T05:34:35.067 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45784.log.gz 2024-04-17T05:34:35.068 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42126.log 2024-04-17T05:34:35.068 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50070.log.gz 2024-04-17T05:34:35.068 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44050.log 2024-04-17T05:34:35.069 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43656.log 2024-04-17T05:34:35.070 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42126.log.gz 2024-04-17T05:34:35.070 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42866.log 2024-04-17T05:34:35.070 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44050.log.gz 2024-04-17T05:34:35.071 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49390.log 2024-04-17T05:34:35.071 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43656.log.gz 2024-04-17T05:34:35.071 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49943.log 2024-04-17T05:34:35.072 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.49390.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45404.log.gz 2024-04-17T05:34:35.072 INFO:teuthology.orchestra.run.smithi123.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42866.log.gz 2024-04-17T05:34:35.073 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50028.log 2024-04-17T05:34:35.073 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49390.log.gz 2024-04-17T05:34:35.073 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.49943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49616.log 2024-04-17T05:34:35.074 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49943.log.gz 2024-04-17T05:34:35.074 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49432.log 2024-04-17T05:34:35.074 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50028.log.gz 2024-04-17T05:34:35.075 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.49616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44230.log 2024-04-17T05:34:35.075 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49616.log.gz 2024-04-17T05:34:35.076 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.49432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50543.log 2024-04-17T05:34:35.076 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49432.log.gz 2024-04-17T05:34:35.077 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51106.log 2024-04-17T05:34:35.077 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45118.log.gz 2024-04-17T05:34:35.078 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45952.log 2024-04-17T05:34:35.078 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50543.log.gz 2024-04-17T05:34:35.078 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.51106.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44230.log.gz 2024-04-17T05:34:35.079 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45454.log 2024-04-17T05:34:35.079 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51106.log.gz 2024-04-17T05:34:35.080 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45952.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-17T05:34:35.081 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45454.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36892.log.gz 2024-04-17T05:34:35.081 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45952.log.gz 2024-04-17T05:34:35.081 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45112.log 2024-04-17T05:34:35.082 INFO:teuthology.orchestra.run.smithi123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45454.log.gz 2024-04-17T05:34:35.082 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45462.log 2024-04-17T05:34:35.083 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45742.log 2024-04-17T05:34:35.084 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46036.log 2024-04-17T05:34:35.085 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46204.log 2024-04-17T05:34:35.085 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45112.log.gz 2024-04-17T05:34:35.086 INFO:teuthology.orchestra.run.smithi123.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45462.log.gz 2024-04-17T05:34:35.086 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42031.log 2024-04-17T05:34:35.087 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44775.log 2024-04-17T05:34:35.087 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43824.log 2024-04-17T05:34:35.088 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43016.log 2024-04-17T05:34:35.089 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45742.log.gz 2024-04-17T05:34:35.089 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44608.log 2024-04-17T05:34:35.090 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43016.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46204.log.gz 2024-04-17T05:34:35.090 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43882.log 2024-04-17T05:34:35.090 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44775.log.gz 2024-04-17T05:34:35.091 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43824.log.gz 2024-04-17T05:34:35.091 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44608.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43016.log.gz 2024-04-17T05:34:35.091 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50585.log 2024-04-17T05:34:35.092 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43882.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44608.log.gz 2024-04-17T05:34:35.092 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49658.log 2024-04-17T05:34:35.093 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43882.log.gz 2024-04-17T05:34:35.093 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45126.log 2024-04-17T05:34:35.093 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50585.log.gz 2024-04-17T05:34:35.093 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.49658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46162.log 2024-04-17T05:34:35.094 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49658.log.gz 2024-04-17T05:34:35.094 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45126.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-17T05:34:35.094 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46036.log.gz 2024-04-17T05:34:35.095 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45126.log.gz 2024-04-17T05:34:35.095 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50854.log 2024-04-17T05:34:35.096 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-mgr.y.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46162.log.gz 2024-04-17T05:34:35.096 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46921.log 2024-04-17T05:34:35.097 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49574.log 2024-04-17T05:34:35.097 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50854.log.gz 2024-04-17T05:34:35.098 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.46921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50156.log 2024-04-17T05:34:35.099 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.49574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45994.log 2024-04-17T05:34:35.099 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49574.log.gz 2024-04-17T05:34:35.100 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44188.log 2024-04-17T05:34:35.100 INFO:teuthology.orchestra.run.smithi123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50156.log.gz 2024-04-17T05:34:35.100 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45994.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-17T05:34:35.101 INFO:teuthology.orchestra.run.smithi123.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45994.log.gz 2024-04-17T05:34:35.101 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45458.log 2024-04-17T05:34:35.101 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-mon.c.log: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-17T05:34:35.102 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45455.log 2024-04-17T05:34:35.102 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44188.log.gz 2024-04-17T05:34:35.103 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45117.log 2024-04-17T05:34:35.104 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45455.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45458.log.gz 2024-04-17T05:34:35.104 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45125.log 2024-04-17T05:34:35.104 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49348.log 2024-04-17T05:34:35.105 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50753.log 2024-04-17T05:34:35.106 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.49348.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-17T05:34:35.106 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49348.log.gz 2024-04-17T05:34:35.107 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50896.log 2024-04-17T05:34:35.108 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50753.log: /var/log/ceph/ceph.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50753.log.gz 2024-04-17T05:34:35.108 INFO:teuthology.orchestra.run.smithi123.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45455.log.gz 2024-04-17T05:34:35.108 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43924.log 2024-04-17T05:34:35.109 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44272.log 86.9% 2024-04-17T05:34:35.109 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-04-17T05:34:35.109 INFO:teuthology.orchestra.run.smithi123.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50896.log.gz 2024-04-17T05:34:35.110 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43698.log 2024-04-17T05:34:35.110 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45117.log.gz 2024-04-17T05:34:35.111 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45125.log.gz 2024-04-17T05:34:35.111 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44272.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-17T05:34:35.112 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43924.log.gz 2024-04-17T05:34:35.112 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42235.log 2024-04-17T05:34:35.112 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36529.log 2024-04-17T05:34:35.113 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49985.log 2024-04-17T05:34:35.114 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44789.log 2024-04-17T05:34:35.115 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.49985.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44272.log.gz 2024-04-17T05:34:35.115 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44786.log 2024-04-17T05:34:35.115 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49985.log.gz 2024-04-17T05:34:35.116 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44524.log 2024-04-17T05:34:35.116 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43698.log.gz 2024-04-17T05:34:35.117 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42698.log 2024-04-17T05:34:35.118 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44787.log 2024-04-17T05:34:35.118 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45124.log 2024-04-17T05:34:35.119 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46288.log 2024-04-17T05:34:35.120 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45124.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42235.log.gz 2024-04-17T05:34:35.120 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45459.log 2024-04-17T05:34:35.121 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50288.log 2024-04-17T05:34:35.122 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50374.log 2024-04-17T05:34:35.122 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49532.log 2024-04-17T05:34:35.123 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42824.log 2024-04-17T05:34:35.124 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46078.log 2024-04-17T05:34:35.125 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44314.log 2024-04-17T05:34:35.126 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43740.log 2024-04-17T05:34:35.127 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-17T05:34:35.128 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51022.log 2024-04-17T05:34:35.129 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36786.log 2024-04-17T05:34:35.130 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50627.log 2024-04-17T05:34:35.131 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46331.log 2024-04-17T05:34:35.131 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45459.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.36529.log.gz 2024-04-17T05:34:35.131 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.50288.log: /var/log/ceph/ceph-client.admin.50374.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44789.log.gz 2024-04-17T05:34:35.132 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.49532.log: /var/log/ceph/ceph-client.admin.50627.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44786.log.gz 2024-04-17T05:34:35.133 INFO:teuthology.orchestra.run.smithi123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44524.log.gz 2024-04-17T05:34:35.133 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9%/var/log/ceph/ceph-client.admin.36786.log: -- replaced with /var/log/ceph/ceph-client.admin.42698.log.gz 2024-04-17T05:34:35.133 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50627.log.gz 2024-04-17T05:34:35.133 INFO:teuthology.orchestra.run.smithi123.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44787.log.gz 2024-04-17T05:34:35.133 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.51022.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45124.log.gz 2024-04-17T05:34:35.133 INFO:teuthology.orchestra.run.smithi123.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46288.log.gz 2024-04-17T05:34:35.134 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42824.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50288.log.gz 2024-04-17T05:34:35.134 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50374.log.gz 2024-04-17T05:34:35.134 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44314.log: 88.9%/var/log/ceph/ceph-client.admin.43740.log: -- replaced with /var/log/ceph/ceph-client.admin.49532.log.gz 2024-04-17T05:34:35.134 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46078.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51022.log.gz 2024-04-17T05:34:35.135 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46331.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45459.log.gz 2024-04-17T05:34:35.144 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36786.log.gz 2024-04-17T05:34:35.145 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44314.log.gz 2024-04-17T05:34:35.145 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42824.log.gz 2024-04-17T05:34:35.145 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46331.log.gz 2024-04-17T05:34:35.145 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43740.log.gz 2024-04-17T05:34:35.163 INFO:teuthology.orchestra.run.smithi123.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-17T05:34:35.165 INFO:teuthology.orchestra.run.smithi123.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-17T05:34:35.177 INFO:teuthology.orchestra.run.smithi164.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-17T05:34:35.225 INFO:teuthology.orchestra.run.smithi164.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-17T05:34:35.253 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46078.log.gz 2024-04-17T05:34:35.311 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42031.log.gz 2024-04-17T05:34:35.439 INFO:teuthology.orchestra.run.smithi164.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-17T05:34:35.911 INFO:teuthology.orchestra.run.smithi164.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-17T05:34:35.916 INFO:teuthology.orchestra.run.smithi164.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-17T05:34:35.992 INFO:teuthology.orchestra.run.smithi164.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-17T05:34:36.045 INFO:teuthology.orchestra.run.smithi164.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-17T05:34:36.047 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-04-17T05:34:36.047 INFO:teuthology.orchestra.run.smithi164.stderr:real 0m1.098s 2024-04-17T05:34:36.048 INFO:teuthology.orchestra.run.smithi164.stderr:user 0m4.463s 2024-04-17T05:34:36.048 INFO:teuthology.orchestra.run.smithi164.stderr:sys 0m0.448s 2024-04-17T05:34:36.362 INFO:teuthology.orchestra.run.smithi123.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.0.46921.log.gz 2024-04-17T05:34:38.665 INFO:teuthology.orchestra.run.smithi123.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-17T05:34:40.061 INFO:teuthology.orchestra.run.smithi123.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-17T05:34:40.782 INFO:teuthology.orchestra.run.smithi123.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-17T05:34:40.860 INFO:teuthology.orchestra.run.smithi123.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-17T05:34:40.930 INFO:teuthology.orchestra.run.smithi123.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-17T05:34:40.935 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-04-17T05:34:40.935 INFO:teuthology.orchestra.run.smithi123.stderr:real 0m5.990s 2024-04-17T05:34:40.935 INFO:teuthology.orchestra.run.smithi123.stderr:user 0m9.064s 2024-04-17T05:34:40.935 INFO:teuthology.orchestra.run.smithi123.stderr:sys 0m1.561s 2024-04-17T05:34:40.936 INFO:tasks.ceph:Archiving logs... 2024-04-17T05:34:40.936 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659843/remote/smithi123/log 2024-04-17T05:34:40.937 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-17T05:34:41.666 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659843/remote/smithi164/log 2024-04-17T05:34:41.667 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-17T05:34:42.351 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-17T05:34:42.361 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-17T05:34:42.361 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-17T05:34:42.369 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-17T05:34:42.525 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-17T05:34:42.535 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-17T05:34:42.535 DEBUG:teuthology.orchestra.run.smithi123:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-17T05:34:42.543 DEBUG:teuthology.orchestra.run.smithi164:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-17T05:34:42.590 INFO:teuthology.orchestra.run.smithi123.stderr:bash: line 1: ntpq: command not found 2024-04-17T05:34:42.599 INFO:teuthology.orchestra.run.smithi123.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-17T05:34:42.600 INFO:teuthology.orchestra.run.smithi123.stdout:=============================================================================== 2024-04-17T05:34:42.600 INFO:teuthology.orchestra.run.smithi123.stdout:^* hv01.front.sepia.ceph.com 3 6 377 22 +884us[ +882us] +/- 48ms 2024-04-17T05:34:42.600 INFO:teuthology.orchestra.run.smithi123.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 22 -1197us[-1198us] +/- 54ms 2024-04-17T05:34:42.600 INFO:teuthology.orchestra.run.smithi123.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 19 +301us[ +301us] +/- 73ms 2024-04-17T05:34:42.600 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-17T05:34:42.600 INFO:teuthology.orchestra.run.smithi164.stderr:bash: line 1: ntpq: command not found 2024-04-17T05:34:42.610 INFO:teuthology.orchestra.run.smithi164.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-17T05:34:42.610 INFO:teuthology.orchestra.run.smithi164.stdout:=============================================================================== 2024-04-17T05:34:42.610 INFO:teuthology.orchestra.run.smithi164.stdout:^* hv01.front.sepia.ceph.com 3 6 377 21 +905us[ +921us] +/- 48ms 2024-04-17T05:34:42.610 INFO:teuthology.orchestra.run.smithi164.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 20 -1179us[-1179us] +/- 54ms 2024-04-17T05:34:42.610 INFO:teuthology.orchestra.run.smithi164.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 20 +273us[ +273us] +/- 73ms 2024-04-17T05:34:42.610 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-17T05:34:42.612 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-17T05:34:42.621 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-17T05:34:42.622 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-17T05:34:42.631 DEBUG:teuthology.orchestra.run.smithi123:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-17T05:34:42.962 DEBUG:teuthology.orchestra.run.smithi164:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-17T05:34:43.173 DEBUG:teuthology.orchestra.run.smithi123:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-17T05:34:43.276 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T05:34:43.277 DEBUG:teuthology.orchestra.run.smithi164:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-17T05:34:43.379 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T05:34:43.380 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-17T05:34:43.389 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-17T05:34:43.399 INFO:teuthology.task.internal:Duration was 1047.784004 seconds 2024-04-17T05:34:43.400 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-17T05:34:43.409 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-17T05:34:43.409 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-17T05:34:43.418 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-17T05:34:43.575 INFO:teuthology.orchestra.run.smithi164.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-17T05:34:43.651 INFO:teuthology.orchestra.run.smithi123.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-17T05:34:43.943 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-17T05:34:43.943 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi123.front.sepia.ceph.com 2024-04-17T05:34:43.943 DEBUG:teuthology.orchestra.run.smithi123:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-17T05:34:44.010 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi164.front.sepia.ceph.com 2024-04-17T05:34:44.010 DEBUG:teuthology.orchestra.run.smithi164:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-17T05:34:44.083 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-17T05:34:44.083 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-17T05:34:44.089 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-17T05:34:44.182 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-17T05:34:44.182 DEBUG:teuthology.orchestra.run.smithi123:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-17T05:34:44.187 DEBUG:teuthology.orchestra.run.smithi164:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-17T05:34:44.407 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-17T05:34:44.417 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-17T05:34:44.418 DEBUG:teuthology.orchestra.run.smithi123:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-17T05:34:44.524 DEBUG:teuthology.orchestra.run.smithi164:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-17T05:34:44.619 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-17T05:34:44.716 DEBUG:teuthology.orchestra.run.smithi123:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-17T05:34:44.724 DEBUG:teuthology.orchestra.run.smithi164:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-17T05:34:44.834 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = core 2024-04-17T05:34:44.853 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = core 2024-04-17T05:34:44.920 DEBUG:teuthology.orchestra.run.smithi123:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-17T05:34:44.968 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T05:34:44.969 DEBUG:teuthology.orchestra.run.smithi164:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-17T05:34:45.022 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T05:34:45.023 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-17T05:34:45.033 INFO:teuthology.task.internal:Transferring archived files... 2024-04-17T05:34:45.034 DEBUG:teuthology.misc:Transferring archived files from smithi123:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659843/remote/smithi123 2024-04-17T05:34:45.034 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-17T05:34:45.149 DEBUG:teuthology.misc:Transferring archived files from smithi164:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659843/remote/smithi164 2024-04-17T05:34:45.149 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-17T05:34:45.256 INFO:teuthology.task.internal:Removing archive directory... 2024-04-17T05:34:45.256 DEBUG:teuthology.orchestra.run.smithi123:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-17T05:34:45.266 DEBUG:teuthology.orchestra.run.smithi164:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-17T05:34:45.322 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-17T05:34:45.333 INFO:teuthology.task.internal:Not uploading archives. 2024-04-17T05:34:45.333 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-17T05:34:45.341 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-17T05:34:45.342 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-17T05:34:45.347 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-17T05:34:45.395 INFO:teuthology.orchestra.run.smithi123.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 17 05:34 /home/ubuntu/cephtest 2024-04-17T05:34:45.399 INFO:teuthology.orchestra.run.smithi164.stdout: 393767 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 17 05:34 /home/ubuntu/cephtest 2024-04-17T05:34:45.403 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-17T05:34:45.413 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-17T05:34:45.436 INFO:teuthology.run:Summary data: description: fs/permission/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_misc} duration: 1047.7840039730072 flavor: default mon.a-kernel-sha1: 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 mon.b-kernel-sha1: 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 owner: scheduled_rishabh@teuthology success: true 2024-04-17T05:34:45.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T05:34:45.515 INFO:teuthology.run:pass